Lead Data Engineer

Lead Data Engineer - Global Technology Consultancy

Salary - £96,000 per annum (depending on experience)

Location - London (Hybrid)

Permanent position - UK passport holders or ILR right to work

Are you a seasoned data engineering consultant with a passion for delivering cutting-edge solutions to enterprise clients? My client, a global technology consultancy, is looking for a Lead Data Engineer to drive high-impact data transformation projects for their UK customers.

This is a client-facing, leadership role, perfect for someone who thrives in fast-paced consultancy environments, has a proven track record in data strategy execution, and can lead technical teams in cloud-driven, Agile settings.

Key Responsibilities:

• Consult with enterprise clients to design, build, and optimize scalable, high-performance data solutions.
• Architect and maintain ETL/ELT pipelines using Apache Airflow and PySpark, ensuring seamless data processing.
• Develop robust data warehouse, data lake, and lakehouse solutions tailored to client needs.
• Advise clients on data modelling best practices, leveraging Kimball/Inmon methodologies and data normalization techniques.
• Work with cloud-native data technologies across Azure, GCP, and AWS, including Azure SQL, PostgreSQL, Google BigQuery, MongoDB, and Google Firestore.
• Oversee the implementation of big data file formats (Avro, Parquet, ORC, Delta) and ensure data integrity across structured and semi-structured datasets.
• Drive API development and integration, ensuring seamless workflows within microservices-based architectures.
• Implement best practices in DevOps and data engineering, including version control (Git), CI/CD pipelines, and integration testing.
• Act as a trusted advisor, mentoring teams and ensuring high-quality project delivery in line with client expectations.
• Stay ahead of emerging data technologies and help clients future-proof their data ecosystems.

What We're Looking For:

• Consultancy experience is essential - ability to work directly with enterprise clients, define data strategies, and deliver business value.
• Strong proficiency in Python and SQL (PostgreSQL or SQL Server preferred).
• Hands-on expertise with Apache Airflow, PySpark, and cloud-based data solutions.
• Familiarity with Databricks (preferred but not mandatory).
• Deep understanding of data warehousing, dimensional modelling, and big data architectures.
• Experience designing API-driven integrations and working with REST and microservices architectures.
• Exceptional stakeholder management and communication skills - ability to translate complex data concepts into business value.

Required Experience & Education:

• Bachelor's degree in Computer Science, Data Science, or a related field.
• 5+ years of experience in data engineering, cloud computing, and technology implementation within a consultancy environment.
• Proven ability to lead technical teams, manage multi-shore projects, and deliver within SaaS/PaaS ecosystems.

This is a fantastic opportunity for a data engineering consultant who wants to work on high-impact, enterprise-scale projects while shaping the future of cloud-based data ecosystems.

If you're a strategic thinker with strong technical acumen and a consultancy mindset, let's talk! ??