Lead Data Engineer
Cheshire- Hybrid working
£80,000-£85,000+ benefits
We are seeking a highly skilled and experienced Lead Data Engineer to join a growing Insurance firm and report into the Head of Data. The ideal candidate will be a strong Azure user and have extensive experience with data engineering
Lead Data Engineer duties:
- Lead the design, implementation, and maintenance of scalable data pipelines to support business analytics, reporting, and machine learning initiatives.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver data solutions that meet organisational needs.
- Oversee the architecture of data infrastructure, including data warehousing, ETL processes, and data storage solutions.
- Ensure data quality, consistency, and security across systems.
- Optimise the performance and scalability of data systems.
- Provide technical leadership and mentorship to a team of data engineers, fostering a culture of continuous learning and improvement.
- Guide the adoption of best practices for data engineering, including code reviews, testing, and deployment processes.
- Monitor data pipeline performance and troubleshoot issues to ensure data availability and reliability.
- Stay up to date with the latest trends and technologies in the data engineering space and evaluate tools to continuously improve data infrastructure.
- Ensure compliance with data governance, privacy, and regulatory requirements.
As Lead Data Engineer, you will have:
- Experience with machine learning frameworks or data science workflows.
- Familiarity with modern BI and data visualization tools (e.g., Tableau, Power BI).
- Experienced doing similar duties within a similar role capacity..
- Experience with ETL tools and frameworks.
- Solid understanding of data modelling, data warehousing, and database design principles.
- Familiarity with data governance, data privacy regulations (GDPR, CCPA), and best practices for data security.
- Expertise in cloud platforms preferably Azure and associated data services.
- Excellent communication skills and the ability to work collaboratively with cross-functional teams.
- Strong problem-solving skills and a passion for working with large datasets and complex data challenges.
Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates