Back to search
Seeking a Technical Lead Data Engineer, Initial 12 Month contract and the position will require weekly visits to site in London.Responsibilities:
- Lead the design, development, and implementation of data engineering solutions for our data Lakehouse platform.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Provide technical leadership, mentoring, and coaching to the data engineering team.
- Ensure best practices in data engineering, including data modeling, ETL processes, and data quality.
- Manage CI/CD pipelines using Azure DevOps or Git.
- Develop and maintain event-driven pipelines using .NET and other relevant technologies.
Skills and requirements:
- Extensive experience with Databricks, Apache Spark, and data lakes.
- Proficiency in Python and SQL.
- Experience with CI/CD processes using Azure DevOps or Git.
- Knowledge of streaming data technologies such as Kafka and KSQL DB.
- Familiarity with reporting tools like Power BI and Qlik.
- Software engineering experience with .NET for event-driven pipelines and automation testing.
- Experience with Databricks Unity Catalog.
- Strong skills in data modeling, including Snowflake modeling, star schema modeling, and other techniques.
- Ability to optimize big data workloads in Spark.
Michael Bailey International is acting as an Employment Business in relation to this vacancy.
