Data Engineer

An exciting opportunity has arisen for a Data Engineer to join my client’s dynamic and growing data team. This role is ideal for someone with strong Databricks, Azure, and Python expertise who is eager to work across the full data lifecycle—streaming, enrichment, and curation—within a cutting-edge Azure cloud environment.

As part of this role, you will be responsible for designing, developing, and maintaining scalable data pipelines, ensuring data quality, and integrating key data sets. You will collaborate with analytics and data science teams to support AI and machine learning initiatives while gaining hands-on experience with ML Ops.

• Develop and optimise data pipelines using Databricks, Azure Data Factory, and PySpark for large-scale data processing.
• Automate data ingestion, transformation, and enrichment, ensuring seamless data integration across the organisation.
• Work with Python and SQL to analyse and process large datasets, enhancing data quality.
• Implement data streaming solutions with Azure Synapse and Delta Lake.
• Manage and maintain source code repositories (GitHub) and version control best practices.
• Investigate and apply AI/ML solutions to enhance data pipelines and cloud-based architectures.
• Contribute to a collaborative, innovative, and fast-paced data engineering environment.

• Proficiency in Python and SQL for data engineering and analytics.
• Experience with Azure cloud data solutions, particularly Databricks, Azure Data Factory, and Synapse Analytics.
• Hands-on experience with PySpark or equivalent for big data processing.
• Proven ability to build scalable and automated data pipelines in a cloud environment.
• Exposure to AI/ML concepts and a willingness to develop expertise in ML Ops.
• Strong problem-solving and analytical skills with excellent attention to detail.
• Ability to work effectively within a team and communicate with stakeholders.

• Work with the latest technologies in Databricks, Azure, and AI-driven data engineering.
• Exciting career growth opportunities with ongoing professional development and ML Ops training.
• Join an innovative and forward-thinking data team, shaping the future of cloud-based analytics.

If you are a motivated Data Engineer with a passion for Databricks, Azure, and Python, we’d love to hear from you!