Data Engineer, Azure

Arc IT Recruitment

Posted 2 days ago, valid for 6 days

London, Greater London EC2V 7WS, England

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

A Data Engineer with extensive cloud experience is sought by a financial services organization in London, offering a competitive salary plus bonus and excellent benefits.
The role requires a minimum of 5 years of experience in a cloud environment using data engineering tools and involves developing standards for federated data teams.
Key responsibilities include designing secure data pipelines, integrating and cleaning data, and optimizing data processing workflows.
Candidates should be proficient in Python, Microsoft Fabric, Azure Data Factory, and other related tools and technologies.
This position is part of the central data platform team, aiming to create a flexible and efficient data engineering development environment.

Data Engineer, AzureLondon/Hybrid£competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities

Work with Product Owners to establish product requirements.
Design and develop observable and secure data pipelines.
Source, integrate and clean data using medallion architecture.
Ensure data completeness, integrity and validity.
Create Lakehouses and Warehouses.
Optimise data pipelines, processing workflows and Fabric warehouses for performance.
Maintain Data Catalogue and ensure data duplication does not occur.
Ensure data security is implemented and enforced.
Set and own standards in the Data Engineering space.
Work with the DevOps team to establish CI/CD processes.
Work with other members of the central platform team to monitor the Microsoft Fabric feature roadmap and integrate new features into the established eco-system.
BCP/DR strategy.
Work with other members of the central platform team to define an efficient project process to deliver new data products.

Skills

Minimum 5 years working in a cloud environment using data engineering tools on a variety of complex products.
Python
Microsoft Fabric
Power BI
Semantic Models
Azure Data Factory
Azure Synapse
SQL Server
ETL/ELT
Database Design
Data Warehousing
Datalake / Lakehouse

For a full consultation on this exciting new opportunity, get in touch with Arc IT today!

Apply now in a few quick clicks

Data Engineer, Azure

Principal Data Architect

Data Architect

Senior Data Architect