Home
London
Database integrator
Lead Data Engineer

Lead Data Engineer

Harvey Nash

Posted 20 hours ago, valid for 9 days

London, Greater London EC1R 0WX

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

Our client is a global leader in Commodities Trading, seeking a Lead Data Engineer for their trade surveillance team.
The position offers a salary range of £100,000-£110,000 with a hybrid work model requiring 2-3 days a week in the Central London office.
Candidates should have extensive experience in Data Warehouse and Data Lakehousing, particularly with DataBricks, SQL, and Azure Data Factory.
Strong proficiency in Python and Pyspark, along with experience in developing ETL pipelines and working in an Azure environment, is essential.
A minimum of several years of relevant experience is required, and unfortunately, sponsorship is not available for this role.

Our client is a global leader in Commodities Trading, with over $50 billion in revenue annually. They're looking for a Lead Data Engineer to join their global trade surveillance team and help to manage the impacts from new business initiatives.

Title: Lead Data Engineer

Salary: £100,000-£110,000

Hybrid: 2-3 x a week in Central London office

They're looking for a Lead Data Engineer to join this newly established Trade Surveillance team, to help them grow this important business area. You will managing a team consisting of local, offshore, and 3rd party resources.

Key Requirements:

Strong Python and Pyspark experience
Extensive experience with both Data Warehouse and Data Lakehousing is a must, in particular DataBricks, SQL, Azure Data Factory (ADF)
Experience working within a Azure environment is essential
Development of ETL Pipelines, working with Big Data technologies, and data architectures is required
Automation experience e.g., PyTest
Experience with containerized environments

Nice to Have:

Capital Markets/Commodities Trading experience

If you have the above experience and would like to be considered for this position, please click apply now.

Please Note: Unfortunately, sponsorship is not an option for this role.

Apply now in a few quick clicks

Lead Data Engineer

Oracle Developer

Project Administrator

Data Manager