Airflow SME

Lorien

Posted 7 days ago, valid for 11 days

London, Greater London EC1R 0WX

£45,000 - £54,000 per annum

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

The job is for an Airflow Subject Matter Expert (SME) on a 6-month contract based in London, offering a remote or hybrid work option and is inside IR35.
The role requires providing technical leadership in data engineering across various projects, guiding a team of data professionals in an agile environment.
Candidates must have proven experience with Apache Airflow, strong Python programming skills, and familiarity with cloud platforms like AWS.
A salary range is not explicitly stated, but the position requires significant expertise in data warehousing, ETL/ELT tools, and SQL, typically necessitating several years of relevant experience.
Strong problem-solving, communication, and collaboration skills are essential, along with a deep understanding of infrastructure hosting for Airflow.

Airflow SME

6 month contract
Based in London
Remote / Hybrid role
Inside IR35

The role

Provide technical leadership on data engineering (acquisition, transformation, distribution), across multiple projects and squads
Guide, nurture, and coach a team of data engineers, architects and database administrators working in an agile, fast-paced environment
Drive adoption and evolution of frameworks and products based on best-in-class data management technologies, such as ETL/ELT tools, open-source frameworks, workflow management tools, etc.
Provide suggestions and recommendation on how to improve the overall data engineering architecture towards a scalable, cost effective ecosystem

Your expertise:

Excellent understanding of enterprise data warehousing principles of ETL/ELT and the tools/technologies used to implement them
Proven experience with Apache Airflow, including designing and maintaining complex workflows.
Strong knowledge of Python programming.
Experience with SQL and relational databases.
Familiarity with cloud platforms (e.g., AWS) and their data services.
Experience with version control systems such as Git.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration skills.
Be an expert in handling ECS, Fargate, EC2, EKS infrastructure hosting Airflow.
DBT including handling Infrastructure related upgrades and optimising DBT code (desirable).

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.

Apply now in a few quick clicks

Airflow SME

Data Architect

Data Architect

Data Architect - DV Cleared