Home
London
Database developer
Databricks Data Engineer Contract

Databricks Data Engineer Contract

Harnham - Data & Analytics Recruitment

Posted 4 days ago, valid for a month

London, Greater London EC1R 0WX

£40,000 - £48,000 per annum

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

Harnham is seeking a candidate for a role focused on developing a Databricks platform for a large retail business.
The ideal candidate should have extensive experience with Spark, Databricks, Delta Lake, and handling real-time data issues.
Experience with dbt, particularly versioning, and real-time pipelines involving formats such as Avro and ORC is desired.
Candidates should also be familiar with Azure Data Factory and have knowledge of managing large data sizes, specifically 10 GB with 4 GB Driver memory.
The position requires significant expertise in the specified technologies, and the salary details are not explicitly mentioned in the job description.

Harnham has partnered with a large retail business who are developing their Databricks platform.

YOUR SKILLS AND EXPERIENCE

Extensive experience in Spark, Databricks, and Delta Lake, particularly regarding real-time issues and partitioning strategies.
Experience in is desired dbt (especially regarding versioning) and real-time pipelines, including formats like Avro and ORC
Experience in streaming data and related to Azure Data Factory (ADF).
Handling large data sizes 10 GB data with 4 GB Driver memory and understanding the impact on performance.
Configuration with spark with shuffle partitions.

TECH REQUIRED

Databricks, Spark, and Deltalake
DBT
ADF
Large data sets

If you have experience in the above requirements and tech stack, please apply using the link and we can have a chat tomorrow morning!

Apply now in a few quick clicks

Databricks Data Engineer Contract

Database Developer - 12 Month Contract

Lead Data Engineer - £95,000

Lead Data Engineer - Azure & Databricks