Back to search
Job Title: Senior Data Engineer
Location: London - Hybrid - 1 day a week in the officeContract Type: 6 Month contract with possible extension
The Company:This company is an incredible commercial broadcaster with a diverse range of content. At the heart of their operations is a commitment to using cutting-edge technology to transform how they engage with their audiences. To make this happen, they have a Data Centre in London with a team who plays an imperative role in enabling data-driven decision-making across the organisation.
The Role:
Are you a Senior Data Engineer with passion to join an innovative Data Centre team?
Do you want to be involved in building and optimizing large-scale data solutions in AWS Databricks, GCP Dataproc, Airflow, and PySpark?
As a Senior Data Engineer in this Data Centre, you will lead efforts to design, develop, and deploy robust data pipelines that power key business insights.
You will have an opportunity to work closely with cross-functional teams, including data scientists, analysts, and software engineers, to deliver solutions that enable seamless data access and drive decision-making across the entire Organisation.
Skills:
Essentials: AWS Databricks - Pyspark - GCP - Airflow
Nice to Have: Python - Data modelling - Scala - Previous Media - Broadcasting exp - CI/CD
Responsibilities:
- Design, implement, and manage scalable data pipelines using AWS Databricks, GCP Dataproc, and PySpark.
- Optimize workflows for batch and real-time data processing using Airflow.
- Collaborate with the Head of Engineering and CTO to translate business needs into effective data engineering solutions.
- Ensure data quality and reliability through robust testing, monitoring, and documentation practices.
- Lead the integration of structured and unstructured data sources into data lake and warehouse solutions.
- Drive innovation by exploring and implementing best practices in cloud-based data engineering.
- Provide mentorship and technical guidance to junior team members.
How to Apply:If all of this resonates with you, and it made you excited to learn more about the opportunity, then we'd love to hear from you! Please submit your CV and other relevant information regarding the role !
