Senior / Lead Data Engineer - Consultancy - Eligible for SC Clearance - AWS or Azure - London
I’m looking for an experienced Senior / Lead Data Engineer to join a successful, multinational Consultancy in their London office working on high profile client projects.
As a Senior Data Engineer, you'll design and implement cutting-edge data solutions that transform their clients' businesses. You'll work with cross-functional teams to create scalable, efficient architectures that turn complex data challenges into opportunities for innovation.
Your role
- Design end-to-end data architectures that align with business objectives
- Create cloud-native solutions leveraging PaaS, serverless, and container technologies
- Build robust data pipelines for both batch and streaming processes
- Collaborate with clients to understand their data landscape and requirements
- Mentor team members and champion best practices in data architecture
To be considered you will be able to demonstrate skills and experience in many of the following:
- Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL
- Deep knowledge of either:
AWS (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB)
Or
Azure (Data Factory, Synapse, Databricks, Event Hubs, Logic Apps, Cosmos DB)
- Experience with data processing across structured and unstructured sources
- Strong scripting abilities and API integration skills
- Knowledge of data visualization and reporting best practices
Desirable but not essential:
- Experience with data mining and machine learning
- Natural language processing expertise
- Multi-cloud platform experience
They will with an Agile environment with Scrum practices, Cross-functional collaborative teams and need someone who can work from the London office or client sites 2 days a week.
Salary: £80,000 - £100,000 + 25 days holiday (option to buy 5 more) + pension + Performance Bonus + share options
Location: Hybrid working - 2 days a week in the London office or on Client site
SC ClearanceEligibility - you must be eligible for SC Security Clearance (or higher) - this means at least 5 years residence in the UK and in that time you’ve not been out the country for more than 29 days consecutively and no more than 6 months out the country per year.