Data Engineer
Due to a period of significant growth, our client a previous Sunday Times Fast Track 100 company are currently recruiting for an experienced Data Engineer to join the team. Hybrid role with 2 days required on site.
As a Data Engineer, you'll combine software engineering expertise with cutting-edge data practices. You'll design, build, and maintain robust data systems while championing DataOps principles.
Working in a fast-paced, agile environment, you'll collaborate with skilled, multidisciplinary team. You’ll work across cloud platforms like Azure, leveraging tools such as Databricks and more.
Role
- Own the cloud-based infrastructure (Azure) on behalf of the team and the business, working closely with the rest of the Data Insights team to ensure it is fit for their purposes, resilient and secure.
- Build and maintain the end-to-end data pipelines and code repositories used by the Data Insights team, aiming for effective automation.
- Work as part of the Data Insights team to design effective ways to store and provision data (e.g. streaming, ETL, schema design/storage patterns, data processing, etc.)
- Be a strong advocate for quality, ensuring that data and common. repositories of code are delivered and maintained to a high standard.
Key Skills
- Data preparation and modelling, ETL pipelines.
- Experience/appreciation of machine learning technique, platforms and pipelines.
- Extensive experience working with MS-SQL databases and writing MS-SQL scripts.
- A good understanding of Azure services (e.g. Blob storage, Virtual Machines, Batch, Azure functions, CosmosDB, Elastic search, Data lake analytics,) and environments
- Experience in writing software in one or more languages, and familiarity with containerised software development.
- Proven ability to systematically approach tasks and manage multiple changing priorities and expectations.
- Strong technical problem-solving skills.
- Azure cloud experience. (essential)
- Experience building and maintaining a live cloud data lake and data warehouse.
- Experience using the Snowflake ecosystem. (essential)
- Excellent team player, flexible, responsive, takes ownership and can work on the detail in a real time environment.
- Become an important part of the data team and work collaboratively with all stakeholders and team members.
- Ability to get colleagues to buy into and support your suggestions to continually improve and drive change forward.
Please do note my client is unable to provide any sponsorship - so the successful candidate must have the full right to work in the UK.