Principal Data Engineer

Asset Resourcing Limited

Posted 4 days ago, valid for 11 days

Newcastle Upon Tyne, Northumberland NE19 2BG, England

£52,000 - £65,000 per annum

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

The Principal Data Engineer position is a remote role focused on developing scalable and cost-effective data products for a cloud-based environment, specifically in Azure or AWS.
Candidates should have a minimum of 5 years of experience in data engineering or similar roles, along with practical experience in cloud data platforms and ETL processes.
The role involves setting coding standards and best practices for data engineering and requires knowledge of CI/CD pipelines, DataOps, and MLOps.
A competitive salary of £85K, dependent on experience, is offered along with good benefits and opportunities for career progression.
While the position is remote, preference is given to candidates based in the North East for accessibility to the client's Newcastle headquarters.

Principal Data Engineer - Cloud-based (Azure or AWS) - Remote to suit - £85K DoE - Data Solutions Consultancy Services ProviderPrincipal Data Engineer - Background:

As a Principal Data Engineer, you will oversee the development of our Client's data products, ensuring highly scalable, high-performance, and cost-effective data processing and analytics solutions.

In this role, you will provide strategic leadership and technical expertise in the development of cloud data platforms, IoT analytics, and data integration and migration projects. You will set the standards for Data Engineering best practices across the organisation, leading the creation of robust coding standards and development practices, while being accountable for their adherence.

Principal Data Engineer practical experience should include:

•Experience implementing cloud data platforms in either Azure / AWS or significant on-premise design experience.

•5+ years prior experience in data engineering or similar roles.

•Extensive ETL and data pipeline design experience, technology agnostic.

•Experience in creating and ensuring adherence to coding standards for Python and PySpark development

•Experience developing CI/CD pipelines and deep knowledge of DevOps and source control best practices.

•Strong knowledge of DataOps practices and awareness of MLOps practices

•Database Administration experience, including query optimisation and indexing strategies

•Knowledge of NoSQL databases (e.g. DynamoDB, CosmosDB, MongoDB).

•Experience implementing solutions using at least one of the following technologies Azure Data Factory, Azure Event Hubs, Azure Data Lake Storage, Azure Function Apps, Azure Synapse Analytics, AWS Glue, AWS S3, AWS Lambda Functions, AWS Redshift, Databricks, Snowflake, Google Big Query, Alteryx, SSIS, Informatica.

Principal Data Engineer Summary:The role is as remote as you wish, but a preference is for employees to be North East based so the client's Newcastle HQ is accessible.On offer is a competitive salary, good benefits and a career with a growing organisation that offers great career progression.

Apply now in a few quick clicks

Principal Data Engineer

Lead Data Architect

Senior Data Architect

Data Solutions Architect Cloud - Remote