Data Engineer

Why Dufrain? We’re a market-leading professional services consultancy delivering Data Engineering, Cloud, Data Strategy & Management and advanced BI & Analytics services to a range of large enterprise clients in data-rich industries.

Dufrain'sData Engineers provide expertise, guidance, and strategic advice to clients in order to help them effectively leverage their data assets for making informed decisions and achieving their business objectives.

Our Data Engineers play a pivotal role in supporting clients navigate the complexities of data management, analytics, and strategy.

OUR DATA ENGINEERS

• Possess a broad range of data engineering skills, with a focus on having delivered primarily in Databricks, although experience with other Spark engines is desirable.

• Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.

• Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.

• Deliver high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.

• Support building the Dufrain consulting practice through contribution to ongoing initiatives. This can include knowledge-sharing activities and building accelerators.

• Have excellent problem-solving, analytical, and communication skills.

• Possess a strong desire to learn and adapt to new technologies.

ROLE DETAILS AND RESPONSIBILITIES

• Design, develop, and maintain Databricks solutions and databases.

• Create solutions to extract, transform, cleanse, and load data (ETL/ELT).

• Conduct unit, system, and performance tests and creating comprehensive documentation.

• Follow agile project delivery methodologies.

• Stay up to date on the latest data engineering trends and technologies.

SKILLS AND EXPERIENCE

Essential

• Databricks- hands on experience developing engineering solutions in Databricks ecosystem, including Unity Catalog.

• SQL- writing optimised and complex queries and understanding of relational databases.

• Python- we specialise in Python solutions.

• DevOps- hands on experience using tools like Terraform for IAC, and Azure DevOps for CI/CD.

• RequirementsGathering

Desirable

• Microsoft Azure- Data Factory, Data Lake, Azure SQL Server.

• Microsoft Fabric- or another spark engine.

• Visualisation tools- Power BI / Tableau.

• DataGovernance - Purview.

• Application Platform Services- Azure Functions, Azure Logic Apps, Power Apps

• ConsultingExperience

About You

• You will share our passionate about data and possess skills and expertise in the following areas:
• A high level of drive with the ability to work to tight deadlines.
• Experience of providing insightful solutions
• The ability to participate effectively in meetings with stakeholders.
• A team player who supports, encourages and shares knowledge with others.
• A self-starter with the ability to work under pressure and with limited supervision.
• A track record of accurate output and responsibility for elements of project delivery.
• The ability to work as part of an integrated team or on an individual basis.
• Awareness of industry standards, regulations and developments.

What we offer you

You can expect guaranteed investment to your personal development. We have a working culture that rewards high performance and nurtures talent, while providing exciting opportunities and challenges to generate positive change for our clients.

Benefits

• Competitive base salary
• Annual Performance related bonus
• Hybrid home/onsite/office working - Edinburgh, Manchester & London
• 25 days annual leave (plus bank and public holidays)
• Birthday day off - celebrate with an extra holiday
• Career progress programme - guaranteed learning and development investment and your own career coach
• Life insurance
• Private medical health insurance
• Contributory pension
• Health and wellbeing group

What to do next

If you’re passionate about data, and you’re looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain. Apply to join us in our quest to get busy living and make a difference.

Once your application has been received a representative from the Dufrain Recruitment team will review your profile and inform you of the next steps.

Please note: The recruitment process will require any candidates that are shortlisted to complete an online technical assessment.

Dufrain offers a diverse, inclusive and engaged culture. A place where people can bring their whole selves to work and be respected for who they are, valued for what they do and celebrated for their contribution to our business and our community.

We are an equal opportunity employer and opposed to discrimination on any grounds. It is the policy of Dufrain to ensure equal employment opportunity without discrimination or harassment on the basis of race, religion, age, sex, sexual orientation, gender identity or expression, marital or domestic/civil partnership status, disability, pregnancy and maternity or any other basis protected by law.

We want to make sure no one is put at a disadvantage during the recruitment process because of a disability, condition or impairment. To assist you with this, we will reduce or remove any barriers where possible and provide additional support where appropriate.