Back to search
We are partnered with a fast-growing FinTech group looking to expand their data engineering team. As a Data Engineer, you will have extensive experience working with Azure cloud services, CI/CD, SQL, and Python. In this role, you will design, build, and maintain scalable data pipelines, optimise data storage solutions, and ensure data integrity and availability across their clients' platforms.
Key Responsibilities:
- Develop, maintain, and optimise ETL processes using Azure services such as Azure Data Factory, Azure Functions, and Logic Apps.
- Create and manage data workflows that extract data from various sources, transform it, and load it into Azure Data Lakes, Azure Synapse Analytics, or Azure SQL Databases.
- Ensure that infrastructure is designed for scalability, security, and cost-effectiveness using Azure-native tools like Azure Monitor, Azure Security Centre, and Azure Cost Management.
- Design and optimise data storage solutions using Azure services, including Azure Blob Storage, Azure Synapse Analytics, Azure SQL Database, and Cosmos DB.
- Ensure data is stored efficiently and securely, with appropriate backup and disaster recovery strategies using Azure Backup, Azure Site Recovery, and Azure Key Vault.
- Develop Python scripts to automate data processing tasks within Azure, leveraging Azure Functions, Azure Batch, or Databricks to improve workflow efficiency.
Experience:
- 2-5 years of experience as a Data Engineer.
- Hands-on experience with Python, Java, R (or similar).
- Experience with cloud platforms such as Azure.
- Extensive experience with SQL (MySQL/SQL Server).
- Experience with data pipeline orchestration tools, such as Azure Data Factory or Apache Airflow.
- Familiarity with CI/CD pipelines and version control systems (e.g., Azure DevOps, Git).
Benefits:
- £55k - £70k
- Bonus of 20-30%.
- Opportunities for professional development and certification.
- 3 days working from home per week.
