Back to search
Key Responsibilities
- Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other relevant tools.
- Manage and optimise Azure Storage for efficient data storage and retrieval.
- Collaborate with data analysts and business stakeholders to understand reporting requirements and translate them into effective data models and reports.
- Create and maintain Power BI dashboards and reports that provide actionable insights and support strategic initiatives.
- Develop and maintain data integration solutions using Azure Logic Apps and Azure Functions to ensure seamless data flow between different systems and applications.
- Implement and manage CI/CD pipelines for continuous integration and delivery.
- Ensure data accuracy, integrity, and security by implementing best practices and adhering to industry standards.
- Monitor and troubleshoot data workflows, ensuring high availability and performance.
- Stay up to date with the latest Azure technologies and industry trends, continually enhancing the data engineering, reporting, and integration capabilities of the team.
Skills and experience
- Proven experience as an Azure Data Engineer or in a similar role, with a strong focus on data integration and reporting.
- Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage.
- Strong expertise in SQL, data modelling, and ETL processes.
- Experience with Power BI or similar reporting tools, including dashboard creation and data visualization.
- Solid understanding of data integration techniques and tools, ensuring seamless data flow between systems.
- Proficiency with Azure Logic Apps and Azure Functions for workflow automation and integration.
- Experience with API integration and data synchronization between on-premises and cloud environments.
- Strong proficiency in developing CI/CD pipelines using tools like Azure DevOps
- Solid understanding of data governance, data quality, and data security best practices.
- Excellent problem-solving skills and the ability to work independently and collaboratively in a fast-paced environment.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
