Azure Data Engineer (SQL Development / Azure Services)

IMPORTANT REQUIREMENT: Data Engineering, Azure Data Services and SQL design and development

Overview:We are delighted to represent an exciting opportunity for a skilled Azure Data Engineer. In this role, you will design, develop, and maintain data solutions that underpin clients’ digital transformation goals. The focus is on Microsoft technologies, particularly SQL, with a strong emphasis on cloud-based solutions.

Key Responsibilities:

1. Data Solutions Development

   • Design, develop, and implement data solutions using SQL and relevant scripting or programming languages to meet various client requirements.
   • Deliver data transformation and migration projects.

2. Collaboration and Integration

   • Work closely with cross-functional teams to seamlessly integrate data solutions into existing systems and workflows.
   • Ensure data integrity and security across all solutions.

3. Azure Cloud Expertise

   • Use Azure services to create scalable and secure cloud-based data architectures.
   • Troubleshoot and resolve data-related issues promptly.
   • Stay up-to-date with emerging technologies and best practices in data engineering and cloud services.

Skills and Qualifications:

1. Microsoft Technologies

   • Advanced proficiency in SQL (including query optimisation, stored procedures, and performance tuning for MS SQL Server or PostgreSQL).
   • Strong hands-on experience with scripting/programming languages for data solution development.

2. Azure Cloud

   • Proven knowledge of key Azure services, such as:
     • Azure Data Factory for ETL processes
     • Azure SQL Database and Azure Synapse Analytics/Microsoft Fabric for data storage and analysis

3. Data Engineering Fundamentals

   • Experience in data modelling and designing scalable, optimised data pipelines
   • Strong understanding of ETL/ELT processes and data transformation
   • Familiarity with data warehousing concepts, including star and snowflake schemas

4. Automation and Integration

   • Proficiency in PowerShell, Python, Spark, or Azure CLI for automating Azure services
   • Ability to integrate data solutions with enterprise systems and workflows

5. Security and Compliance

   • Working knowledge of Azure data security best practices (Azure Key Vault, RBAC, encryption)
   • Awareness of data compliance standards (e.g., GDPR)

6. Problem-Solving and Collaboration

   • Excellent analytical and troubleshooting skills
   • Strong communication skills to effectively collaborate with teams and stakeholders

7. Desirable Extras

   • Familiarity with Power BI or Tableau for data visualisation
   • Experience with Azure Databricks or Azure Machine Learning for advanced analytics and AI integration
   • Understanding of DevOps practices and CI/CD pipelines in Azure
   • Knowledge of C#/.NET