Back to search
Wer have a 5 month project for an Azure Platform Data Architect.
The Role:
- CI/CD, Source Control for Fabric (covering as many of the services as possible)
- Implement Testing Automation: Standardize testing processes, incorporating schema validation, data reconciliation, and automated testing within CI/CD workflows.
- Professional development practices and environment for Analytics (linked to the CI/CD) embed within the team
- Enabling Fabric Migration (Fabric Data Engineering/ Data Platform HLD and LLDs, migration strategy, workspace design etc). This can include the layers of the Data Lake(One Lake) and how they should be structured via workspaces.
- Establish Near Real-Time Data Lake: Configure Fabric’s replication and mirroring capabilities to enable near real-time ingestion of core systems (e.g., ERS Billing, SmartGen, Salesforce, ETRM, Finance).
- Build Metadata-Driven Orchestration: Develop a configurable orchestration solution using a metadata-driven approach to manage pipeline workflows.
Key Skills:
- Database Management: such as SQL, NoSQL, and NewSQL databases, including their design, implementation, and optimization.
- Azure Cloud Platforms: with an understanding of data storage, processing, and security in the cloud environment.
- Big Data Technologies: Familiarity with Azure MS Fabric and frameworks for handling large-scale data processing tasks.
- ETL Processes: Knowledge of Extract, Transform, Load (ETL) processes and tools for integrating data
- Programming Languages: such as Python, Java, Scala, and SQL for data manipulation and analysis.
- Data Warehousing: Experience in designing and managing data warehouses, including schema design, indexing, and partitioning. .
- Security and Compliance: Understanding of data security best practices and compliance requirements (GDPR, HIPAA, etc.) to ensure data protection and privacy.
Please note the successful candidate will be required on site 2 - 3 days per week
