Cloud Data Engineer - 6 Months (Outside IR35) - Hybrid (Edinburgh)Lorien is recruiting for a Cloud Data Engineer on a initial 6 month contract.Main Responsibilities* Implement the data pipelines that handle the ETL processes in the AWS environment.* Automate the nightly data transfer from on-premises Oracle databases to the AWS environment.* Collaborate with the ETL Engineer to ensure seamless integration between the extraction and transformation steps.* Set up monitoring and logging to track the performance and reliability of the data pipelines.* Optimize the data ingestion process for performance and scalability.* Troubleshoot and resolve issues related to data pipelines and ETL processes.* Document data engineering processes and ensure alignment with best practices.Key Skills* Bachelor's degree in Computer Science, Data Engineering, or a related field.* 3+ years of experience in data engineering, with a focus on ETL pipeline development.* Proficiency in AWS services like Glue, Lambda, S3, and Redshift.* Strong programming skills in Python, SQL, or other relevant languages.* Experience with data pipeline monitoring and performance optimization.* Knowledge of Oracle database structures and data migration strategies
Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.