Data engineer

Sanderson

Posted 2 days ago, valid for 20 days

South Croydon, Surrey CR2 0JT, England

£45,000 - £54,000 per annum

Full Time

In order to submit this application, a Reed account will be created for you. As such, in addition to applying for this job, you will be signed up to all Reed’s services as part of the process. By submitting this application, you agree to Reed’s Terms and Conditions and acknowledge that your personal data will be transferred to Reed and processed by them in accordance with their Privacy Policy.

Sonic Summary

The role is for a Data Engineer in the public sector requiring SC clearance.
The contract length is 6 months with a rate of £400-£500 per day and is classified as outside IR35.
The position requires a minimum of 5 years of experience in an iterative and Agile development environment.
Key responsibilities include building data ingestion pipelines using AWS technologies and preparing data for modeling.
The role has an onsite requirement of 2 days a week and involves working with various data formats and AWS database services.

- Sector: Public sector / Government

- Clearance required: SC clearance

- Contract length: 6 months

- Rate: 400-500/d

- IR35 status: Outside

- Onsite requirement: 2.d a week

- Role title: Data engineer

Job Description:

· Build streaming data ingestion pipelines using AWS MSK and batch data ingestion pipelines using APIs

· Prepare data for prescriptive & predictive modelling.

· Experience working with various data formats e.g., parquet, avro, json

· Experience in building ETL pipelines using Lambda, Step Functions and Glue

· Experience working with various AWS database services (e.g., RDS, DynamoDB and Redshift)

· Technical expertise with various data modelling techniques

· Hands-on experience with Python and SQL

· Kafka Streaming data experience to build the new data pipelines.

Supporting Skills

· 5 years' experience in an iterative and Agile development environment

· Appreciation of Software Development Environments & Languages

· Appreciation of Business Analysis Activities

Appreciation of other scripting language, eg JavaScript, Lua, Perl, PHP, Unix

Apply now in a few quick clicks

Data engineer

Snowflake Data Architect - £110,000-£125,000

Oracle Cloud Integration and Data Architect

Oracle Cloud Integration and Data Architect