Back to search
AWS Kafka Engineer
3-month contract - up to £580 a day Inside IR35
Heathrow - Hybrid 2/3 days onsite
Role Information:
Design and Development: Build and maintain real-time data streaming pipelines using Apache Kafka, including producer and consumer applications.
Testing Lifecycle: Write Python scripts for performing unit testing around Kafka topics, consumers, producers, and data processing Lambda functions.
AWS Services: Utilise strong knowledge of AWS services, particularly those relevant to stream processing and serverless components like Lambda Functions.
Performance Monitoring: Monitor and troubleshoot Kafka cluster performance issues to ensure optimal functionality.
Collaboration: Work closely with cross-functional teams to integrate Kafka into various platform components and support existing implementations.
Version Control: Manage code using Git, ensuring best practices in version control are followed.
Infrastructure as Code (IaC): Apply knowledge of Terraform for infrastructure management where applicable.
CI/CD Practices: Implement CI/CD processes using GitHub Actions or similar tools to automate deployment workflows.
Technical Skills:
Strong proficiency in Apache Kafka, AWS MSK, and Confluent Kafka.
Excellent programming skills in Python with the ability to write efficient scripts for testing and data processing.
Solid understanding of AWS services used in stream processing environments, especially serverless architectures.
Familiarity with Git concepts for version control.
Knowledge of Infrastructure as Code principles, particularly using Terraform.
Experience with CI/CD tools like GitHub Actions is a plus.
Disclaimer:
This vacancy is being advertised by either Advanced Resource Managers Limited, Advanced Resource Managers IT Limited or Advanced Resource Managers Engineering Limited ("ARM"). ARM is a specialist talent acquisition and management consultancy. We provide technical contingency recruitment and a portfolio of more complex resource solutions. Our specialist recruitment divisions cover the entire technical arena, including some of the most economically and strategically important industries in the UK and the world today. We will never send your CV without your permission. Where the role is marked as Outside IR35 in the advertisement this is subject to receipt of a final Status Determination Statement from the end Client and may be subject to change.
