Lead Big Data Engineer

Lead Big Data Engineer
Salary: £94,000 DOE
Location: London (4 days a week on site)

** MUST HOLD AN ACTIVE DV CLEARANCE **

Benefits: Health care, dental, flexible working, critical illness cover, health assessments and annual incentive programme.
As the Lead Big Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our big data architecture. You will work with the wider teams to ensure seamless data integration
Responsibilities:

• Develop and maintain scripts for automation processes and work flows
• Conduct thorough testing to ensure seamless integration
• Data pipeline support by managing and optimising
• Utilise detailed knowledge of Linux internals
• Troubleshooting by diagnosing and resolving technical issues
• Following network protocols
• Design scalable big data systems
• Data pipeline support
• Hybrid cloud management
• Implement and support business intelligence and visualisation tools
• Utilise big data NoSQL engines and platforms

Requirements:

• Experience with Python /Bash
• Strong troubleshooting skills
• Strong understanding of TCP/ IP and OSI Models proven experience with integration testing
• Strong knowledge of Linux internals
• Experience working in AWS Cloud environment's
• Big data NoSQL
• Experience AI tools such as Jupyter / Spacy
• Business intelligence tools like Tableau/ Power BI
• AWS Certification (desirable)
• Big data tools and technologies. Hadoop/ Cloudera (desirable)

If you have the required skills set, and this role is of interest please apply online or email