Job description:
Role: Data Engineer
Duration: Permanent
Experience: 6-8+Years
Locations: Need to be flexible for all locations
- Derry Street, London, UK
- Peterborough, UK
- Birmingham, UK
- Warrington, UK
- Norwich, UK
Responsibilities include:
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
- Work with data and analytics experts to design and deliver optimal dataset design and functionality.
Profile:
- Production experience examples of change management tools (Jira etc)
- Advanced data analysis knowledge with proven experience in the following;
- Relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- NoSQL databases, including Postgres and Cassandra
- Python, Java
- Experience building and optimizing data pipelines in Spark 'big data’ environment.
- Experience working in Big Data architecture
- Hadoop, HDFS, Kafka, etc
- Experience in Devops / Data ops practices (Agile code management, sprints, continuous integration)
- Strong analytic skills performing root cause analysis on internal & external data and processes to answer specific business questions and identify opportunities for improvement.
- Good commercial acumen, with a desire to understand detailed requirements and facilitate the process of analyzing solution options and comfortable with making strategic decisions.
- Experience in insurance/reinsurance or financial industry would be a plusBirtish/UK Citizens or ILR or UK Authorised Work permit holders without any sponsorship are encouraged to apply for this role.