Graph Database Data Engineer - Dublin
Atrium UK are seeking a highly skilled and experienced Senior Data Engineer with expertise in graph databases to join a dynamic team. The ideal candidate will have a strong background in data engineering, graph querying languages, and data modeling, with a keen interest in leveraging cutting-edge technologies like vector databases and LLMs to drive functional objectives.
- Develop, and implement scalable data pipelines using Azure Databricks and Azure Data Lake.
- Create and maintain ETL workflows to ensure data quality, integrity, and availability.
- Demonstrated ability to manage and analyze data at scale within the Azure ecosystem.
- Develop and optimize graph database solutions using querying languages such as Cypher, SPARQL, or GQL. Neo4J DB experience is preferred.
- Build and maintain ontologies and knowledge graphs, ensuring efficient and scalable data modeling.
- Work with Large Language Models (LLMs) to achieve functional and business objectives.
- Ensure data quality, integrity, and security while delivering robust and scalable solutions.
- Data Modeling: Strong skills in creating ontologies and knowledge graphs. Presenting data for Graph RAG based solutions.
- Vector Databases: Understanding of similarity search techniques and RAG implementations.
- Coach junior data engineers on technologies like Azure Databricks and Azure Cosmos database.
- Implement CI/CD pipelines using Azure DevOps to streamline deployment processes.
- Conduct code reviews, provide mentorship, and facilitate knowledge sharing sessions within the team.
- Integrate data from various sources into a centralized data lake, enabling unified access and analysis.
- Perform data cleansing, transformation, and migration tasks as required.
- Monitor and troubleshoot data pipelines and resolve any issues promptly.
Essential:
- Highly Experienced hands-on in data engineering with experience working with Graph DB.
- Experienced in Azure Databricks, Azure Data Lake, and Azure Cosmos DB & proven track record of building data engineering solutions
- Proficient in programming languages such as Python, SQL, and Scala.
- Experience with big data technologies including Apache Spark, Hadoop, and Hive.
- Knowledge of tools and technologies such as Azure Data Factory, AzureSynapse Analytics, and Apache Kafka.
- Solid understanding of CI/CD pipelines and hands-on experience with DevOps tools such as Git for continuous integration and deployment.
- Excellent problem-solving skills and the ability to troubleshoot complex data issues.
- Strong coaching abilities, Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
- Communication: Excellent verbal and written communication skills
- Qualifications: Microsoft Certified: Azure Data Engineer Associate. Databricks Certified Associate Developer for Apache Spark. Experience with data governance and data security practices. Knowledge of Docker, Podman and Kubernetes for containerization and orchestration.
Click Apply now/Contact Lianne to be considered for the Graph Database Data Engineer - Dublin role