- Design, develop, and maintain the Website UI using Ember JS
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Optimize scraping algorithms for efficiency, scalability, and reliability.
- Implement data quality checks and validation processes to ensure accuracy and completeness of scraped data.
- Excellent understanding of all the principles of the data engineering development lifecycle
- Strong development background in Python and Elixir and Ecto wrapper, Ember JS, ideally within an AWS environment
- A strong desire to improve existing implementations, and to innovate and introduce new and exciting ways to achieve the project goals
- Design, develop, and maintain data scraping scripts and pipelines using Python and Elixir
- AWS Certifications an advantage