Back to search
100% On-Site Required // No Sponsorship Available
Our client are a global telecommunication company within their AI Infrastructure Team.
Brief:
We are looking for a highly skilled Senior IT Engineer to manage a large-scale AI development and training infrastructure.
The role involves overseeing GPU servers, Kubernetes clusters (Rancher), and storage systems to ensure seamless operations and optimized performance. You will collaborate with development teams, ensuring they have the resources and support needed to run their projects efficiently.
This is a critical technical position requiring expertise in Kubernetes, hardware management, automation
Responsibilities:
Kubernetes and Rancher Management: Configure, scale, and maintain Kubernetes clusters and Rancher for multi-cluster management, ensuring optimal performance and resource allocation.
GPU Resource Management: Manage GPU resources and servers, ensuring efficient resource scheduling, load balancing, and performance optimization for AI workloads.
Storage Management: Maintain and optimize large storage systems, ensuring high availability, performance, and data persistence.
DevOps and Automation: Implement CI/CD pipelines and automate infrastructure management using tools such as Terraform, Ansible, Jenkins, and GitLab CI.
Monitoring and Troubleshooting: Set up and manage monitoring and logging systems (e.g., Prometheus, Grafana, ELK) to ensure high availability and rapid issue resolution.
AI Framework Optimization: Collaborate with data scientists and AI developers to optimize AI frameworks (e.g., TensorFlow, PyTorch) for GPU and cluster environments.
Security and Access Management: Implement and manage role-based access control (RBAC) and ensure data security, encryption, and backup procedures are in place.
Key Requirements:
Proven experience in managing large-scale Kubernetes clusters and containerisation technologies (e.g., Docker).
Strong understanding of GPU resource management and optimization for AI workloads.
Expertise in managing large storage systems and implementing data persistence strategies.
Proficiency in scripting and automation (Python, Bash, Go), with experience in infrastructure as code (IaC) using Terraform, Ansible, or similar tools.
Familiarity with deep learning frameworks (e.g., TensorFlow, PyTorch) and experience optimizing them for large-scale environments.
Experience with monitoring and logging tools such as Prometheus, Grafana, and ELK.
Desirables:
Experience with Rancher or other Kubernetes management platform Experience in managing hybrid cloud environments Preferred Red Hat Certified System Administrator (RHCSA) Preferred Certified Kubernetes Administrator (CKA) Preferred Mandarin Speaker.
