Expoint - all jobs in one place

The point where experts and best companies meet

Limitless High-tech career opportunities - Expoint

Qualcomm Staff Engineer Machine Learning Technical Support - Cork 
Ireland, Cork 
940299534

19.11.2024

QT Technologies Ireland Limited

Job Area:

Information Technology Group, Information Technology Group > IT Engineering

Key Responsibilities

  • Kubernetes Orchestration & Resource Management: Serve as the subject matter expert for Kubernetes and container orchestration. Guide customers through the design and deployment of Kubernetes clusters tailored for AI/ML use cases, helping them effectively manage workloads through Run:AI. Ensure optimal resource allocation, including GPU sharing, node management, and job scheduling across clusters.

  • Cluster Monitoring & Optimization: Monitor and tune Kubernetes clusters to ensure they are optimized for AI/ML workloads. Provide support on managing Kubernetes autoscaling, resource quotas, and performance monitoring of distributed ML models running on Kubernetes clusters via the Run:AI platform.

-GPU troubleshooting and incident response: Diagnose and resolve complex issues regarding dependencies between GPU drivers and software, Nvidia toolkit errors, or GPU component failure.

  • Run:AI Platform Support: Provide expert support for the Run:AI platform, assisting customers with the deployment, configuration, and management of Kubernetes clusters that handle AI/ML workloads. This includes setting up the platform, configuring resource pools (GPU, CPU), and optimizing Kubernetes namespaces to ensure proper orchestration of workloads.

  • Workload Optimization on Kubernetes: Assist customers in optimizing dynamic resource allocation for their AI/ML workloads by utilizing the Run:AI scheduler in conjunction with Kubernetes's native tools. Help manage job preemption, scheduling priorities, and horizontal scaling of workloads across clusters.

  • Kubernetes Troubleshooting & Incident Response: Diagnose and resolve complex issues related to Kubernetes cluster management, including pod failures, node connectivity issues, and namespace misconfigurations. Provide support in handling incidents such as job contention, GPU misallocation, and failed containerized workloads, ensuring smooth operation across the entire Kubernetes environment.

  • Integration Support: Help customers integrate Run:AI into their existing Kubernetes-based ML infrastructure. Ensure seamless operation of AI/ML pipelines, covering data flow, distributed training, and model deployment. Troubleshoot issues arising from the interaction between Run:AI, Kubernetes, and other ML tools (e.g., TensorFlow, PyTorch, Kubeflow).

  • Security and Best Practices in Kubernetes: Advise customers on security best practices for Kubernetes clusters handling sensitive ML workloads, such as secure pod communications, role-based access control (RBAC), and resource isolation for multi-tenant clusters. Ensure Kubernetes and containerized environments are secure and compliant with organizational policies.

  • Collaboration with HQ: Work closely with the engineering and product teams in HQ, providing feedback on Kubernetes-related issues, cluster optimization features, and improvements to the Run:AI platform. Escalate complex issues and contribute to ongoing platform development.

  • Training & Documentation: Develop training materials and deliver technical workshops on using Run:AI in Kubernetes environments. Maintain up-to-date documentation on best practices for configuring and managing Kubernetes clusters for AI/ML workloads, focusing on high availability, performance, and security.

Minimum Qualifications:

• 4+ years of IT-related work experience with a Bachelor's degree.

7+ years of IT-related work experience without a Bachelor’s degree.

Physical Requirements:

• Frequently transports and installs equipment up to 20 lbs.

Requirements

  • 3+ years of experience in technical support roles with strong expertise in Kubernetes administration, container orchestration, and AI/ML workload management.

  • 1+ year of general GPU administration, addressing issues with driver conflicts, hardware failures, and performance issues

  • In-depth knowledge of Kubernetes (CKA or CKAD certification highly preferred), including core components like Kubelet, Kube-API, Kube-scheduler, and etc.

  • Proficiency in Kubernetes resource management (e.g., CPU/GPU allocation, pods, services, and namespaces) and troubleshooting common Kubernetes issues in production environments.

  • Experience with configuration management tools (Puppet, Chef, Ansible) and Kubernetes management platforms like Rancher a plus

  • Experience with Run:AI platform or similar tools for ML workload optimization (e.g., Kubeflow, MLFlow, Slurm) in Kubernetes environments.

  • Hands-on experience with Docker and containerized environments for AI/ML operations, including distributed training, scaling, and deployment.

  • Strong understanding of ML frameworks (e.g., TensorFlow, PyTorch) and how they interact with Kubernetes clusters for model training and deployment.

  • Excellent analytical, communication, and problem-solving skills.

  • Ability to manage priorities in a fast-paced environment and collaborate within a matrix organization.

Where you will be working

A gateway to Europe, Cork airport provides access to almost 50 international destinations including transatlantic air routes.

What's on Offer

Apart from working in an open, relaxed and collaborative space, you will enjoy:

  • Salary, stock and performance related bonus

  • Maternity/Paternity Leave

  • Employee stock purchase scheme

  • Matching pension scheme

  • Education Assistance

  • Relocation and immigration support (if needed)

  • Life, Medical, Income and Travel Insurance

  • Subsidised memberships for physical and mental well-being

  • Bicycle purchase scheme

  • Employee run clubs, including, running, football, chess, badminton + many more

*References to a particular number of years experience are for indicative purposes only. Applications from candidates with equivalent experience will be considered, provided that the candidate can demonstrate an ability to fulfill the principal duties of the role and possesses the required competencies.

Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.