We are seeking an experienced(5+ years) to design, implement, and manage cloud infrastructure and CI/CD pipelines for big data solutions using Kubernetes and AWS.
What will your job look like?
Design and manage cloud infrastructure on AWS using IaC tools like Terraform or CloudFormation.
Optimize Kubernetes clusters for big data workloads.
Develop and maintain CI/CD pipelines using tools like ArgoCD and GitLab CI/CD .
Implement monitoring and logging solutions for big data systems.
Ensure compliance with security best practices .
Collaborate with development and operations teams.
Troubleshoot and resolve complex technical issues.
All you need is:
5+ years of DevOps experience , focusing on big data .
Expertise in Kubernetes , AWS , and big data technologies (e.g., Spark, Athena, Argo Workflows).
Proficiency in scripting (Bash, Python, SQL).
Experience with CI/CD tools, containerization (Docker), and configuration management (e.g., Ansible, Puppet).
Strong problem-solving and communication skills.
Preferred Qualifications:
Certifications in AWS or Kubernetes .
Familiarity with cloud-native technologies (Helm, Operators).
Knowledge of security best practices for cloud and big data.
Experience with monitoring tools (Prometheus, Grafana).