Unique opportunity to be a core member of a growing team while working closely with the customer to grow and maintain Apache Spark clusters.
Responding to customer queries and incidents, diagnosing and solving complex issues primarily on technologies like Spark, ClickHouse, Postgres etc.,
Undertake complex cluster operations such as migrations, upgrades, backup and maintenance.
Liaise with our customers’ engineers in resolving interesting issues related to Apache Spark and other supported technologies.
This role will grant you the opportunity to gain knowledge on Apache Cassandra, Kafka, OpenSearch, PostgreSQL and other supported technologies.
Opportunity to contribute to open source projects.
Provide expert operational support to our nodes running in the cloud (AWS/Azure/GCP) using tech such as Linux, Docker and languages such as Python, Java and Bash.
Investigate issues and apply maintenance procedures to optimise the performance and stability of production systems.
Develop and continually improve our suite of internal automation tools, applications and processes.
Participate in an active rotating roster within the TechOps team
Job Requirements
Have good experience in Apache Spark and a desire to learn and develop more.
Experience in public cloud (AWS/GCP/Azure), preferably AWS.
Experience in Terraform for Infrastructure setup, installation, and configuration
Experience in managing EKS and other K8's cloud services is a plus
Good knowledge of Spark architecture and various spark's configurations.
Knowledge in troubleshooting Spark applications.
Exposure to AWS EMR and other AWS services like EC2, S3, VPC, Load balancer is desirable.
Basic knowledge of Openshift or Spot (by NetApp) platform would be an advantage.
Strong knowledge and experience with Linux and comfortability working from the command line.
Ability to communicate clearly and professionally.
Past IT Customer service/support experience is a plus
Programming skills in Python/Java/Go alongside source code control using Git.
Experience in working with databases (Cassandra, PostgresSQL etc) is a plus
Ability to work as part of a team.
Education
Computer Science/IT Graduate or other formal qualification with 2+ years of experience.
Any Cloud Certification and/or Kubernetes certification would be a plus
( ).
If you’re excited about this role and wish to apply, simply click “apply now” or apply via our careers page: