Nvidia Senior Systems Software Engineer Spark Service - Accelerated 

United States, California 

761169382

What you'll be doing:

• Design and develop a world-class GPU accelerated Apache Spark service.

• Enable a collection of micro-services to provide the ability to run Spark applications on Kubernetes or other platforms.

• Implement the REST API and its client libraries to simplify customer adoptions.

• Customize the open-source projects to meet the project requirements.

• Deploy and verify the solution on CSPs or on-prem Kubernetes environments.

• Engage open source communities, including Apache Spark and, for technical discussions and contributions

What we need to see:

• 8+ years of experience in software development.

• 5+ years hands on experience with web service design and development

• BS/MS/PhD in computer science or a related field or equivalent experience

• Experience with REST service frameworks like Spring Boot

• Familiarity with the modern data open source ecosystem (Apache Spark, Apache Kyuubi, Apache Zookeeper, gRPC, etc)

• Experience with Kubernetes and Helm charts andExperience building performance and reliable service APIs

• Experience working on public and private cloud platformsandExperience with object storage and distributed file systems

• Prior experience supporting enterprise customers

• Solid understanding of Python and Scala/Java

• Excellence at communicating, presenting and explaining technical topics

Ways to stand out from the crowd:

• Working experience with Spark distributions: Databricks, AMS EMR, GCP Dataproc, Azure Synapse Analytics.

• Contributions to major open source projects such as Apache Spark, Apache Kyuubi, Apache Ranger, Apache Iceberg, and Delta Lake.

• Development experience of Apache Spark Data Sources and connectors.

• Development experience with Spark Client interfaces/tools like Jupyter, Zeppelin, Spark Connect, and BI tools.

• Working knowledge of secrets and encryption management systemsandBasic ML/DL experience with PyTorch, TensorFlow, Spark ML and XGBoost.

We have some of the most forward-thinking and hardworking people on the planet working for us. If