מציאת משרת הייטק בחברות הטובות ביותר מעולם לא הייתה קלה יותר
What you'll be doing:
Design and develop a world-class GPU accelerated Apache Spark service.
Enable a collection of micro-services to provide the ability to run Spark applications on Kubernetes or other platforms.
Implement the REST API and its client libraries to simplify customer adoptions.
Customize the open-source projects to meet the project requirements.
Deploy and verify the solution on CSPs or on-prem Kubernetes environments.
Engage open source communities, including Apache Spark and, for technical discussions and contributions
What we need to see:
8+ years of experience in software development.
5+ years hands on experience with web service design and development
BS/MS/PhD in computer science or a related field or equivalent experience
Experience with REST service frameworks like Spring Boot
Familiarity with the modern data open source ecosystem (Apache Spark, Apache Kyuubi, Apache Zookeeper, gRPC, etc)
Experience with Kubernetes and Helm charts andExperience building performance and reliable service APIs
Experience working on public and private cloud platformsandExperience with object storage and distributed file systems
Prior experience supporting enterprise customers
Solid understanding of Python and Scala/Java
Excellence at communicating, presenting and explaining technical topics
Ways to stand out from the crowd:
Working experience with Spark distributions: Databricks, AMS EMR, GCP Dataproc, Azure Synapse Analytics.
Contributions to major open source projects such as Apache Spark, Apache Kyuubi, Apache Ranger, Apache Iceberg, and Delta Lake.
Development experience of Apache Spark Data Sources and connectors.
Development experience with Spark Client interfaces/tools like Jupyter, Zeppelin, Spark Connect, and BI tools.
Working knowledge of secrets and encryption management systemsandBasic ML/DL experience with PyTorch, TensorFlow, Spark ML and XGBoost.
We have some of the most forward-thinking and hardworking people on the planet working for us. If
You will also be eligible for equity and .
משרות נוספות שיכולות לעניין אותך