Implement scalable data pipelines, optimize models for performance and accuracy, and ensure they are production-ready. Contribute to projects that require cutting-edge technology and innovative approaches.
Design, build, scale, and maintain services to process billions of daily events into our machine learning and reporting pipelines.
Write and optimize complex data generations and training ML pipelines, queries, and services on the Google Cloud Platform orchestrated within Kubeflow.
Ensure pipeline scalability and reliability through efficient code and data processing design.
Work closely with data science teams to build future-proof solutions collaboratively.
What we're looking for
Experience developing and optimizing scalable machine learning in production code using Python. Ability to design and reason about services in a distributed system, including testing, communication patterns, data protocols, and reliability.
Practical experience working with deep learning frameworks such as Tensorflow, Pytorch, or Jax.
Track record of maintaining and building large-scale data pipelines using Apache Spark, Flink, or similar frameworks and schedulers such as Ray, Kubeflow or Apache Airflow
Good understanding of Big Data and its components (e.g., cluster computing, batch & stream processing, data partitioning, etc.)
Practical experience with setting up and running a cloud data infrastructure (including containerization with Docker & Kubernetes and infrastructure as code with Terraform)
You might also have
Experience with distributed data processing and scalable data storage systems.
Experience working in a Machine Learning-driven product where data pipelines are a key contributing factor. Even better if it includes experience with deep neural networks.
Background working as a Data scientist and/or in backend engineering, and some understanding of Go as we use it as our primary backend language.
Additional information
Relocation support is not available for this position.
International relocation support is not available for this position.
Work visa/immigration sponsorship is not available for this position.