The point where experts and best companies meet
Share
As a Software Engineer on our team, you will be responsible for designing, developing, and maintaining our systems that acquire content for information grounding and training foundational models. You'll work closely with Science partners on data requirements for training their models. This position requires creativity, passion, and experience with building innovative solutions to complex technical problems.Key job responsibilities
• Design and develop scalable content acquisition and data extraction systems to acquire data.
• Build automation data pipelines and insights using big data frameworks (e.g., Spark) to acquire petabytes of data and visualize important KPI's to enable technical direction.
• Optimize our data architecture for scale, low latency, resilience and cost efficiency.
• Implement robust systems to process content and extract meaning.
• Develop data pipelines and infrastructure to support petabyte-scale datasets.
• Work closely with scientists and other engineers to rapidly prototype and deploy new algorithms.
• Write high quality, well-tested production code in languages like Python, Spark, Java, Scala.Key job responsibilities
- Develop data pipelines and infrastructure to support petabyte-scale datasets throughout the ML model development lifecycle, from training to production deployment
- Work closely with scientists and other engineers to rapidly prototype and deploy new ML models
- Optimize architecture for performance, scale, resilience and cost efficiency
- Write high quality, well-tested production code in languages like Python, Java, Scala.A day in the life
As a Software Developer, you will be leading a team of software engineers and collaborating with applied scientists to develop novel processes for constructing and enhancing structured information retrieval systems; and enable high precision/recall & low latency access to knowledge in Web content acquisition systems.
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
These jobs might be a good fit