By applying to this U.S. New York, New York position, you are required to be local to the New York area and in office 3 days a week.
Responsibilities:
- Thought leader and owner of the architecture blueprint of data platform
- Superior coding skills in SPARK using Scala, Python and Java
- Work collaboratively with other Platform, infrastructure, application engineers as well as AI Researchers to build next generation data platform services and capabilities.
- Ship high-quality, well-tested, secure, and maintainable code.
- Find a path to get things done despite roadblocks to get your work into the hands of users quickly and iteratively.
- Enjoy working in a fast-paced, design-driven, product development cycle.
- Embody our and .
Required Qualifications:
- Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8 years experience in software development, data modeling or data engineering work
- OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6 year(s) experience in software development, or data engineering work
- OR equivalent experience.
- 5 years of hands experience in building from ground up large scale data processing platforms with more than 100 data pipelines. Use of Apache Hadoop eco system, Kafka Stream/Flink, columnar databases, vector databases, semantic search technologies, RDBMS databases, key value stores, etc.
- 5 years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
- 2 years' experience building distributed systems at scale and extensive systems knowledge that spans bare-metal hosts to containers to networking.
Preferred Qualifications:
- 10 years technical engineering experience building data platforms that handle large volumes of data in both batch and real time. Coding in languages including, but not limited to, Python, C#, Java, Spark, SQL
- Ability to identify, analyze, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.
- Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.
- Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers.
- Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.
- Passion for learning new technologies and staying up to date with industry trends, best practices, and emerging technologies in web development and AI.
- Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
- Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: