Job Description:
tackle problems such as attribute extraction, entity resolution, taxonomy mapping, schema evolution, and knowledge graph construction — all in servicepowering AI-driven search and personalized recommendations.
Do
Design and implement scalable batch and real-time data pipelines to process and enrich large volumes of product catalog data.
Develop robust data transformations and workflows for entity resolution, attribute extraction, normalization, and deduplication.
Design andmaintainmetadata layers and knowledge representations (e.g., product graphs, ontologies, embeddings) that serve as foundational infrastructure for ML and AI-driven features.
Collaborate with taxonomy and content experts to structure and evolve product classification systems and schemas.
Monitor and improve data quality, consistency, and lineage; define and enforce data contracts and validationrules.Optimizepipeline performance and reliability, ensuring efficient operation at scale.
Drive best practices in data engineering, including testing, versioning, documentation, and observability.
Looking For
Bachelor’s orMaster’s degree in Computer Science, Data Engineering, or a related technical field.
5+ years of experience designing and building large-scale data processing systems, preferably in cloud-native environments.
Strong experience with batch and streaming data technologies such as Apache Beam, Dataflow, or Pub/Sub.
in Python,Scalaor Java; familiarity with SQL and data transformation tools (e.g.,dbt,BigQuery) is a plus.
Solid understanding of data modeling, schema design, and data lifecycle management.
Experience with structured and semi-structured data (JSON, Avro,Protobuf, etc.) and modern data warehousing.
Excellent problem-solving skills and a collaborative mindset, with the ability to work across engineering, ML, and product domains.
Nice to Have
Experience in e-commerce, product catalogs, orknowledgegraph construction.
Familiarity with machine learning pipelines or collaborating with ML teams.
The total compensation for this practice may include an annual performance bonus (or other incentive compensation, as applicable), equity, and medical, dental, vision, and other benefits. For more information, visit .
The US national annual pay range for this role is $176,500 to $262,350
Our Benefits:
Any general requests for consideration of your skills, please
משרות נוספות שיכולות לעניין אותך