Key job responsibilities
1. Build end to end data extraction, data transformation and data pipelines to ensure data availability for ML & LLM models that are critical to IN businesses.2. Enable ML/LLM tools by setting up all the required underlying data infrastructure, data pipelines and permissions to generate training and inference data for the ML models.4. Must possess strong verbal and written communication skills, be self-driven, and deliver high quality results in a fast-paced environment.5. Drive operational excellence strongly and build automation and mechanisms to reduce operations6. Enjoy working closely with your peers in a group of very smart and talented engineers.A day in the life
- 2+ years of data engineering experience
- Experience with SQL
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Knowledge of computer science fundamentals such as object-oriented design, operating systems, algorithms, data structures, and complexity analysis
משרות נוספות שיכולות לעניין אותך