מציאת משרת הייטק בחברות הטובות ביותר מעולם לא הייתה קלה יותר
Key job responsibilities
- Design, implement and maintain data infrastructure including data modeling, ETL pipelines, and ongoing maintenance.- Able to read, write, and debug data processing and orchestration code written in Python/Scala etc following best coding standards (e.g. version controlled, code reviewed, etc.)
- Build a data dictionary, catalog and governance plan and manage and audit all of the registered data via mechanisms.- Develop automated solutions to minimize manual processes with focus on efficiency and scalability.
- 5+ years of data engineering experience
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with modern SQL data orchestration tools like DBT, Mode, and Airflow
משרות נוספות שיכולות לעניין אותך