המקום בו המומחים והחברות הטובות ביותר נפגשים
Design, implement and operate large-scale, high-volume, high-performance data structures for analytics and data science.
Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools.
Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture.A day in the life
As a Data Engineer with Workforce Intelligence, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce, and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will proactively help to identify new data for integration with our platform, and propose and implement new technologies to help us better understand our data. In this role, you will serve as the expert in designing, implementing, and operating a stable, scalable, low cost environment to flow information from the source systems to data warehouse into end-user facing reporting applications such as Tableau or AWS QuickSight. Above all, you will bring large datasets together to answer business questions and drive data-driven decision making.
- 1+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
משרות נוספות שיכולות לעניין אותך