המקום בו המומחים והחברות הטובות ביותר נפגשים
Key job responsibilities
"As a data engineer intern, you will/may:
• Design, implement, and automate deployment of our distributed system for collecting and processing log events from multiple sources.
• Design data schema and operate internal data warehouses and SQL/NoSQL database systems.
• Own the design, development, and maintenance of ongoing metrics, reports, analyses, and dashboards that engineers, analysts, and data scientists use to drive key business decisions.
• Monitor and troubleshoot operational or data issues in the data pipelines.
• Drive architectural plans and implementation for future data storage, reporting, and analytic solutions.
• Develop code based automated data pipelines able to process millions of data points.
• Improve database and data warehouse performance by tuning inefficient queries.
• Work collaboratively with Business Analysts, Data Scientists, and other internal partners to identify opportunities/problems.
• Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of a problem. "
- - 1+ years of data engineering experience
- - Experience with data modeling, warehousing and building ETL pipelines
- - Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- - Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
משרות נוספות שיכולות לעניין אותך