מציאת משרת הייטק בחברות הטובות ביותר מעולם לא הייתה קלה יותר
We are looking for experienced, self-driven Data Engineer. In this role, you will be building complex data engineering and business intelligence applications using AWS big data stack. You should have deep expertise and passion in working with large data sets, data visualization, building complex data processes, performance tuning, bringing data from disparate data stores and programmatically identifying patterns. You should have excellent business acumen and communication skills to be able to work with business owners to develop and define key business questions and requirements. You will provide guidance and support for other engineers with industry best practices and direction. Amazon Web Services (AWS) has culture of data-driven decision-making, and demands timely, accurate, and actionable business insights.Key job responsibilities
• Design, implement, and support data warehouse/ data lake infrastructure using AWS bigdata stack, Python, Redshift, QuickSight, Glue/lake formation, EMR/Spark, Athena etc.
• Develop and manage ETLs to source data from various financial, AWS networking and operational systems and create unified data model for analytics and reporting.
• Creation and support of real-time data pipelines built on AWS technologies including EMR, Glue, Redshift/Spectrum and Athena.
• Collaborate with other Engineering teams, Product/Finance Managers/Analysts to implement advanced analytics algorithms that exploit our rich datasets for financial model development, statistical analysis, prediction, etc.
• Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
• Use business intelligence and visualization software (e.g., QuickSight) to develop dashboards those are used by senior leadership.
• Empower technical and non-technical, internal customers to drive their own analytics and reporting (self-serve reporting) and support ad-hoc reporting when needed.
• Working closely with team members to drive real-time model implementations for monitoring and alerting of risk systems.
• Manage numerous requests concurrently and strategically, prioritizing when necessary
• Partner/collaborate across teams/roles to deliver results.
• Mentor other engineers, influence positively team culture, and help grow the team.
- 3+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
- Experience of designing and developing data engineering systems from grounds up and maintaining/supporting existing systems.
- Experience in dealing with large and complex data sets and performance tuning
- Proficiency in one of the scripting languages - Python, Ruby, or similar
- Experience operating large data warehouses or data lakes
- Experience in designing data models that supports structures and unstructured data
- Experience in gathering requirements and formulating business metrics for reporting
- Ability to deal with ambiguities and competing priorities.
משרות נוספות שיכולות לעניין אותך