המקום בו המומחים והחברות הטובות ביותר נפגשים
As a Sr. Data Engineer in the CDW team, you will own complex big data pipelines and data solutions to provide highly availability datasets. You will work with large data sets (in petabytes) and transformations involving multiple data sources to enable downstream analytics for our stakeholders. You will build and manage large datasets to help teams drive data-driven decisions through analytical and business metrics dashboards.Key job responsibilities
• Define and optimize data models for rapid analytics on catalog product data, improving freshness and LLM consumption while reducing costs and undifferentiated work.• Automate metrics generation to support S-team goals, including pack hierarchy scaling and standard KPIs, while leading strategy for scaling self-serve analysis and dashboards.• Mentor engineers, establish best practices in data engineering and operational excellence, and stay current with latest technologies to recommend innovations.• Conduct comprehensive data discovery, profiling, and performance analysis for various sources, designing effective models for Page0, entitlement, propensity, and other relevant data.• Collaborate with stakeholders to translate requirements into optimized data structures, while establishing and enforcing data governance policies to maintain quality, consistency, and security.• Take a long-term view of data solutions, proactively addressing architecture deficiencies and making appropriate trade-offs for usability, security, maintainability, scalability, and extensibility.• Resolve root causes of endemic problems, unblocking innovation for related teams, and build consensus with stakeholders to influence and determine the best path forward.
- Bachelor's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience mentoring team members on best practices
- Experience in at least one modern scripting or programming language, such as Python, Java or Scala
- Experience in dimensional data modeling and schema design
- Experience with diverse data formats: Parquet, JSON, big data formats, and table formats like Apache Iceberg
משרות נוספות שיכולות לעניין אותך