Share
Key job responsibilities
CORE RESPONSIBILITIES:
· Be hands-on with ETL to build data pipelines to support automated reporting
· Interface with other technology teams to extract, transform, and load data from a wide variety of data sources
· Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, Redshift.
· Model data and metadata for ad-hoc and pre-built reporting
· Interface with business customers, gathering requirements and delivering complete reporting solutions
· Build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
· Build and deliver high quality data sets to support business analyst, data scientists, and customer reporting needs.
· Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
· Participate in strategic & tactical planning discussionsA day in the life
As a Data Engineer, you will be working with cross-functional partners from Science, Product, SDEs, Operations and leadership to translate raw data into actionable insights for stakeholders, empowering them to make data-driven decisions. Some of the key activities include:Crafting the Data Flow: Design and build data pipelines, the backbone of our data ecosystem.
Architect for Insights: Translate complex business requirements into efficient data models that optimize data analysis and reporting. Automate data processing tasks to streamline workflows and improve efficiency.
- 1+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience with any ETL tool like, Informatica, ODI, SSIS, BODI, Datastage, etc.
- Knowledge of cloud services such as AWS or equivalent
These jobs might be a good fit