מציאת משרת הייטק בחברות הטובות ביותר מעולם לא הייתה קלה יותר
Intuit Senior Software Engineer India, Karnataka, Bengaluru 541429379
Today
Responsibilities
- Design and implement scalable ETL and ELT pipelines using tools like Apache Spark, DBT, and Kafka.
- Own the development of data models that support reporting, analytics, and machine learning use cases.
- Build and maintain historical, delta, and snapshot tables optimized for large-scale data processing and access patterns.
- Work with columnar storage formats (e.g., Parquet, ORC) to optimize performance and storage efficiency.
- Integrate and automate data validation and quality checks, ensuring trust and accuracy across pipelines.
- Partner with data platform and product teams to design and deliver seamless data integrations across systems and domains.
- Contribute to data governance practices, schema evolution, and performance tuning.
Qualifications
- 6+ years of hands-on experience in data engineering or data platform development.
- Strong experience in building and optimizing data pipelines using Spark and Flink.
- Proficiency with DBT for transformation workflows and Kafka for event-driven ingestion.
- Solid understanding of data modeling principles and best practices in relational and analytical systems.
- Proven track record in creating and maintaining historical, delta, and snapshot data structures.
- Familiarity with data quality frameworks and tools for validation and anomaly detection.
- Experience working with columnar file formats and scalable data storage systems.
- Strong coding skills in Python or Scala, and familiarity with SQL at scale.
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
משרות נוספות שיכולות לעניין אותך
