EY EY - GDS Consulting AI DATA AWS Databricks Senior 

India, Kerala, Kochi 

848061102

Must have experience

• Hands-on practical experience delivering system design, application development, testing, and operational stability
• Proven experience in implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming data from various sources into Databricks
• Experience in building pipelines using Delta live tables, autoloader, and Structured streaming Databricks workflows for orchestration.
• Deep understanding of Apache Spark, Delta Lake, DLT and other big data technologies
• Hands-on experience with performance tuning and data modelling. Strong SQL skills with experience in querying and optimizing large datasets.
• Experience in Python, Spark & Streaming (Spark Streaming or KAFKA or Kinesis) is plus
• Experience in building metadata-driven ingestion and DQ framework using PySpark is plus.
• Manage and monitor data workflows using orchestration tools like Apache Airflow
• Knowledge of CI/CD workflows for data engineering projects.
• Utilize Git for version control, ensuring proper collaboration and tracking of code changes.
• Establish and follow best practices for repository management, branching, and code reviews.
• Good to have DBT Exposure -Contribute to dbt transformations and assist in setting up data modelling workflows.

To qualify for the role, you must have

• BE/BTech/MCA/MBA

• Minimum 3+ years hand-on experience in one or more key areas.

What we look for

• A Team of people with commercial acumen, technical experience and enthusiasm to learn new things in this fast-moving environment

• An opportunity to be a part of market-leading, multi-disciplinary team of 1400 + professionals, in the only integrated global transaction business worldwide.

• Opportunities to work with EY Consulting practices globally with leading businesses across a range of industries

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.