EY Oracle Advanced Engineering-Glue- AWS EMR-Redshift-Pyspark-S3- 

India, Uttar Pradesh 

819109601

Key Responsibilities:

• Design and implement data ingestion pipelines from various sources including on-premise Oracle databases, batch files, and Confluent Kafka.
• Develop Python producers and AWS Glue jobs for batch data processing.
• Build and manage Spark streaming applications on Amazon EMR.
• Architect and maintain Medallion Architecture-based data lakes on Amazon S3.
• Develop and maintain data sinks in Redshift and Oracle.
• Automate and orchestrate workflows using Apache Airflow.
• Monitor, debug, and optimize data pipelines for performance and reliability.
• Collaborate with cross-functional teams including data analysts, scientists, and DevOps.

Required Skills and Experience:

• Good programming skills in Python and Spark (Pyspark).
• Hands on Experience with Amazon S3, Glue, EMR.
• Good SQL knowledge on Amazon Redshift and Oracle
• Proven experience in handling streaming data with Kafka and building real-time pipelines.
• Good understanding of data modeling, ETL frameworks, and performance tuning.
• Experience with workflow orchestration tools like Airflow.

Nice-to-Have Skills:

• Infrastructure as Code using Terraform.
• Experience with AWS services like SNS, SQS, DynamoDB, DMS, Athena, and Lake Formation.
• Familiarity with DataSync for file movement and medallion architecture for data lakes.
• Monitoring and alerting using CloudWatch, Datadog, or Splunk.

Qualifications:

• BTech / MTech / MCA / MBA

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.