AWS Data Engineer- Senior
We are seeking a highly skilled and motivated Hands on AWS Data Engineer with 5-10 years of experience in AWS Glue, Pyspark ,AWS Redshift, S3, and Python to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines and solutions that support business intelligence, analytics, and large-scale data processing. You will work closely with data scientists, analysts, and other engineering teams to ensure seamless data flow across our systems.
Technical Skills :
- Must have Strong experience in AWS Data Services like Glue , Lambda, Even bridge, Kinesis, S3/ EMR , Redshift , RDS, Step functions, Airflow & Pyspark
- Strong exposure to IAM, Cloud Trail , Cluster optimization , Python & SQL
- Should have expertise in Data design, STTM, understanding of Data models , Data component design, Automated testing, Code Coverage, UAT support , Deployment and go live
- Experience with version control systems like SVN, Git.
- Create and manage AWS Glue crawlers and jobs to automate data cataloging and ingestion processes across various structured and unstructured data sources.
- Strong experience with AWS Glue building ETL pipelines, managing crawlers, and working with Glue data catalogue.
- Proficiency in AWS Redshift designing and managing Redshift clusters, writing complex SQL queries, and optimizing query performance.
- Enable data consumption from reporting and analytics business applications using AWS services (ex: QuickSight, Sagemaker, JDBC / ODBC connectivity, etc.)
Behavioural skills:
- Willing to work 5 days a week from ODC / client location ( based on project can be hybrid 3 days a week )
- Ability to Lead developers and engage with client stakeholders to drive technical decisions
- Ability to do technical design and POCs- help build / analyse logical data model, required entities, relationships, data constraints and dependencies focused on enabling reporting and analytics business use cases
- Should be able to work in Agile environment
- Should have strong communication skills
Good to have :
- Exposure to Financial Services , Wealth and Asset Management
- Exposure to Data science, Exposure to Fullstack technologies
- GenAI will be an added advantage
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.