EY Data Engineering Lead 

India, Kerala, Kochi 

433040586

Position Summary

• Design and implement scalable data lake architectures using Azure Data Lake services.
• Develop and maintain data pipelines to ingest data from various sources.
• Optimize data storage and retrieval processes for efficiency and performance.
• Ensure data security and compliance with industry standards.
• Collaborate with data scientists and analysts to facilitate data accessibility.
• Monitor and troubleshoot data pipeline issues to ensure reliability.
• Document data lake designs, processes, and best practices.
• Experience with SQL and NoSQL databases, as well as familiarity with big data file formats like Parquet and Avro.

Essential

• Azure Data Lake
• Azure Synapse Analytics
• Azure Data Factory
• Azure DataBricks
• Python (PySpark, Numpy etc)
• SQL
• ETL
• Data warehousing
• Azure Devops
• Experience in developing streaming pipeline using Azure Event Hub, Azure Stream analytics, Spark streaming
• Experience in integration with business intelligence tools such as Power BI

Good to have skills

• Big Data technologies (e.g., Hadoop, Spark)
• Data security

General Skills

• Experience with Agile and DevOps methodologies and the software development lifecycle.
• Proactive and responsible for deliverables
• Escalates dependencies and risks
• Works with most DevOps tools, with limited supervision
• Completion of assigned tasks on time and regular status reporting
• Should be able to train new team members
• Desired to have knowledge on any of the cloud solutions such as Azure or AWS with DevOps/Cloud certifications.
• Should be able to work with a multi culture global teams and team virtually
• Should be able to build strong relationship with project stakeholders

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.