EY DE-NCLC-Azure Data Engineer-GDSN02 

India, Kerala, Thiruvananthapuram 

84352196

Azure Data Architect - Azure Lead Data Engineer – Consulting

As part of our GDS Consulting team, you will be part of Digital & Emerging team delivering specific to Microsoft account. You will be working on latest Microsoft BI technologies and will collaborate with other teams within Consulting services.

Your key responsibilities

• Design and implement scalable and efficient data architectures on Azure/Microsoft Fabric for batch and real-time processing.
• Develop and optimize ETL/ELT pipelines using Azure Data Factory, Azure Synapse, and Azure Data bricks or Microsoft Fabric.
• Build and maintain data integration solutions leveraging PySpark and ADLS.
• Implement data models and data storage solutions in Azure SQL and Synapse for analytics and reporting.
• Manage data ingestion from various sources, including APIs, databases, and streaming platforms.
• Ensure data quality, consistency, and security across the platform.
• Design and develop real-time data processing solutions using Azure Event Hub, Azure Stream Analytics, and Azure Functions.
• Enable seamless integration for streaming data pipelines and event-driven architectures.
• Work closely with data scientists, analysts, and business stakeholders to understand data requirements.
• Translate business needs into technical solutions and provide data engineering expertise to the team.
• Optimize data pipelines for performance, scalability, and cost-efficiency.
• Implement and enforce best practices for data governance, security, and compliance.
• Stay updated with the latest Azure data services and technologies to drive innovation.
• Mentor junior engineers and lead technical discussions within the team.

Skills and attributes for success

• Collaborating with other members of the engagement team to plan the engagement and develop work program timelines, risk assessments and other documents/templates.
• Able to manage Senior stakeholders.
• Experience in leading teams to execute high quality deliverables within stipulated timeline.
• Must-Have Skills:
  • Expertise to design and develop integration and reporting solution in Power BI/Power BI Fabric
  • Proficiency in Azure Databricks or Azure Synapse for data processing and analytics.
  • Expertise in PySpark for big data processing and transformations.
  • Strong experience with Azure Data Factory (ADF) for orchestration and ETL/ELT.
  • Solid knowledge of Azure SQL and ADLS for data storage and querying.
• Good-to-Have Skills:
  • Familiarity with Azure Event Hub and Azure Stream Analytics for real-time data processing.
  • Experience with Azure Functions and Logic Apps for event-driven workflows.
  • Knowledge of Python for data manipulation and scripting.
  • Understanding of Dataverse for data integration.
• Excellent Written and Communication Skills
• Ability to deliver technical demonstrations
• Quick learner with “can do” attitude
• Demonstrating and applying strong project management skills, inspiring teamwork and responsibility with engagement team members
• Certifications (Preferred):
  • DP-203: Data Engineering on Microsoft Azure.
  • DP-600/DP -700: Fabric Data Analyst/ Fabric Data engineer
  • Databricks Data Engineer Associate or Professional Certification.
  • Databricks Certified Associate Developer for Apache Spark.

To qualify for the role, you must have

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• 3.5-8 years of hands-on experience in Azure data engineering.
• Proven track record of designing and implementing large-scale data solutions.
• Strong problem-solving skills and ability to work in a fast-paced environment.

Ideally, you’ll also have

• Analytical ability to manage multiple projects and prioritize tasks into manageable work products.
• Can operate independently or with minimum supervision

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.