

Share
Your key responsibilities
· Business Analysis: Collaborate with stakeholders to gather and analyze business requirements, translating them into technical specifications for Big Data solutions.
· Data Architecture & Design: Define and implement modern data architectures using distributed processing paradigms and scalable frameworks.
· Pipeline Development: Design, develop, and maintain data pipelines and frameworks for ingestion, transformation, and processing of structured and unstructured data.
· Performance Optimization: Optimize data workflows and distributed processing jobs to ensure efficiency and reliability at scale.
· Monitoring & Troubleshooting: Ensure operational stability of Big Data platforms, proactively identifying and resolving issues.
· Data Security & Governance: Apply best practices for data quality, security, and compliance throughout the data lifecycle.
· Leadership & Planning: Coordinate technical teams, provide estimates, manage risks, and ensure timely delivery of Big Data projects.
· Documentation: Maintain comprehensive documentation of solution designs, processes, and procedures to facilitate knowledge sharing and compliance with organizational standards.
· Technical Support and Training: Provide technical support and training to end-users and development teams, fostering a culture of continuous improvement and knowledge sharing.
Skills and attributes for success
• Communication is essential, must be able to listen and understand the question and develop and deliver clear insights, in both verbal and written, with the ability to convey complex technical concepts to non-technical stakeholders. • Independent and able to manage and prioritize workload. • Ability to adapt quickly and positively to change. • This position will require strong analytical and problem-solving skills, with a keen attention to detail. • You will also be a part of larger team (incl. client-side stakeholders), so communication and collaboration skills will also help you to succeed.
· A proactive approach to identifying and resolving issues
To qualify for the role, you must have
• Proven experience (more than 4 years) in Big Data projects, including design, modeling, implementation, and evolution of data solutions (data lakes, lakehouses, pipelines).
• Deep knowledge of Big Data fundamentals and lifecycle (collection, integration, quality control, processing, visualization, dissemination).
• Hands-on experience with Big Data platforms and technologies (e.g., Spark, Databricks, Azure Synapse, Kafka, MS Fabric).
• Expertise in distributed storage (S3, Blob, ADLS) and file formats (Parquet, Avro, Delta).
• Advanced programming skills in Python and SQL.
• Familiarity with cloud Big Data services (Azure, AWS, GCP).
• Experience as team leader or tech lead, including planning, risk management, and stakeholder engagement.
• Strong background in Agile methodologies and DevOps/DataOps practices.
• Knowledge of CI/CD principles, version control, and automated testing (e.g., TFS, GitHub).
Ideally, you'll also have
· Experience with visualization tools and preparing data for business consumption.
· Relevant certifications in Big Data or cloud technologies.
An effective communicator and you’ll be a confident team player equipped with strong people management skills; Creative, proactive, a team player, and able to work under pressure. It’s important to have a strategically focused mindset and the ability to deliver multiple projects and present information in a clear and concise manner. Business mindset and some commercial acumen. We value a strong work ethic, forward-thinking, and being a self-starter; If you’re ready to take on a wide range of responsibilities and are committed to seeking out new ways to make a difference, this role is for you.
What we offer
We offer a competitive remuneration package where you’ll be rewarded for your individual and team performance. Plus, we offer support and coaching, opportunities to develop new skills and progress your career, and the freedom and flexibility to handle your role in a way that’s right for you.
• Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
• Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
If you can demonstrate that you meet the criteria above, please contact us as soon as possible.
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
These jobs might be a good fit