– GCP Data Engineer - Senior
We’re looking for Senior with 3 -7 years of experience. He /She should have strong expertise in cloud data engineering using GCP, PySpark and Python.
Key Responsibilities
- Develop technical requirements and solution designs based on Approved Business Requirements from client stakeholders and Business Systems Analysts
- Review and refine technical requirements and solution designs with client stakeholders, incorporating feedback to achieve Approved Specifications
- Support the build and configuration of tickets in development environment, including tasks related to data sourcing, integration, management, and transformation
- Create comprehensive unit and regression test cases for each ticket based on Specifications
- Execute unit testing in the development environment and regression testing in test environment, documenting the results
- Collaborate with stakeholders to review identified defects from testing and agree on resolutions to be handled by EY
- Resolve mutually agreed defects from unit and regression testing to ensure high-quality deliverables
- Prepare code packages and release documentation to facilitate the release of code packages for each ticket to production
To qualify for the role, you must have
- BE/BTech/MCA with 3-7 years of industry experience
- Proficiency in Google Cloud Platform services and tools like Google Cloud Storage (GCS), BigQuery, Cloud Dataflow, Cloud Data Fusion, Cloud Dataproc, Cloud Composer etc
- Ability to leverage GCP for data engineering tasks such as data storage, processing, and analytics
- Expertise in PySpark for large-scale data processing
- Experience with Spark's Data Frame API for performing complex data transformations and analyses
- Strong programming skills in Python, with a focus on writing scripts for efficient data processing
- Experience in writing SQL scripts to handle Data manipulation / transformation
- Working experience in an Agile based delivery methodology (Preferable)
- Excellent communication skills (written and verbal, formal and informal)
- Capability to Lead, Guide and Mentor junior members in the team
- Strong communication and collaboration abilities to work effectively with various stakeholders.
- GCP Certification (Cloud Engineer / Developer/ Database Engineer) would be a plus
Skills and attributes for success
- Strong expertise in data engineering principles, including data sourcing, integration, management, and transformation
- Experience with software development lifecycle, including testing and defect resolution
- Proficiency in developing technical specifications and solution designs
- Excellent analytical and problem-solving skills.
- Ability to produce high quality deliverables.
What we look for
- A Team of people with technical experience and enthusiasm to learn new things in this fast-moving environment
You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees, and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that’s right for you
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.