Job Description
Associate Manager, Data Engineer
The Opportunity
- Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare.
- Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products.
- Drive innovation and execution excellence. Be a part of a team with passion for using data, analytics, and insights to drive decision-making, and which creates custom software, allowing us to tackle some of the world's greatest health threats.
What will you do in this role
- Design, develop and maintain data pipelines to extract data from a variety of sources and populate data lake and data warehouse.
- Develop the various data transformation rules and data modeling capabilities.
- Collaborate with Data Analyst, Data Scientists, Machine Learning Engineers to identify and transform data for ingestion, exploration, and modeling.
- Work with data governance team and implement data quality checks and maintain data catalogs.
- Use Orchestration, logging, and monitoring tools to build resilient pipelines.
- Use test driven development methodology when building ELT/ETL pipelines.
- Develop pipelines to ingest data into cloud data warehouses.
- Analyze data using SQL.
- Use serverless AWS services like Glue, Lambda, Step Functions
- Use Terraform Code to deploy on AWS.
- Containerize Python code using Docker.
- Use Git for version control and understand various branching strategies.
- Build pipelines to work with large datasets using PySpark
- Develop proof of concepts using Jupyter Notebooks
- Work as part of an agile team.
- Create technical documentation as needed.
What should you have
- BS Degree or equivalent in Computer Science, Computer Engineering, Information Systems, or equivalent experience.
- 2+ years of relevant experience
- Good experience with AWS services like S3, ECS, Fargate, Glue,
- Any AWS developer or architect certification
- Agile development methodology
- Step Functions, CloudWatch, Lambda, EMR, SQL
- Proficient in Python, PySpark
- Good with Git, Docker, Terraform
- Ability to work in cross functional teams
What we look for
Current Contingent Workers apply
*A job posting is effective until 11:59:59PM on the dayBEFOREthe listed job posting end date. Please ensure you apply to a job posting no later than the dayBEFOREthe job posting end date.