Microsoft Data Engineer II 

India, Telangana, Hyderabad 

233646678

IIwho is self-driven, innovative, and motivated who can help us build the next generation federated Big Data service and modernize our platform. This job offers great growth opportunities for skilled and motivated engineers to work on big scale data and bring valuable insights, shaping our complex OTA (over the air) update domain.If you are passionate about processing billions of events, churning Petabytes of data daily, learning innovative public cloud technologies like Spark, Synapse, then EDS would love to apply your data expertise to some of the most exciting data problems in the industry.

You will build reliable, secure, compliant, highly scalable, performant and real-time data pipelines to enhance our publishing and updating platform.The value of your work will be reflected in improvements to the delivery and distribution pipeline of Windows Update platform, bringing efficiency/observability to our updating services, driving insights into our customers, including COGS reduction.You will have opportunities for mentorship, accelerating your career growth, learning new areas and working on truly high-business impact areas.

Required Qualifications

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field
  • OR equivalent experience.

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications

• Bachelor's Degree in Computer Science , Math, Software Engineering, Computer Engineering,
  • OR related field AND 5+ years experience in business analytics, data science, software development, data modeling
  • OR data engineering work

• Requirements and Modeling : Collaborate with stakeholders, document data requirements, evaluates feasibility, negotiate data agreements, and proposes data metrics for project-relevant features.
• Data Model Design and Specification : Contribute to the data model design, draft design specification documents, improve data schemas, and balance analytical requirements and compute/storage consumption for data.
• Data Extraction and Validation : With guidance, implement code to extract raw data from upstream sources, perform code reviews, implement orchestration techniques, validate data quality and reliability, and record data source control and versioning.
• Data Transformation and Merging : Apply standard operations to transform raw data into compatible forms, use software and tools to wrangle and analyze data, and merge data into distributed systems or products.
• Data Tool Design and Maintenance : Design and maintain data tools/platforms that are used to transform, manage, and access data, write efficient code to test and validate data platforms, and implement sustainable design patterns.
• Data Monitoring and Troubleshooting : Follow performance monitoring protocols, build visualizations and aggregations to monitor data quality and pipeline/report health, troubleshoot and fix problems or anomalies, and document and share insights.
• Data Compliance and Governance : Follow data modeling and handling procedures to comply with laws and policies, tag and classify data, govern data accessibility and traceability, and contribute to the data glossary.