Microsoft Data Engineer II 

India, Telangana, Hyderabad 

55062359

Basic Qualifications:

• Bachelor’s / Master’s degree in Computer Science or Engineering or Mathematics or IT technical discipline

• Architect, implement and optimize scalable infrastructure that enables …
• Data extraction across a wide variety of data sources
• Data ‘cleaning’, preprocessing and transformation for descriptive, predictive and prescriptive modeling
• Data Validation framework from source to endpoints ensuring data quality and integrity
• Data monitoring for reliable and fault tolerant data systems
• Automation of Data Integration / ingestion Pipelines and Orchestration in streaming and batch modes
• Design and Implement a Data platform that is Highly available with Data Intensive operations

• Ensure compliance and sovereignty of data per applicable policies

Preferred Qualifications:

• 5+ years of experience architecting, designing, and operating large scale big data services.

Preferred Qualifications:

• 5+ year experience with Azure Big Data stack (Data Lake, Spark, P ySpark , Hadoop) and distributed processing like Apache Spark, Azure Data Factory, Azure Automation or equivalent
• 5+ years development experience on large-scale (Big) data solutions including databases (SQL/No-SQL) and ETL / Data pipelines using cloud services.
• Hands-on expertise on Enterprise Python, complex SQL development and Kusto query language
• Modern DevOps practices (including Git, CI/CD, Azure DevOps/VSTS)
• Experience working in a fast-paced/competitive environment, and have a deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes.
• Long term strategic thinking and strong problem-solving skill

Working experience on any of the below technologies will be an added advantage:

• Azure Synapse Analytics
• High throughput logging systems/databases like Azure Log Analytics, ELK Stack or similar
• Service-oriented architecture using microservices and Kubernetes
• Azure SDK, PowerShell
• Experience with any analytical / visualization tool (Power BI, Cognos, OBIEE, etc.) is a plus.