Expoint - all jobs in one place

המקום בו המומחים והחברות הטובות ביותר נפגשים

Limitless High-tech career opportunities - Expoint

Microsoft Data Engineer II 
India, Telangana, Hyderabad 
55062359

30.07.2024
Qualifications

Basic Qualifications:

  • Bachelor’s / Master’s degree in Computer Science or Engineering or Mathematics or IT technical discipline
  • Architect, implement and optimize scalable infrastructure that enables …
    • Data extraction across a wide variety of data sources
    • Data ‘cleaning’, preprocessing and transformation for descriptive, predictive and prescriptive modeling
    • Data Validation framework from source to endpoints ensuring data quality and integrity
    • Data monitoring for reliable and fault tolerant data systems
    • Automation of Data Integration / ingestion Pipelines and Orchestration in streaming and batch modes
  • Design and Implement a Data platform that is Highly available with Data Intensive operations
  • Ensure compliance and sovereignty of data per applicable policies

Preferred Qualifications:

  • 5+ years of experience architecting, designing, and operating large scale big data services.

Preferred Qualifications:

  • 5+ year experience with Azure Big Data stack (Data Lake, Spark, P ySpark , Hadoop) and distributed processing like Apache Spark, Azure Data Factory, Azure Automation or equivalent
  • 5+ years development experience on large-scale (Big) data solutions including databases (SQL/No-SQL) and ETL / Data pipelines using cloud services.
  • Hands-on expertise on Enterprise Python, complex SQL development and Kusto query language
  • Modern DevOps practices (including Git, CI/CD, Azure DevOps/VSTS)
  • Experience working in a fast-paced/competitive environment, and have a deep desire to work collaboratively, solve problems with groups, find win/win solutions and celebrate successes.
  • Long term strategic thinking and strong problem-solving skill

Working experience on any of the below technologies will be an added advantage:

  • Azure Synapse Analytics
  • High throughput logging systems/databases like Azure Log Analytics, ELK Stack or similar
  • Service-oriented architecture using microservices and Kubernetes
  • Azure SDK, PowerShell
  • Experience with any analytical / visualization tool (Power BI, Cognos, OBIEE, etc.) is a plus.