SAP Senior Data Engineer Automation 

India, Karnataka, Bengaluru 

941828800

POSITION OVERVIEW

As a Lead QA Engineer for the Data Engineering team responsible for building analytical solutions for SAP SuccessFactors, you will be expected to ensure the highest quality of data pipelines and analytics systems. Your role involves buidling end-to-end quality assurance processes, from validating data extraction and transformation to performance testing and troubleshooting.

RESPONSIBILITIES

• Data Pipeline Testing:Validate ETL processes for accuracy, test big data pipelines using Spark, Hive, and HBase, and implement automated tests (Pytest/JUnit) to support continuous integration.
• Data Quality Assurance:Ensure data consistency, integrity, and accuracy across pipelines and verify correctness from source to target systems.
• Performance and Scalability Testing:Test pipeline throughput, latency, and performance under high data volumes through load testing to ensure scalability and system stability.
• Data Engineering Validation:Ensure data conforms to schemas, formats, and business requirements, and validate data cleansing and transformation processes.
• Integration Testing:Test data flow between microservices and validate both batch and streaming data for operational consistency.
• System Integration Testing (SIT):Perform SIT as part of the CI/CD pipeline to validate the integrated components of data pipelines and ensure seamless system interactions.
• API and Microservices Testing:Validate the functionality, security, and performance of APIs and microservices, ensuring smooth communication and data flow between services in the data pipeline.
• Monitoring and Troubleshooting:

SKILLS & COMPETIENCES

• Data Engineering:Deep understanding of ETL processes, big data technologies (Spark, Hive, HBase), and data validation.
• Automation Tools:Experience with Pytest, JUnit, or similar frameworks to automate testing in CI/CD environments.
• Performance Testing:Proficiency in load and performance testing tools to simulate high-volume data scenarios.
• System Integration Testing (SIT):Experience with SIT in CI/CD pipelines, ensuring smooth integration of all components and data flows.
• API and Microservices Testing:Expertise in testing APIs and microservices, including functionality, security, and performance validation using tools like Postman, SoapUI, or RestAssured.
• Data Quality:Expertise in ensuring data integrity, consistency, and cleansing processes across complex systems.
• Integration & Microservices:Knowledge of microservices architecture and testing integration between services and batch/streaming data flows.
• Monitoring & Troubleshooting:Familiarity with tools likeSplunkDynatrace, and strong problem-solving skills for root cause analysis.
• Collaboration & Leadership:

WORK EXPERIENCE & EDUCATION

• Requires 8+ years of professional experience is essential for understanding system architecture, programming, and technical troubleshooting.
• Outstanding written and verbal communication skills.
• Bachelors/master’s in computer science required.

​

Job Segment:Database, Testing, QA, Quality Assurance, Cloud, Technology, Quality