Capital One Master Data Engineer 

India, Karnataka, Bengaluru 

183090479

Voyager (94001), India, Bangalore, Karnataka Master Data Engineer

What You’ll Do:

• Lead the design, development, and optimization of scalable data ingestion pipelines and observability data stores.

• Architect and implement cloud-native data solutions to support real-time analytics and monitoring.

• Work closely with cross-functional teams, including software engineers, data scientists, and platform teams, to enhance data infrastructure and observability capabilities.

• Build and optimize distributed data storage solutions, leveraging scalable indexing and search frameworks such as OpenSearch.

• Develop and maintain efficient ETL/ELT processes for structured and unstructured data sources.

• Ensure high availability, reliability, and security of data platforms through automation, monitoring, and best practices.

• Collaborate with stakeholders to understand business requirements and translate them into technical solutions.

• Contribute to architectural decisions, code reviews, and technical mentorship within the team.

Required Qualifications:

• 7-10 years of experience in data engineering, software engineering, or a related field.

• Strong expertise in building scalable data ingestion pipelines using distributed processing frameworks.

• Hands-on experience with designing and optimizing data stores for large-scale observability and analytical workloads.

• Proficiency in cloud services (AWS preferred) and infrastructure-as-code tools.

• Solid programming skills in Python, Java, or Scala for building robust data solutions.

• Familiarity with indexing and search engines such as OpenSearch or Elasticsearch.

• Strong problem-solving skills and ability to work in a collaborative, agile environment.

Preferred Qualifications:

• Experience working with log analytics, metrics collection, and observability platforms.

• Knowledge of microservices, event-driven architectures, and API-based data integration.

• Familiarity with Kubernetes, Docker, and DevOps practices for data pipeline deployment.

• Exposure to Machine Learning Observability and monitoring frameworks.

If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.