Capital One Senior Data Engineer - Principal Associate 

United States, Virginia, Arlington 

541556976

What You’ll Do:

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

• Work with a team of developers with deep experience in cloud services (AWS) , Big Data, machine learning and full stack systems

• Utilize programming languages like Python, Java, Scala, and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Snowflake

• Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community

• Collaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences

• Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance.

Basic Qualifications:

• Bachelor’s Degree

• At least 4 years of experience in application development (Internship experience does not apply)

• At least 1 year of experience in big data technologies

Preferred Qualifications:

• 5+ years of experience in application development including Python, SQL, Scala, or Java

• 5+ years experience with distributed data computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark)

• 4+ years of experience in Spark Scala or PySpark

• 4+ years of experience working on real-time data and streaming applications

• 3+ years of experience with AWS services EC2, EMR, ECS, S3, SNS, Lambda, RDS, VPC

• 3+ years of experience with AWS Security Groups or Identity and Access Management

• 4+ years of data warehousing and relational database experience (Snowflake , Oracle, or PostgreSQL)

• 4+ years of experience with Container Services (Amazon ECS, Amazon Fargate)

• 3+ years of experience building CI/CD pipelines

• 3+ years of experience with UNIX/Linux including basic commands and shell scripting

• 2+ years of experience with Agile engineering practices

• Certified AWS Solutions Architect Associate