Uber Software Engineer II - Data 

United States, West Virginia 

810027037

About the Role

- - - - What the Candidate Will Do ----

1. Solution Development: Collaborate with stakeholders to understand business needs and translate them into scalable and reliable data systems and tools, while ensuring data quality, privacy, and compliance.
2. Data Governance: Champion and enforce data governance practices, including data lineage, metadata management, data quality controls, and privacy regulations.
3. Data Architecture: Design and develop large-scale data systems, including databases, data warehouses, and big data platforms
4. Software Engineering Skills: Excellent programming skills, with expertise in building robust and scalable software solutions using modern software engineering practices
5. Design and build scalable data pipelines for both batch and real-time processing - leveraging Apache Airflow, Spark, and SQL for ETL workflows across diverse data sources (e.g., relational databases, APIs, logs), and using tools like Apache Kafka, Flink, and Spark Structured Streaming to enable near real-time data processing for analytics and monitoring use cases.
6. Automation and Efficiency: Drive automation initiatives by developing scripts, utilities, and frameworks to streamline data processes, improve efficiency, and enforce data governance practices.
7. Collaboration and Mentoring: Collaborate with cross-functional teams, mentor junior engineers
8. Innovation and Continuous Improvement: Stay updated with the latest industry trends and technologies in data engineering, Gen AI and Cloud solutions and create innovative solutions for complex challenges
9. Documentation and Knowledge Sharing: Maintain comprehensive documentation of data solutions, processes, best practices and actively share knowledge with the team.
10. Communication Skills: Strong verbal and written communication skills to effectively convey complex technical concepts

- - - - Basic Qualifications ----

1. 3+ years of experience as a software engineer, with a strong focus on data engineering and large-scale data systems
2. Strong SQL skills
3. Strong in Data Warehousing and Data Modelling concepts
4. Hands-on experience in Hadoop tech stack: HDFS, Hive, Presto, Spark, Flink, Airflow, MapReduce
5. Batch and Real Time Data processing using Airflow, Spark, HUDI, Kafka, Flink
6. Programming languages - Python, Scala etc.
7. Experience in building ETL Data Pipelines
8. Performance Troubleshooting and Tuning

- - - - Preferred Qualifications ----

1. Experience with Cloud Platforms such as AWS and GCP, using services like Amazon S3, EMR, Lambda, Redshift and GCP BigQuery
2. Experience in developing & deploying GenAI powered applications for predictive & generative analytics, code optimization and developer productivity
3. Experience building high-quality end-to-end data solutions in an agile environment from requirements to production.
4. Should be self-motivated and passionate about bringing efficiency into the system through optimizations.
5. Should be able to raise the bar for other engineers by proposing and driving innovative ideas.
6. Experience in mentoring junior team members technically.
7. If need be, Act as a Leader to drive big efforts in collaboration with other engineers or team members.

For San Francisco, CA-based roles: The base salary range for this role is USD$167,000 per year - USD$185,500 per year.

For Sunnyvale, CA-based roles: The base salary range for this role is USD$167,000 per year - USD$185,500 per year.