Walmart Staff Software Engineer Data Engineer 

United States, California, Sunnyvale 

642541366

About the Data Organization:

Our organization focuses on managing and delivering world-class data assets, including creating and

:

• ou will use cutting edge data engineering techniques to create critical datasets and dig into our mammoth scale of data to help unleash the power of data science by imagining, developing, and maintaining data pipelines that our Data Scientists and Analysts can rely on

• be responsible for contributing to an orchestration layer of complex data transformations, refining raw data from source into targeted, valuable data assets for consumption in a governed

• and sellers’

• l ead the discovery phase of medium to large projects to come up with high level design by partnering with the product management, Web Operations, project management, business and user experience teams. Obtaining cross-function approvals, driving proof-of- concept and implementing prototypes to validate

• You will develop Innovation strategies, processes

• Utilizes industry research to improve Wal-Mart's technology environment by analyzing industry best practices, benchmarking industry against internal processes and solutions. Researching or influencing future industry solutions for fit with internal needs and defining software development guidelines, standards and processes.

• You will drive the execution of multiple business plans and projects by identifying customer and operational needs. Developing and communicating business plans and priorities, removing barriers and obstacles that impact performance. Developing contingency plans and demonstrating adaptability and supporting continuous learning.

• rovide guidance and mentorship to junior data

• You will design, develop and maintain highly scalable and fault-tolerant real time, near real time and batch data systems/pipelines that process, store, and serve large volumes of data with optimal performance.

• You will ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes.

• i dentif y possible options to address business problems within one's discipline through analytics, big data analytics, and automation

• You will build business domain expertise to s upport the data need for product teams, analytics , data scientists and other data consumers.

:

• Bachelor's/master’s degree in computer science or a related field

• 8 + years' experience in development of big data technologies/data pipelines

• in managing and manipulating huge datasets in the order of terabytes (TB) is

• in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.

• in building idempotent workflows using orchestrators like Automic , Airflow, Luigi etc.

• in writing SQL to analyze, optimize , profile data preferably in BigQuery or SPARK SQL

• facilitate seamless data joins across various

• Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development / data solution

• Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution

• to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this

Nice to have from you :

• Experience building complex near real time (NRT) streaming data pipelines using Apache Kafka, Spark streaming, Kafka Connect with a strong focus on stability, scalability and SLA adherence.

• Good understanding of REST APIs – working knowledge on Apache Druid, Redis, Elastic search, GraphQL or similar technologies.  Understanding of API contracts, building telemetry, stress testing etc.

• Exposure in developing reports/dashboards using Looker/Tableau

• Experience in eCommerce domain.

:

Flexible, Hybrid Work :

Benefits :
Benefits: Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.

: