דרושים Senior Hadoop Software Engineer ב-איביי ב-Ireland, Dublin

• Collaborate with multi-functional engineering teams to deliver the platform and contribute to open-source projects.

• Work on building a very resilient distributed system at eBay's edges that can proxy all eBay traffic and also eBay's service mesh for all of our services with unparalleled observability.

• Work with other developers in different phases of system development.

• Build and debug large scale distributed systems and help with observability and monitoring of the system.

• Contribute your knowledge and experience of the networking topology (TCP and HTTP stack) to solve any network related issues encountered by the system, deploying and troubleshooting large scale infrastructure.

• Hands-on development experience with strong analytical skills.

• Familiarity and proven understanding of networking technologies like BGP, anycast is a must, experience with TCP/IP networking and familiarity with TCP, UDP, SSL and HTTP Protocols.

• Hands-on experience with various programming languages like C/C++, GoLang to build the system and also build automation around it for better observability and remediation, any experience with kernel programming and experience with Python is a plus!

• Distributed systems with design and implementation of network communication using container networking technologies.

• Multi-threaded programming: Telemetry infrastructure to accumulate and export statistical information.

• Excellent debugging and triaging skills and strong expertise in agile development.

• Familiarity with L4 Networking layer and Kubernetes is a plus.

What you will accomplish

• Lead the full lifecycle of software projects — from requirements gathering through design, development, testing, and deployment.

• Build and maintain tools that automate network lifecycle management and infrastructure deployment.

• Develop and configure monitoring systems to support network engineering operations.

• Implement new features, fix issues, and maintain high standards of software quality and test coverage.

• Model, manage, and analyze network data to improve automation and operational efficiency.

• Collaborate with engineers across infrastructure, operations, and AI teams to develop innovative solutions.

What you will bring

• 5+ years of software development experience, with at least 3 years in project or functional leadership.

• Proficiency in Go, Java, and Python , with strong debugging and problem-solving skills.

• Experience with CI/CD pipelines , Docker , Kubernetes , and time-series databases (TSDB).

• Proficient in SDLC protocols, data modeling, and systems integration.

• Working knowledge of UNIX/Linux environments and familiarity with network protocols (TCP/IP, routing, switching).

• Bachelor’s or Master’s degree in Computer Science or related field, or equivalent experience in the field.

Preferred qualifications

• Familiarity with LLM-based tools (e.g., ChatGPT, Claude Code) for engineering productivity.

• Experience with Cisco Nexus Dashboard Fabric Controller or Adobe Flex .

• Strong understanding of network automation, monitoring frameworks , and large-scale distributed systems.

The cool part

• Work on modern automation technologies powering one of the world’s largest e-commerce infrastructures.

• Collaborate with experienced engineers across networking, AI, and systems development.

• Compose eBay’s next-generation network management and monitoring solutions — at global scale.

• Design, develop, and maintain both client-side and server-side applications for eBay’s data platforms.

• Build responsive, accessible web applications using ReactJS , JavaScript , and modern UI frameworks.

• Develop and optimize backend services and RESTful APIs using Java and Spring Boot .

• Deploy, monitor, and manage cloud-native applications using Kubernetes and Docker .

• Collaborate closely with product, design, DevOps, and data engineering teams to deliver robust, integrated solutions.

• Conduct code reviews, testing, and performance tuning to ensure quality and scalability.

• 7+ years of experience as a Full Stack Engineer or in a similar software development role.

• Strong proficiency in Java , Spring Boot , and REST API design and integration.

• Expertise in ReactJS , JavaScript (ES6+), HTML, and CSS for dynamic, responsive UI development.

• Hands-on experience with Kubernetes , Docker , and CI/CD pipelines.

• Familiarity with cloud platforms such as AWS, GCP, or Azure.

• Excellent problem-solving, communication, and collaboration skills.

• Experience with microservices architecture and GraphQL .

• Familiarity with Agile/Scrum methodologies and modern testing frameworks.

• Proficiency in distributed systems and standard methodologies for scalable web services.

• Work on impactful applications that support eBay’s data and analytics ecosystem.

• Collaborate with a multi-functional team encouraging innovation across eBay’s data platforms.

• Build modern, cloud-native systems that power insights for one of the world’s largest commerce platforms.

As a on the Dublin team, you’ll play a key role in building, optimizing, and maintaining our Hadoop-based data warehouse and large-scale data pipelines. This is a hands-on engineering role where you’ll collaborate closely with data engineers, analysts, and platform teams to ensure our data platforms are scalable, reliable, and secure.

What you will accomplish

• Design, develop, and maintain robust, scalable data pipelines using Hadoop and related ecosystems.

• Implement and optimize ETL processes for both batch and streaming data needs across analytics platforms.

• Collaborate cross-functionally with analytics, product, and engineering teams to align technical solutions with business priorities.

• Ensure data security, reliability, and compliance across the entire infrastructure lifecycle.

• Troubleshoot distributed systems and contribute to performance tuning, observability, and operational excellence.

• Continuously learn and apply new open-source and cloud-native tools to improve data systems and processes.

What you will bring

• 6+ years of experience in data engineering, with a strong foundation in distributed data systems.

• Proficiency with Apache Kafka, Flink, Hive, Iceberg, and Spark SQL in large-scale environments.

• Working knowledge of Apache Airflow for orchestration and workflow management.

• Strong programming skills in Python , Java (Spring Boot) , and SQL across various platforms (e.g., Oracle, SQL Server).

• Experience with CI/CD, monitoring, and cloud-native tools (e.g., Jenkins, GitHub Actions, Docker, Kubernetes, Prometheus, Grafana).

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent practical experience).

The cool part

• Work on one of eBay’s most impactful data infrastructure platforms, supporting global analytics and insights.

• Join a collaborative, innovative engineering culture that embraces open-source and continuous learning.

• Solve complex, high-scale data challenges that directly shape how eBay makes data-driven decisions.

As a Senior Software Engineer, you will help shape the next generation of our Hadoop-based analytics infrastructure. eBay operates one of the world’s largest Hadoop deployments, with . You’ll join a team of passionate engineers who thrive on building at scale and contributing to open-source innovation.

• Lead the design and development of scalable, secure analytics infrastructure aligned with eBay’s platform vision.

• Build and optimize production-grade frameworks and features using Hadoop, Spark, and Iceberg.

• Contribute to open-source projects that advance both eBay and the broader data community.

• Collaborate across engineering teams to drive innovation, resiliency, and performance at massive scale.

• Solve complex system challenges with creativity, data-driven thinking, and technical depth.

• 7+ years of software engineering experience with proven expertise in Java and distributed systems design.

• Strong knowledge of Hadoop ecosystem technologies such as Hadoop, Spark, Iceberg, and YuniKorn.

• Deep understanding of computer science fundamentals, performance tuning, and concurrency.

• Experience working in Linux environments with strong networking and troubleshooting skills.

• A collaborative mindset with excellent communication and analytical abilities.

• Bachelor’s or Master’s degree in Computer Science, or equivalent experience in the field.

• Shape the future of eBay’s Hadoop ecosystem and big-data infrastructure.

• Work at global scale, driving analytics that power millions of eBay experiences.

• Join a culture that encourages open-source contribution, innovation, and collaboration.

What you will accomplish

• Lead the architecture and technical direction for eBay’s next-generation Core Data Platform.

• Design and develop distributed backend systems for data processing at massive scale.

• Optimize real-time and batch data services for performance, availability, and cost efficiency.

• Partner with cross-functional teams to deliver end-to-end data solutions that enable AI, search, and marketplace insights.

• Champion engineering excellence through automation, observability, and reliable service design.

• Mentor engineers and help foster an inclusive, collaborative, and high-performing team culture.

What you will bring

• 8+ years of experience in backend or distributed systems engineering, ideally within data platform or infrastructure domains.

• Proficiency in Java, Scala, or Go , with strong foundations in algorithms, data structures, and system design.

• Expertise in distributed data systems such as Kafka, Spark, Flink, or HDFS.

• Experience designing and operating large-scale services on cloud platforms (AWS, GCP, Azure, or private cloud).

• Understanding of data governance, cataloging, and orchestration frameworks .

• Strong communication and collaboration skills, with the ability to influence technical strategy across diverse teams.

The cool part

• Shape the future of eBay’s global Core Data Platform, enabling real-time AI and analytics innovation.

• Solve complex data challenges at global scale with a team passionate about performance and resilience.

• Work in a culture that values craftsmanship, diversity, and open-source collaboration.