Finding the best job has never been easier
Apple Software Engineer Flink/Kafka India, Karnataka, Bengaluru 603992193
31.08.2024
Share
Description
If so, Data Services Big Data Engineering team is looking for a highly motivated, diligent, energetic individual with excellent written and verbal skills who are not afraid to think creatively and question assumptions. In this role, you will be part of a fast growing, cohesive team with many exciting responsibilities related to Big Data, including:- Setup of Flink platform using Kubernetes/EKS on AWS.- Build ETL pipeline in Java using Apache Flink & Kafka to load data into Relational Datastore.- Handle a large-scale fleet of Kafka servers.- Define/develop Big Data technologies, platforms and applications.- Architect, improve, and scale applications to the next level. - Interface with application owners, developers and project managers.- Recommend and deploy tools and processes to enable rapid development, deployment and operations of big data solutions.
Minimum Qualifications
- B.Tech Computer Science or equivalent.
- Strong education in Computer Science, Software Engineering, Algorithms, Operating Systems, Networking, etc.
- 5+ years of working experience in designing, building, and managing highly available and large-scale data platforms.
- 5+ years of demonstrated experience of backend/core Java programming, design, architecture, performance, multi-threading, etc.
- Strong experience and knowledge in Big Data Technologies with proven expertise in event streaming technologies Flink and Kafka.
- Solid understanding of ETL pipeline development using Java in data processing frameworks such as Apache Spark, Apache Flink and Apache Kafka.
- Expertise in Kubernetes internals and Kubernetes Operators, with a strong ability to design and develop solutions using Kubernetes.
- Experience with other programming and scripting languages like Python, Go and Bash desirable.
- Available for on-call support during IST hours as needed.
Preferred Qualifications
- Experience with public clouds, specially AWS. Preferably with knowledge of cost optimisation.
- Familiarity with DevOps practices, including continuous integration, continuous delivery, testing, and monitoring.
- Strong communication and collaboration skills, with the ability to handle ambiguity and prioritise issues to provide clarity.
- Proven track record to take ownership of a product end-to-end, drive its development, and generate innovative ideas independently.
These jobs might be a good fit
