Role Type Technical Engineering and Support
We are seeking an experienced Confluent Kafka Administrator to manage and maintain our Kafka infrastructure. The ideal candidate will have a minimum of 3-5 years of experience with Confluent Kafka and a strong background in data streaming and real-time data processing.
Your key responsibilities
- Kafka Cluster Management: Install, configure, and manage Kafka clusters, including Confluent Kafka components.Monitoring and Performance Tuning: Monitor Kafka clusters for performance, reliability, and capacity planning. Optimize Kafka performance and troubleshoot issues.
- Security: Implement and manage security measures for Kafka clusters, including encryption, authentication, and authorization.
- Data Integration: Work with development teams to integrate Kafka with various data sources and sinks.
- Upgrades and Patching: Plan and execute upgrades and patches for Kafka clusters to ensure they are up-to-date with the latest features and security fixes.
- Disaster Recovery: Develop and maintain disaster recovery plans for Kafka clusters.
- Documentation: Create and maintain documentation for Kafka configurations, processes, and procedures.
- Support: Provide support for Kafka-related issues and work closely with other teams to resolve any problems.
- Topic Management: Manage Kafka topics, including adding and removing topic configurations, setting cleanup policies, and configuring retention times.Support 24/7 shift coverage for BAU production support. Ready to work in Shift and flexible to work on weekends.
Skills and attributes for success
- Experience : Minimum of 3 years of experience with Confluent Kafka.
- Technical Skills: Strong knowledge of Kafka architecture, Kraft mode (Kafka Raft), Kafka Connect, Kafka Streams, and KSQL.
- Scripting and Automation: Proficiency in scripting languages (e.g., Python, Bash) and automation tools (e.g., Ansible, Terraform).
- Monitoring Tools: Experience with monitoring tools like Prometheus, Grafana, Dynatrace, and Splunk ITSI.
- Security: Knowledge of security best practices for Kafka, including SSL/TLS, Kerberos, and RBAC.
- Problem-Solving: Strong analytical and problem-solving skills.
- Communication : Excellent communication and collaboration skills.
To qualify for the role, you must have
- Certifications : Confluent Certified Administrator or Developer.
- Cloud Experience: Experience with cloud platforms (e.g., AWS) and managing Kafka in cloud environments.
- DevOps : Familiarity with DevOps practices and tools.
- Database Knowledge: Experience with databases such as PostgreSQL, MySQL, or MongoDB.
- Big Data Technologies: Familiarity with big data technologies like Hadoop, Spark, or Flink.
- Containerization and Orchestration: Experience with Docker and Kubernetes.
- CI/CD Pipelines : Knowledge of continuous integration and continuous deployment (CI/CD) pipelines.
- Agile Methodologies : Experience working in Agile development environments.
What we offer
EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across six locations – Argentina, China, India, the Philippines, Poland and the UK – and with teams from all EY service lines, geographies and sectors, playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants, we offer a wide variety of fulfilling career opportunities that span all business disciplines. In GDS, you will collaborate with EY teams on exciting projects and work with well-known brands from across the globe. We’ll introduce you to an ever-expanding ecosystem of people, learning, skills and insights that will stay with you throughout your career.
- Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
- Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
- Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
- Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.