- Responsibilities:
- Explore new paths for cost reduction / optimizations for the product.
- Keep expanding the range of adoption for the product (targeting new solutions, frameworks & technologies).
- Expand & own a scalable, real time autonomous system that implements the optimizations.
- Instrumentation & enhancement: develop, maintain, and enhance our Java agent that performs low-level instrumentation of Spark applications to optimize their performance.
- Backend systems Scaling: design, implement, and scale robust backend systems that continuously configure our optimization agent, ensuring high availability and performance for our growing clientele.
- Continuous learning: stay abreast of the latest developments in Big Data technologies, especially Spark, and leverage this knowledge to suggest and implement improvements to our optimization strategies.
- Performance analysis & optimization: collaborate with the team to analyze application performance data, identify bottlenecks, and devise strategies to overcome performance-related challenges, ensuring optimal scalability.
- Collaboration & mentorship: work closely with other team members, providing guidance, mentorship, and expertise, fostering a culture of continuous improvement and knowledge sharing.
Qualifications- 5+ years of proven experience in backend system development with a focus on scalability, performance, and reliability.
- Strong coding skills with Python, with an emphasis on developing scalable backend systems.
- Experience with Spark.
- Experience with public Cloud, preferably with AWS.
- Experience with Java, Databricks, MapReduce, YARN - an advantage.
- Knowledge of Kubernetes - an advantage.
- Learning agility: demonstrated ability to quickly learn and adapt to new technologies and methodologies.
- Problem-Solving Skills: Excellent analytical and problem-solving abilities, with a knack for identifying and resolving performance bottlenecks.
- Team Player: Strong interpersonal and communication skills, with the ability to collaborate effectively in a team setting.
We offer a total compensation package that ranks among the best in the industry. It consists of competitive pay, stock, bonuses, as well as, benefit programs which include health, retirement, and vacation. Find more information about all of our Amazing Benefits