Vastdata Solutions Data Engineer 

Israel, Tel-Aviv District, Tel-Aviv 

896568165

"VAST's data management vision is the future of the market."- Forbes

A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.

Job Description:

Key Responsibilities:

• Develop and maintain high-performance Big Data pipelines using Apache Spark, Python, Apache Kafka, Cloudera, HDFS and Hive.
• Engage directly with R&D and customers to understand their data challenges and deliver solutions that meet their needs.
• Leverage your IT expertise to manage and optimize data storage solutions, employing both SQL and NoSQL technologies.
• Work collaboratively with teams across Sales,Marketing, Product Management,R&D QA, and more, facilitating data-driven decision-making across the organization.

Required Skills & Experience:

• 1-2 years of hands-on experience with SPARK Streaming, with a strong proficiency in Python and Java.
• A total of 6-8 years of IT experience
• Excellent programming skills, particularly in Python and familiarity with other scripting languages.
• In-depth knowledge of SQL, NoSQL, and HDFS for data storage and management.
• Practical experience with the Cloudera platform, especially in a production Hadoop ecosystem.
• Familiarity with TPC-DS benchmarks for data warehousing and analytics performance evaluation.
• Effective communication skills, capable of engaging with diverse stakeholder groups, including direct interactions with customers.