"VAST's data management vision is the future of the market."- Forbes
A Solutions Engineer works to balance various aspects of the project, from safety to design. Additionally, a Solutions Engineer researches advanced technology regarding best practices in the field and seek to find cost-effective solutions.
Job Description:
Key Responsibilities:
- Develop and maintain high-performance Big Data pipelines using Apache Spark, Python, Apache Kafka, Cloudera, HDFS and Hive.
- Engage directly with R&D and customers to understand their data challenges and deliver solutions that meet their needs.
- Leverage your IT expertise to manage and optimize data storage solutions, employing both SQL and NoSQL technologies.
- Work collaboratively with teams across Sales,Marketing, Product Management,R&D QA, and more, facilitating data-driven decision-making across the organization.
Required Skills & Experience:
- 1-2 years of hands-on experience with SPARK Streaming, with a strong proficiency in Python and Java.
- A total of 6-8 years of IT experience
- Excellent programming skills, particularly in Python and familiarity with other scripting languages.
- In-depth knowledge of SQL, NoSQL, and HDFS for data storage and management.
- Practical experience with the Cloudera platform, especially in a production Hadoop ecosystem.
- Familiarity with TPC-DS benchmarks for data warehousing and analytics performance evaluation.
- Effective communication skills, capable of engaging with diverse stakeholder groups, including direct interactions with customers.