JFrog Senior Data Engineer - JFrog ML Group 

Dominican Republic, Santo Domingo 

46175257

In this dynamic, fast-paced environment, you will collaborate with other data professionals to create robust, scalable data solutions. You will be responsible for architecting, designing, and implementing data pipelines that ensure reliable data ingestion, transformation, and storage, ultimately supporting the production of high-performance ML models.

• Design and implement large-scale batch & streaming data pipelines infrastructure
• Build and optimize data workflows for maximum reliability and performance
• Develop solutions for real-time data processing and analytics
• Implement data consistency checks and quality assurance processes
• Design and maintain state management systems for distributed data processing
• Take a crucial role in building the group's engineering culture, tools, and methodologies
• Define abstractions, methodologies, and coding standards for the entire Data Engineering pipeline

• 5+ years of experience as a Software Engineer with focus on data engineering
• Expert knowledge in building and maintaining data pipelines at scale
• Strong experience with stream/batch processing frameworks (e.g. Apache Spark, Flink)
• Profound understanding of message brokers (e.g. Kafka, RabbitMQ)
• Experience with data warehousing and lake technologies
• Strong Python programming skills and experience building data engineering tools
• Experience with designing and maintaining Python SDKs
• Proficiency in Java for data processing applications
• Understanding of data modeling and optimization techniques

• Experience with ML model deployment and maintenance in production
• Knowledge of data governance and compliance requirements
• Experience with real-time analytics and processing
• Understanding of distributed systems and cloud architectures
• Experience with data visualization and lineage tools/frameworks and techniques