Finding the best job has never been easier
Share
What you'll do:
What you bring:
Responsibilities:
• Design, develop, and maintain robust, scalable data pipelines to support various data processing needs.
• Implement data ingestion processes from multiple sources including databases, APIs, and streaming platforms.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that meet their analytical needs.
• Work closely with software engineers to integrate data solutions into existing systems and applications.
• Implement and enforce data governance policies to ensure data quality, consistency, and security.
• Troubleshoot and resolve data-related issues in a timely manner.
• Stay up-to-date with emerging technologies and trends in data engineering and contribute to continuous improvement initiatives.
Requirements:
• Bachelor's degree in Data Science or a related field. Master's degree preferred.
• 4-5 years of experience in data engineering roles, preferably in a fast-paced environment.
• Experience with ETL (Extract, Transform, Load) tools such as Informatica, Talend, or Apache NiFi.
• Hands-on experience with relational and NoSQL databases.
• Experience with data processing frameworks and technologies such as Apache Spark, Hadoop, or Flink.
• Proficiency in programming languages such as Python, Java, or Scala.
• Exposure to cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Familiarity with machine learning concepts and frameworks.
Job Segment:Cloud, ERP, QA, Quality Assurance, Strategic Planning, Technology, Quality, Strategy
These jobs might be a good fit