Expoint - all jobs in one place

Finding the best job has never been easier

Limitless High-tech career opportunities - Expoint

IBM Data Engineer 
India, Uttar Pradesh, Noida 
751936507

27.11.2024

Your Role and Responsibilities

  • Develop and maintain data pipelines for data ingestion, transformation, and loading.
  • Optimize data pipelines for performance and scalability.
  • Monitor data quality and troubleshoot issues.
  • Collaborate with Data Architect and DevOps for infrastructure management.


Required Technical and Professional Expertise

  • Strong programming skills in Python (or similar language).
  • Experience building data pipelines and data transformation processes with DBT, DuckDB, Spark, and other ETL/ELT tools.
  • Familiarity with data ingestion tools like Kafka (if applicable).
  • Experience of cloud platforms for data storage and processing.


Preferred Technical and Professional Expertise

  • Knowledge of Model Ops practices on cloud and containerization
  • Familiarity with design lead development methodologies in complex data platforms and analytics
  • Ability to work with data from the data platform and communicate insights effectively.