In this role, you’ll work in one of our IBM Consulting Client Innovation Centers, where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
We are seeking a highly skilled Data Engineer with expertise in advanced analytics and a strong understanding of Generative AI (GenAI). In this role, you will design, develop, and optimize scalable data pipelines, integrate GenAI technologies into analytics workflows, and support the deployment of machine learning models. You will collaborate closely with data scientists and cross-functional teams to ensure seamless data integration and drive innovation through cutting-edge AI solutions.
at
Required Technical and Professional Expertise
- At least 3+ years of work experience in Data Engineering and analytics
- Experience with SQL and Python
- Experience with data ingestion tools such as Azure Data Factory, AWS Glue or Airflow
- Experience with data processing tools such as Databricks, Spark, EMR
- Solid understanding of storage formats and types
- Experience with SQL and Python
Preferred Technical and Professional Expertise
- Experience in orchestration technologies (OpenShift, Kubernetes)
- Understanding of Data Modelling, Metadata Management and Data Warehousing
- Experience in the latest Lakehouse technologies such as Snowflake, Delta Lake and Synapse
- Experience in Google Cloud Platform