Finding the best job has never been easier
Share
Advanced Data Engineer
You will be part of the IT Information Management & Analytics team and in this role, you will at the forefront of implementing state-of-the-art Generative AI, Machine Learning and AI Cognitive Services enhanced business use cases. This Advanced Data Engineer role will work with the business stakeholders, IT business partners, functional consultants, and infrastructure/technology teams to deliver innovative AI technology solutions that accelerate digital transformation and drive operational efficiency as well as business growth. You will focus primarily on the full cycle delivery of AI/ML use cases from requirements/design to release, driving the evolution of AI/ML infrastructure/process, and enabling Intelligent Apps & Automation, next generation of AI Copilots/Assistants, etc.
Collaborate with data scientists and AI engineers to build production-level models and pipelines, including any required preprocessing of input datasets and postprocessing after model inference.
Developing batch processing and real-time data processing solutions. Writing ETL (Extract, Transform, Load) processes, designing database systems, and implementing data pipelines for Gen AI & Class AI systems.
Optimizing data retrieval and developing dashboards for monitoring the quality of Data & AI systems. Tuning the performance of the data management systems to ensure high performance.
Work within project planning constraints, communicating any identified project risks and issues to the delivery/project manager and provide inputs to the change control process.
YOU MUST HAVE
Experience with Databricks, Snowflake, Informatica
WE VALUE
Understanding of application development framework like LangChain, LlamaIndex, and knowledge of vector index, vector databases
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Experience operating large data warehouse
These jobs might be a good fit