Your Role and ResponsibilitiesWe are seeking an experienced Data Engineer to join the Asset Engineering team. In this role, you will be responsible for building innovative AI-powered solutions that integrate with various systems and applications. You will also be working with the broader team to build, analyse and improve the AI solutions.Required Technical and Professional Expertise
- 8+ years of professional experience; 5+ years of experience in Data Engineer with ML exposure.
- Proficiency in Python programming language with exposure to RESTful APIs.
- Knowledge of database management systems such as MySQL or PostgreSQL.
- Experience with web scraping and other data collection methods. Optimizing data retrieval and machine learning workflows to improve performance of Generative AI systems in real-time environments
- Exploratory Data Analysis on both structured and unstructured data, generate and propose insights. Data management (including creating tools to support PMs for creating use case specific KBs and use flows).
Preferred Technical and Professional Expertise
- Work with the Product Managers and technical lead to build the data pipeline and knowledge bases to support the AI use cases. Work with integration team to integrate models into production environments and ensure smooth data flow.
- Experience with IBM Cloud, Cirrus (IBM CIO Private Cloud). Experience with DevOps tools including GitHub Enterprise, CI/CD
- Ensuring data security, privacy, and compliance standards are met