Citi Group Ops Tech AI & Automation Principal Engineer 

United States, Texas, Irving 

609474736

The team you will be working with will consist of both employee and contractor resources based in the US and offshore. This diverse team will bring together a wealth of knowledge and experience in AI development, and you will have the opportunity to collaborate and learn from these talented individuals. You will also be expected to stay up-to-date with the latest advancements in AI and machine learning, and apply this knowledge to the continuous improvement and reengineering of our systems. This is a dynamic and fast-paced role that will require a high level of technical expertise and a passion for AI technology.

Responsibilities:

• Serve as a technology subject matter expert for internal and external stakeholders and provide direction for all firm mandated controls and compliance initiatives, all projects within the group and in creating a technology domain roadmap

• Ensure that all integration of functions meet business goals

• Define necessary system enhancements to deploy new products and process enhancements

• Recommend product customization for system integration

• Identify problem causality, business impact and root causes

• Exhibit knowledge of how own specialty area contributes to the business and apply knowledge of competitors, products and services

• Advise or mentor junior team members

• Impact the engineering function by influencing decisions through advice, counsel or facilitating services

• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

• Lead the development of Generative AI models, ensuring they are designed and implemented in line with business objectives and quality standards. This includes working closely with the modelling team to ensure the accuracy and efficiency of these models.

• Validate all AI models before deployment, conducting rigorous testing and debugging to ensure their reliability and performance. This includes ensuring that all models meet the necessary quality standards and comply with all relevant regulations.

• Establish and enforce guardrails for AI development, ensuring that all activities are conducted within defined parameters. This includes setting boundaries for model development and deployment to ensure the integrity and security of our systems.

• Oversee the integration of AI models into existing systems, ensuring seamless functionality and user experience. This includes working closely with the technology team to ensure successful integration.

• Collaborate with the business team to ensure that Ground Truth is captured for all Generative AI models. This involves ensuring that all models are based on accurate and reliable data, and that they accurately reflect the realities of the business environment.

• Foster a collaborative environment, working closely with the modelling and business teams to ensure the successful development and deployment of Generative AI models. This includes facilitating communication and collaboration between these teams, and ensuring that all team members are aligned with the overall AI development strategy.

Qualifications:

• 6+ years of relevant experience in an Engineering role

• Experience working in Financial Services or a large complex and/or global environment

• Project Management experience

• Proven hands-on experience with Large Language Models (LLMs) in previous projects, particularly in product development using LLMs, demonstrating a strong understanding of their application and functionality.

• Experience in Chat , IVR , and Banking sectors is highly desirable , showcasing the ability to apply AI technologies in diverse contexts.

• Proficiency in Speech to Text technologies such as Whisper and Google Text-to-Speech , demonstrating a strong understanding of natural language processing.

• Hands-on experience with Vector Database & Graph DB technologies such as Pinecone , Milvus , and Neo4j , indicating a strong understanding of database management and data modeling.

• Solid understanding and practical experience using Transformer and Neural Network models , demonstrating a strong foundation in machine learning and deep learning techniques.

• Hands-on experience using Open AI APIs and Open Source LLMs such as Llama2 , Mistral , Mixtral , etc., showcasing the ability to leverage open-source tools and resources in AI development.

• Solid understanding of frameworks like Langchain and Haystack , and the ability to use Agentic Workflows within these frameworks, indicating a strong ability to work within established AI development frameworks.

• Hands-on experience in creating Embeddings using MPNET and Ada models , demonstrating a strong understanding of word embedding techniques in natural language processing.

• Ability to use advanced techniques like Hybrid Dimensionality Reduction (HyDE) , Maximal Marginal Relevance (MMR) , and LLM reranking for effective semantic search , showcasing a strong understanding of advanced AI techniques and their application in improving search functionality.

• Comprehensive knowledge of design metrics, analytics tools, benchmarking activities and related reporting to identify best practices

• Demonstrated analytic/diagnostic skills

• Ability to work in a matrix environment and partner with virtual teams

• Ability to work independently, multi-task, and take ownership of various parts of a project or initiative

• Ability to work under pressure and manage to tight deadlines or unexpected changes in expectations or requirements

• Proven track record of operational process change and improvement

• Consistently demonstrates clear and concise written and verbal communication

Education

• Bachelor’s degree/University degree or equivalent experience

• Master’s degree preferred

Anticipated Posting Close Date:

View the " " poster. View the .

View the .

View the