Senior Engineer-ai Inference jobs at Bank Of America in United States, Addison

Job Description:

This position is focused on leadership, technical direction, and oversight to multiple initiatives delivering Gen AI technology capabilities and solutions. Key responsibilities of the role include developing solutions and processes for multiple organizations based on their design/architectural/Agile/DevOps practices.This job is responsible for defining an architectural vision and solution that supports the strategic outcomes of the Business' Products and Services. Key responsibilities include defining the target operating environment, designing for client resiliency, assisting with solution design, and defining non-functional requirements. Job expectations include working with stakeholders and service providers aligned to the Business' strategic objectives, evaluating the impact of strategic design decisions, and contributing to the architecture roadmap.

Responsibilities:

• Works across the business, operations and technology to create the solution intent and architectural vision for complex solutions and prioritize functional and non-functional requirements into a technology backlog to enable the technology roadmap and functionality to support evolving capabilities and services
• Contributes to the creation of the architecture roadmap of defined domains (Business, Application, Data, and Technology) in support of the product roadmap and the development of best practices including standardized templates
• Clarifies the architecture, assists with system design to support implementation, and provides solution options to resolve any architectural impediments
• Facilitates solution driven discussions, leads the design of complex architectures, and finds creative solutions through knowledge of domain, practical experiments, and proof of concepts while ensuring architecture is flexible, modular, and adaptable
• Educates team members on the technology practices, standardization strategies, and best practices to create innovative solutions
• Supports the team as needed to select the technology stack required for solutions and helps select preferred technology products
• Performs design and code reviews to ensure all non-functional requirements are sufficiently met (for example, security, performance, maintainability, scalability, usability, and reliability)

• Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution. Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs.

• Enables teams/applications with Continuous Integration/Continuous Development (CI/CD) capabilities and engages with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline.

• Guides and influences teams on design and best practices for high code performance –e.g. pairing, code reviews.

• Provides end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level.

• Conducts research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features.

• Works with stakeholders to establish high-level solution needs and with architects for technical requirements.

• Collaborate with product teams, data analysts and data scientists to design and build solutions.

• Design and execute the implementation plans to both move forward strategically, while at the same time ensuring the current technology stack is supporting current needs.

• Manage multiple priorities, and simultaneously engage with multiple teams worldwide.

• Be vocal and actively participate in all session with business stakeholders and agile teams.

• Manage next generation of architectural decision for advanced analytics platform, create strategy, roadmaps, present to tech and non-tech leaders.

• Coach and mentor team members.

Required Qualifications

• 8+ years of experience in platform development, architecture, and strategy for data science, modeling, advanced analytics, and Gen AI.

• Experience building E2E analytics platform focusing on self-service for as Data science, Big Data platform, Analytics etc.- Experience building E2E ML pipelines: Data prep, Model Build, training models, Deployment, Scoring, Monitoring and Optimization

• Experience working with technical and line of business users to gather the requirements, writing BRD for building platform, brainstorm with different set of tech and non-tech audience, document the details with conceptual diagrams, validate the tech feasibilities of capabilities by researching and working with tech teams, architects, and engineers.

• Reviews technical designs to ensure that they are consistent with defined architecture principles, standards, and best practices. Own technical decisions for the solution and application developers in the creation of architectural decisions and artifacts. Ability to clearly communicate with team & stakeholders.

• Collaborate with product teams, data analysts and data scientists to design and build solutions.

• Manage next generation of architectural decision for advanced analytics platform, create strategy, roadmaps, present to tech and non-tech leaders.

• Strong understanding of modern open-source data science platform architecture for storage & compute separation, interactive development workbenches, virtual environments, containers, and toolsets.

• Hands on experience on implementing CI/CD and automation using the Atlassian ecosystem.

• Knowledge of metadata management, data lineage, and principles of data governance

• Experience designing and building full stack solutions utilizing distributed computing architecture.

• Design and build and deploy streaming and batch data pipelines capable of processing and storing large datasets quickly and reliably using Kafka, Spark and YARN

Desired Qualifications

• Experience developing and delivering AI/ML, data, and analytics platform capabilities with open-source technologies, focusing on Gen AI – model serving, RAG frameworks, AI BI, MCP modules for enterprise data systems.

Skills:

• Analytical Thinking
• Architecture
• Result Orientation
• Solution Design
• Technical Strategy Development
• Application Development
• Collaboration
• Data Management
• DevOps Practices
• Risk Management
• Agile Practices
• Automation
• Influence
• Solution Delivery Process
• Test Engineering

Job Description:

This position is focused on design, build, and serve the Gen AI inferencing capabilities.

This job is responsible for defining and leading the engineering approach for complex features to deliver significant business outcomes. Key responsibilities of the job include delivering complex features and technology, enabling development efficiencies, providing technical thought leadership based on conducting multiple software implementations, and applying both depth and breadth in a number of technical competencies. Additionally, this job is accountable for end-to-end solution design and delivery.

Responsibilities:

• Assembles large, complex data sets that meet functional and non-functional requirements, ensuring that the design and engineering approach is consistent across multiple systems
• Maintains, improves, cleans, and manipulates large data for operational and analytics data systems, builds complex processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, and communicates required information for deployment, maintenance, and support of business functionality
• Utilizes multiple architectural components in the design and development of client requirements and collaborates with development teams to understand data requirements and ensure the data architecture is feasible to implement
• Defines and builds data pipelines to enable data-informed decision making, ensuring adherence to release processes and risk management routines
• Contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies any test issues and errors, and leads triage of underlying causes
• Leads the identification of gaps in data management standards adherence and works with appropriate partners to develop plans to close gaps, leading concept testing and conducting research to prototype toolsets and improve existing processes
• Mentors Data Engineers in the delivery and release of continuous integration and continuous delivery events and defines key performance indicators and internal controls
• Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution. Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs.
• Define the technology tool stack for the solution and evaluate and adapt new testing tool/framework/practices for team(s)
• Enables team(s)/applications with Continuous Integration/Continuous Development (CI/CD) capabilities and engages with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline
• Guides and influences team(s) on design and best practices for high code performance –e.g. pairing, code reviews
• Provides end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level
• Conducts research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features
• Works with stakeholders to establish high-level solution needs and with architects for technical requirements
• Proficient written and verbal communication skills to support and shape the platform and clearly articulate technical designs and concepts; and to communicate effectively with all levels within the organization
• Design and execute the implementation plans to both move forward strategically, while at the same time ensuring the current technology stack is supporting current needs.
• Manage multiple priorities, and simultaneously engage with multiple teams worldwide.
• Coach and mentor team members

Required qualifications:

• 10+ years strong experience designing and delivering AI, ML, Data platform, and advanced analytics platforms capabilities using open-source technologies in large enterprise environment
• Experience with emerging technologies e.g. of GenAI (public and open source), MCP, Agents, AI BI etc.
• Hands-on experience on data science, big data, cloud, governance technologies
• Experience architecting next generation AI analytical product delivery to all levels of users in organization using self-service interfaces
• Proven track record in data, analytics, insight and AI/ML platforms supporting multiple business units.
• Experience in designing, developing, and maintaining software frameworks using Open-Source technologies such as Python, Spark, Jupyter, FastAPI, LabelStud.io, Ragas etc.
• Strong working experience of how metadata management, semantic layers, labeling, annotations is important for enabling AI BI, MCP, Agents, Data Assistants etc.
• Experience with using various Open source and Cloud model for AI BI, Summarization etc., and tuning those models and deployment to provide higher throughput for latency and cost optimizations.
• Experience of building RAG with knowledge base, data sources and Vector Store platforms such as Redis, Solar, Postgres DB, FAISS, Teradata, Oracle, SQL Server, Hadoop etc.
• Hands on experienced building RAG, RAG Fusion, CAG etc.
• Experience with various inference metrics, and related monitoring and observability.
• Experience with serving multiple tenants/clients with model endpoints with secure boundaries.
• Experience with AI gateway, OPA, authentication & authorization, policy as code, API based systems Integration, cost management, and model routing

Desired Qualifications

• Experience developing Gen AI training and RAG platform with open-source model, inferencing & servicing capabilities, MCP modules etc.
• Hands on experience on driving and maintaining a culture of quality, innovation, and experimentation.
• Research on new tools and capabilities for better UI and UX for advanced analytics platform, quick prototype and demonstrate the features and capabilities, and participate on various user forums.

Skills:

• Analytical Thinking
• Application Development
• Data Management
• Risk Management
• Solution Design
• Agile Practices
• Architecture
• Collaboration
• Decision Making
• DevOps Practices
• Business Acumen
• Data Quality Management
• Financial Management
• Solution Delivery Process
• Test Engineering

This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, and solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Job expectations include a strong knowledge of development and testing practices common to the industry and design and architectural patterns.

Responsibilities:

• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
• Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
• Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
• Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
• Automates manual release activities
• Designs, develops, and maintains automated test suites (integration, regression, performance)

Managerial Responsibilities:
This position may also have responsibilities for managing associates. At Bank of America, all managers at this level demonstrate the following responsibilities, in addition to those specific to the role, listed above.

• Opportunity & Inclusion Champion: Creates an inclusive team where members are treated fairly and respectfully.
• Manager of Process & Data: Demonstrates and expects process knowledge, data driven decisions, simplicity and continuous improvement.
• Enterprise Advocate & Communicator: Delivers clear and concise messages that motivate, convey the “why” and connects contributions to business results.
• Risk Manager: Leads and encourages the identification, escalation and resolution of potential risks.
• People Manager & Coach: Knows and develops team members through coaching and feedback.
• Financial Steward: Manages expenses and demonstrates an owner’s mindset.
• Enterprise Talent Leader: Recruits, on-boards and develops talent, and supports talent mobility for career growth.
• Driver of Business Outcomes: Delivers results through effective team management, structure, and routines.

Required Qualifications

• 8 years of minimum experience required .
• Expert Python development skills
• Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization.
• Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. Hands on experience building frameworks using MLFlow, KubeFlow, Fine – Tuning techniques, Inference Frameworks
• Building API based application leveraging FAST API services, JWT Integration, API Gateway
• Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing
• Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)

Desired Qualifications

Skills:

• Application Development
• Automation
• Influence
• Solution Design
• Technical Strategy Development
• Architecture
• Business Acumen
• DevOps Practices
• Result Orientation
• Solution Delivery Process
• Analytical Thinking
• Collaboration
• Data Management
• Risk Management
• Test Engineering

Job Description:

This job is responsible for providing leadership, technical direction and oversight to a team delivering technology solutions. Key responsibilities of the job are to provide oversight of the design, implementation, and maintenance of complex computer programs, align technical solutions to business objectives, and ensure that coding practices/quality comply with software development standards. Job expectations include conducting multiple software implementations and applying both depth and breadth in knowledge of several technical competencies.

Responsibilities:

• Designs, develops and is accountable for feature delivery
• Applies enterprise standards for solution design, coding and quality
• Ensures solution meets product acceptance criteria with minimal technical debt
• Guides the team on work breakdown and execution
• Works with the Product Owner to ensure that product backlog/requirements are healthy, with clear acceptance criteria
• Plays a team lead role (as an individual contributor) and mentors the team
• Guides team members with skills and practices (planning and estimation, peer reviews, and other engineering practices)
• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements.
• Utilizes multiple architectural components (across data, application, business) in design and development of client requirements.
• Performs Continuous Integration and Continuous Development (CI-CD) activities.
• Contributes to story refinement and definition of requirements.
• Participates in estimating work necessary to realize a story/requirement through the delivery lifecycle.
• Manage multiple priorities, and simultaneously engage with multiple teams.
• Be vocal and actively participate in all session with business stakeholders and agile teams.
• Collaborate with product teams, data analysts and data scientists to design and build solutions

Required Qualifications

• 8+ years of software development experience on large, complex systems focused on AI/ML/Gen AI/ Adv. analytics
• Minimum 2 years of hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.
• Experience developing Gen AI training and RAG platform with open-source model, inferencing & servicing capabilities, MCP modules etc.
• Experience in designing, developing, and maintaining software frameworks using Open-Source technologies such as Python, Spark, Jupyter, FastAPI, OPA, API Six, LabelStud.io, Ragas etc.
• Knowledge of metadata management, Labeling, annotations, principles of data governance
• Hands on experience building & leading team and delivering features and capabilities.
• Experience in OOP in Python/Java programming experience with expert level development skills
• Hands-on experience in application development in one or more areas MongoDB, Redis, React Frameworks, Containers, Building API based application leveraging FAST API services, JWT Integration
• Experience on model serving pipelines and deployments in production: steps including Data prep, model tuning, training models, Deployment, Inferencing/Scoring, Monitoring and Optimization
• Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)

Skills:

• Automation
• Influence
• Result Orientation
• Stakeholder Management
• Technical Strategy Development
• Architecture
• Business Acumen
• Risk Management
• Solution Delivery Process
• Solution Design
• Agile Practices
• Analytical Thinking
• Collaboration
• Data Management
• DevOps Practices

Job Description:

This position is focused on design, build, and operate of reusable toolkits for Gen AI RAG capabilities.

This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, and solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Job expectations include a strong knowledge of development and testing practices common to the industry and design and architectural patterns.

Responsibilities:

• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
• Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
• Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
• Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
• Automates manual release activities
• Designs, develops, and maintains automated test suites (integration, regression, performance)

Required qualifications:

• 5+ years of software development experience on large, complex systems required .
• Experience in OOP in Python/Scala/Java programming experience with expert level development skills
• Hands on experience and knowledge generative AI RAG process for various use cases, including chunking, embedding, retrieval, reranking and summarization.

• Hands-on experience in application development in one or more areas MongoDB, Redis, Angular/React Frameworks, Containerization, Building API based application leveraging FAST API services, JWT Integration, API Gateway

• Develop efficient utilities, automation frameworks, data science platforms that can be utilized across multiple Data Science teams for AI/ML and GenAI work.
• Experience with AI/ML/GenAI Lifecycle Management and Development and its Ecosystem. Hands on experience building frameworks using MLOps, Fine – Tuning techniques, Inference Frameworks
• Building API based application leveraging FAST API services, JWT Integration, API Gateway
• Working in large sized teams that collaboratively develop on a shared multi-repo codebase using IDEs (e.g. VS Code rather than Jupyter Notebooks), Continuous Integration (CI), Continuous Deployment (CD) and Continuous Testing
• Hands-on DevOps experience with one or more of the following enterprise development tools: Version Control (GIT/Bitbucket), Build Orchestration (Jenkins), Code Quality (SonarQube and pytest Unit Testing), Artifact Management (Artifactory) and Deployment (Ansible)

Desired Qualifications:

Skills:

• Application Development
• Automation
• Influence
• Solution Design
• Technical Strategy Development
• Architecture
• Business Acumen
• DevOps Practices
• Result Orientation
• Solution Delivery Process
• Analytical Thinking
• Collaboration
• Data Management
• Risk Management
• Test Engineering

Job Description:

This position is focused on leadership, technical direction, and oversight to multiple initiatives delivering Gen AI technology capabilities and solutions. Key responsibilities of the role include developing solutions and processes for multiple organizations based on their design/architectural/Agile/DevOps practices.

Job responsibilities:

• Ensures that the design and engineering approach for complex features are consistent with the larger portfolio solution. Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs.
• Enables teams/applications with ContinuousIntegration/ContinuousDevelopment (CI/CD) capabilities and engages with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline.
• Guides and influences teams on design and best practices for high code performance –e.g. pairing, code reviews.
• Provides end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level.
• Conducts research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features.
• Works with stakeholders to establish high-level solution needs and with architects for technical requirements.
• Collaborate with product teams, data analysts and data scientists to design and build solutions.
• Design and execute the implementation plans to both move forward strategically, while at the same time ensuring the current technology stack is supporting current needs.
• Manage multiple priorities, and simultaneously engage with multiple teams worldwide.

• Be vocal and actively participate in all session with business stakeholders and agile teams.
• Manage next generation of architectural decision for advanced analytics platform, create strategy, roadmaps, present to tech and non-tech leaders.

• Coach and mentor team members.

Required Qualifications

• Bachelor’s or master’s degree in computer science or engineering or related field
• 8+ years of experience in platform development, architecture, and strategy for data science, modeling, advanced analytics, and Gen AI.
• Experience building E2E analytics platform focusing on self-service for as Data science, Big Data platform, Analytics etc.- Experience building E2E ML pipelines: Data prep, Model Build, training models, Deployment, Scoring, Monitoring and Optimization
• Experience working with technical and line of business users to gather the requirements, writing BRD for building platform, brainstorm with different set of tech and non-tech audience, document the details with conceptual diagrams, validate the tech feasibilities of capabilities by researching and working with tech teams, architects, and engineers.
• Reviews technical designs to ensure that they are consistent with defined architecture principles, standards, and best practices. Own technical decisions for the solution and application developers in the creation of architectural decisions and artifacts. Ability to clearly communicate with team & stakeholders.
• Collaborate with product teams, data analysts and data scientists to design and build solutions.
• Manage next generation of architectural decision for advanced analytics platform, create strategy, roadmaps, present to tech and non-tech leaders.
• Strong understanding of modern open-source data science platform architecture for storage & compute separation, interactive development workbenches, virtual environments, containers, and toolsets.
• Hands on experience on implementing CI/CD and automation using the Atlassian ecosystem.
• Knowledge of metadata management, data lineage, and principles of data governance
• Experience designing and building full stack solutions utilizing distributed computing architecture.
• Design and build and deploy streaming and batch data pipelines capable of processing and storing large datasets quickly and reliably using Kafka, Spark and YARN

Desired Qualifications

• Experience developing and delivering AI/ML, data, and analytics platform capabilities with open-source technologies, focusing on Gen AI – model serving, RAG frameworks, AI BI, MCP modules for enterprise data systems.

Job Description:

Job Description:

Axia/Healthcare Payments is the bank's first AWS hosted In-Production platform. Require a Lead Software Engineer with the skillset to support the expanding and revenue generating platform. We have a critical risk on AWS / Cloud / Container knowledge within global tech that needs support as quickly as we can resolve.

This job is responsible for developing and delivering complex requirements to accomplish business goals. Key responsibilities of the job include ensuring that software is developed to meet functional, non-functional and compliance requirements, and solutions are well designed with maintainability/ease of integration and testing built-in from the outset. Job expectations include a strong knowledge of development and testing practices common to the industry and design and architectural patterns.

Required Qualifications:

5 Year's Experience in:

Project Management

Stakeholder communication

Cloud Application Development using AWS/Azure/Containers

proficient in designing, deploying, and managing cloud infrastructure on AWS / Azure of Containers. Expertise in building microservices and deploying the workloads via CICD. Expert in application architecture, system performance optimization and solving complex problems.

Previous experience in

• C#, Redis,
• Leading agile/scrum development team

Desired Qualifications:

Proficient in JAVA development, including Spring Boot and RESTful APIs.

Responsibilities:

• Codes solutions and unit test to deliver a requirement/story per the defined acceptance criteria and compliance requirements
• Designs, develops, and modifies architecture components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
• Mentors other software engineers and coach team on Continuous Integration and Continuous Development (CI-CD) practices and automating tool stack
• Executes story refinement, definition of requirements, and estimating work necessary to realize a story through the delivery lifecycle
• Performs spike/proof of concept as necessary to mitigate risk or implement new ideas
• Automates manual release activities
• Designs, develops, and maintains automated test suites (integration, regression, performance)

Skills:

• Application Development
• Automation
• Influence
• Solution Design
• Technical Strategy Development
• Architecture
• Business Acumen
• DevOps Practices
• Result Orientation
• Solution Delivery Process
• Analytical Thinking
• Collaboration
• Data Management
• Risk Management
• Test Engineering