Vice President-Applied AI/ML Lead

🏢 JP Morgan
📍 Palo Alto, United StatesFull-timeOn-site
📅 Posted: 1w ago🔄 Updated: 1w ago
CV%
✨ AI Summary
As a Vice President and Lead for Applied AI/ML in Payments and Global Banking Technology, you will be responsible for hands-on application-layer engineering using large language models (LLMs) to build scalable systems for banking and financial services. This role involves designing and developing production search, conversational AI, and agentic workflow systems, focusing on retrieval pipelines, dialogue management, and workflow automation. You will write and review code daily, troubleshoot systems issues, and collaborate with senior leaders and stakeholders to deliver end-to-end technical solutions while adhering to engineering quality standards.
Required Skills
Information Technology
PythonREST APIMicroservicesLarge Language ModelsPrompt EngineeringOrchestrationAWS
Business, Sales & Management
HR ManagementCold Calling
Other
output parsinglatencythroughputcost efficiencygraceful degradation
Soft Skills & Professional Competencies
PlanningCommunicationCollaboration
Nice to have:
Business, Sales & Management
Lead GenerationCost ControlHR Management
Design, Content & Media
Composition
Information Technology
Routing
Other
contextual compressionstateful workflowsmodel explainability
Soft Skills & Professional Competencies
Execution
🎁 Benefits & Perks
comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching
Requirements
Requires 6+ years of software engineering experience with Python, API design, and microservices architecture. Must have a working understanding of LLMs, prompt engineering, and experience with retrieval systems, conversational AI, or agentic architectures. Familiarity with AWS cloud services and strong communication/collaboration skills are essential. Experience with LLM evaluation, RAG patterns, agent orchestration, model governance, and explainability are preferred.
Description

Join the Payments and Global Banking Technology team as a Vice President and Engineer for Applied AI/ML. This is a hands-on, code-every-day role focused on application-layer engineering—using large language models as components within scalable systems that solve real business problems in banking and financial services. You will work within a team of engineers under the guidance of senior technical leaders, delivering high-quality features and systems end-to-end while developing your expertise in generative AI application development.

As a Vice President – Applied AI/ML Lead in Payments and Global Banking Technology, you design and build production search, conversational AI, and agentic workflow systems powered by generative AI. You deliver high-quality features and systems end-to-end within established architectural frameworks. You collaborate with senior technical leaders and cross-functional partners to translate requirements into scalable implementations. You contribute to engineering quality through strong implementation practices and peer review.

This role emphasizes practical application-layer engineering, including retrieval pipelines, conversational experiences, and workflow automation patterns, with a focus on reliability, performance, and maintainability in non-deterministic AI systems.

Job responsibilities:

  • Implement and iterate on production search, chatbot, and agentic workflow features, writing and reviewing code daily.
  • Build retrieval pipelines (hybrid search, re-ranking, chunking, and embedding strategies) and integrate them into conversational AI systems with dialogue management and backend services.
  • Implement components of agentic workflows (tool use, orchestration, error recovery, and human-in-the-loop patterns) within established architectural frameworks.
  • Troubleshoot and resolve systems issues related to latency, reliability, and observability in non-deterministic AI systems.
  • Follow and contribute to team technical standards, design patterns, and best practices for generative AI-powered applications.
  • Participate in design reviews and code reviews to maintain engineering quality.
  • Collaborate with product and business stakeholders to understand requirements and deliver technical solutions.

Required qualifications, capabilities, and skills: 

  • 6+ years of hands-on software engineering experience building production systems at scale, with exposure to search, conversational AI, or workflow automation.
  • Proficiency in Python, application programming interface (API) design, and microservices architecture.
  • Working understanding of large language model (LLM) capabilities and limitations, including prompt engineering, context management, and output parsing, and practical use of models as components.
  • Experience with at least one of the following: retrieval systems, conversational AI, or agentic architectures (tool calling, planning, and orchestration).
  • Awareness of systems-level concerns, including latency, throughput, cost efficiency, and graceful degradation.
  • Experience with Amazon Web Services (AWS) cloud services for production applications.
  • Strong communication and collaboration skills across technical and non-technical audiences.

Preferred qualifications, capabilities, and skills: 

  • Experience building evaluation and testing frameworks for LLM-powered applications.
  • Familiarity with retrieval-augmented generation (RAG) patterns, including query decomposition, multi-index routing, and contextual compression.
  • Exposure to agent orchestration, including parallel tool execution, stateful workflows, and cost/token management.
  • Experience working in regulated environments with awareness of model governance and explainability requirements.

This position is subject to Section 19 of the Federal Deposit Insurance Act. As such, an employment offer for this position is contingent on JPMorganChase’s review of criminal conviction history, including pretrial diversions or program entries

✨ Premium Match Details
Deep-dive CV analysis, customized Cover Letters, and Interview prep!
📊 Match Analysis
Insights against your active CV
📊
Personalized Match Analysis
Upload your CV to see exact matching percentages, detailed skills mapping, and gap analysis for this role.
🎯 Overalli74%
⚡ Skillsi85%
View Breakdown
Ontology Match: 85.0
Matched:✓ Requirements Matching✓ Ontology Skills Mapping
📜 Eligibilityi49%
View Breakdown
Local: 19600%
🏗️ Career Fiti91%
View Breakdown
Seniority: 91.0
📋 Requirementsi67%
View Breakdown
Domain: 67.0
🔥 Motivationi78%
View Breakdown
Title Fit: 78.00