Note: The job is a remote job and is open to candidates in USA. NVIDIA is hiring a Senior Product Manager to lead Switchyard, its adaptive inference runtime for systems of models. The role owns product strategy, developer experience, partner integrations, adoption, and the translation of research advances into reliable products for model routing and adaptive inference.

Responsibilities

• Drive Switchyard’s product strategy and roadmap. Set priorities, quality bars, and clear product outcomes together with Engineering
• Work directly with agent harness builders, inference gateways, model serving systems, and other partners to make integrations successful and turn market feedback into stronger product capabilities
• Define the developer experience and product interfaces for adaptive inference
• Partner with Research to translate advances in areas like cost and quality prediction, constrained optimization, and budget allocation into usable products and features
• Partner with Engineering to improve reliability, usability, documentation, SDK coverage, and the customization path for production deployments
• Build the adoption motion with Product Marketing, Solution Architects, and GTM teams. Identify qualified workloads, guide partner pilots, and build repeatable deployment playbooks
• Establish the messaging and narrative for how our teams talk about model routing and adaptive inference, working together with Product Marketing
• Define and inspect the evidence for success. Own the outcomes
• Coordinate across adjacent teams to build compelling joint product outcomes

Skills

• Bachelor's or Master's degree in Computer Science, Engineering, AI/ML, or a related field, or equivalent experience
• 8+ years of product management or closely related experience building technical products for developers, infrastructure teams, or AI practitioners
• A record of scaling developer or infrastructure products through a partnership motion and integrations, not only through a single first-party application
• Technical proficiency in LLM inference, model routing, agent runtimes, and developer APIs
• Able to reason clearly about quality/cost/latency tradeoffs
• Ability to engage mature customers and partners independently, uncover real production constraints, and guide GTM teams through complex technical adoption
• Positive relationships with Engineering and Research teams
• Ask sharp questions, convert uncertainty into decisions, and support teams without prescribing implementation
• An evidence-driven product approach grounded in benchmarks, evals, and explicit success criteria
• Excellent written and verbal communication, good judgment, and the ability to align senior technical and business leaders across organizational boundaries
• Enough technical depth to inspect APIs, traces, and benchmark results directly and earn the trust of senior researchers and engineers
• Experience with LLM routers, AI gateways, model serving, distributed inference, or systems that dynamically allocate test-time compute
• Experience taking research from prototype to a reliable, adopted developer product
• A track record with open-source communities, SDKs, platform integrations, or developer ecosystems
• Hands-on familiarity with relevant adjacent topics like agent building, eval systems, and inference optimization

Benefits

• Equity

Company Overview

Company H1B Sponsorship