AI Platform Engineer

Location: US, CA, Santa Clara

Time Type: Full time

Job Description

NVIDIA is looking to hire a deeply technical, creative, and AI Platform Engineer to build, support, and maintain the next generation of AI-powered enterprise products that improve engineering efficiency, data security, and power our product development. This role will give you the opportunity to collaborate with Cloud and AI/ML teams in a multifaceted and agile environment. You will be pivotal in shaping the technological future of our organization, ensuring our systems are scalable, reliable, and ready for the AI era.

What you will be doing:

• Define and lead AI-native infrastructure roadmaps and cross-organizational initiatives.

• Architect and scale LLM/ML infrastructure across cloud-native clusters and on-premises hardware.

• Design and implement observability for infrastructure health and AI model performance.

• Build LLM-aware monitoring and leverage AI to improve incident response and reduce toil.

• Develop automation and tooling to ensure reliability, scalability, and developer self-services

• Troubleshoot complex distributed systems, including deep Kubernetes and AI/ML scaling challenges.

• Drive AI-assisted engineering practices and mentor engineers to foster an AI-first culture.

What we need to see:

• 10+ years of experience in cloud, platform, or SRE roles.

• Bachelors degree or equivalent experience.

• Strong Python and at least one systems language (C++, Go, or Rust), with proven distributed systems debugging expertise.

• Deep experience building and scaling distributed systems, including Kubernetes and bare-metal infrastructure.

• Strong observability design across infrastructure and AI workloads (metrics, logging, tracing, AI quality signals).

• Hands-on experience operating AI/ML platforms, including MLOps, model serving, and GPU-accelerated environments.

• Practical use of AI-assisted development tools and coding agents in daily workflows.

• Solid foundation in data structures, algorithms, and complexity analysis.

• Excellent problem-solving, communication, and collaboration across multiple functions.

Ways to stand out from the crowd:

• Deep experience with AI/ML platforms (e.g., Hugging Face, Weights & Biases, NVIDIA NIM).

• Proven use of AI agents and LLM tooling to enhance observability, incident response, or developer productivity.

• Experience with artifact management, AI supply chain security, or trusted model distribution systems.

• Strong ownership demeanor with a structured, automation-first approach.

• Demonstrated impact driving AI-first engineering practices across teams.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 168,000 USD - 270,250 USD for Level 4, and 200,000 USD - 322,000 USD for Level 5.Applications for this job will be accepted at least until March 22, 2026.

This posting is for an existing vacancy. 

NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.