NVIDIA

Director, Software Engineering - NIM Factory

Santa Clara, CA US
USD 308k - 471k
Deep Learning Microservices API
Search for More Jobs Talk to a recruiter now 💪
Description

Are you ready to usher in the new world of Artificial Intelligence? Do you want to build the rockets launching the AI revolution? We are seeking a Director of Software Engineering for building a GPU accelerated software platform for inference applications. The right candidate for this role brings a mix of humanity and technical talent to provide the drive and creative direction to the way NVIDIA optimizes, serves, and measures the performance of AI models. Your team will build optimized scalable AI services and software products engineered for fast software delivery with the most recent research breakthroughs. Our work is a collaboration with internal and external partners who are developing innovative AI models and accelerating them to provide the highest performing inference on the market. NVIDIA NIMs are easy to use and designed for all deployment scenarios, in the cloud, on self-hosted infrastructure, and locally on all NVIDIA GPUs. You are your team's heart, its strategist, and its north-star. You must have a passion for engineering fundamentals. Your team is building software products and cloud services with good engineering principle and innovative software designs. You believe in teamwork, collaboration and love growing a strong diverse team with a culture of learning.

NVIDIA is building a new category of products by combining deep learning innovation, accelerated computing with industry-leading generative AI techniques at scale. You will harness groundbreaking GPU technologies and build highly efficient automation and software processes for NVIDIA’s NIM Factory. Together with our partners, your team will innovate from model ingestion, optimization, predictable testing methods all the way through deployment. You collaborate on sophisticated techniques with other NVIDIA technologists. Your team's work strives to accelerate the delivery of every AI model on GPUs anywhere. You will continuously be learning about the latest acceleration techniques in AI Inference and learn from top talent in the industry.

What you’ll be doing:

  • You will direct the design and implementation of an industry-leading software platform built on top of heterogeneous hardware and cloud infrastructure.

  • Optimize the internal software operations across all of NVIDIA’s products using the latest generative AI techniques.

  • Manage the deployment of large-scale GPU systems to support a reliable and efficient enterprise-grade operational platform.

  • Collaborate with diverse teams within and outside of NVIDIA to drive innovation.

  • Improve development practices and strategies across the organization.

  • Remain involved and gain a deep understanding of the technology, demonstrating your knowledge in cloud and software platforms.

  • Drive improvements in performance by implementing engineering practices that prioritize measuring and addressing bottlenecks.

  • Foster continuous feedback loops to ensure flawless optimization of AI models and NIMs.

What we need to see:

  • Proven authority in engineering leadership with a Master’s or equivalent experience in Computer Science, Computer Engineering, or a related field.

  • Extensive experience developing software as a service platforms, infrastructure, automation, and microservices.

  • Demonstrated success in designing high-performance, cloud-scale APIs and distributed software platforms.

  • Exceptional engineering fundamentals with the ability to navigate complicated and ambiguous problems.

  • History of teamwork across interpersonal matrix operations, setting up strategy, and collaborating with different levels of the organization.

  • 15+ years of hands-on experience delivering software platforms and services.

  • 5+ years of proven skills in growing individuals in their careers and developing teams.

Ways to stand out from the crowd:

  • Curiosity and drive to tackle problems with a diverse range of abilities in various programming languages.

  • Strong track record of crafting well-designed solutions and delivering high-quality software on time.

  • Previous work on accelerating software across inference stack.

  • Hands on experience on NVIDIA accelerated libraries, tools and GPU technologies.

We are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and talented people in the world working for us. If you're creative and autonomous with a real passion for technology we want to hear from you.

#LI-Hybrid

The base salary range is 308,000 USD - 471,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • Salaries for the engineering jobs on our site range from $100K-$200K. On average, senior engineer positions on our EchoJobs are about $160K.
  • The EchoJobs positions have been sourced and vetted from the top companies to work for in the US as a software engineer, including LinkedIn and other reputable job sites. We also have syndicated jobs from companies that have just raised funding, as well as those that have great unique products and culture. From all of these sources, our founder, Morgan, has also resourced the company's authenticity in terms of their website, public appearance, and more.
  • Yes, our users asked us for just this, so now our search filters allow you to search for your top jobs via location, as well as by onsite, remote, or both. Approximately 30% of our jobs are remote, so you’ve got the best options for you!
  • We have not yet implemented this option, but are considering doing so in the future. For the moment, you would need to cancel your subscription, and resubscribe when you wanted to come back.
  • We add new jobs to EchoJobs every day! We scan our sources for the newest jobs, verify them, and post them to EchoJobs within minutes. We add about 2,000-3,000 new jobs for you each day!
  • From starting your job search to getting hired, the entire job search process can take us software engineers anywhere between 3-6 months. However, at EchoJobs, we’re striving to shorten this duration by finding the best, newest jobs for you, so you can do less job searching, and more applying.
  • We’d recommend checking EchoJobs daily, as we add new jobs to the site each day. Additionally, if you got a chance to read our previous email on “what makes EchoJobs different from any other job search tools,” we also recommended that you set a job alert based on your job filters, so if you get emails on those new jobs, you could be checking more than once per day.
  • If you decide to continue with us after the 1-month trial, we definitely recommend this, as we all know it usually takes 3-6 months to find a quality job as a software engineer these days. So to best support you, we just adjusted our membership options at EchoJobs to monthly, 3 months, or 12 months (this option is more for passive job seekers looking a little bit for the future if they want to come back to work or make a job switch potentially. This lets you see what’s out there in case an even better fit job becomes available.)
  • EchoJobs is truly the only job site of its kind. We want to be THE spot for you to find the best job for you, and haven’t encountered any other company doing this. Other job sites are in niches besides software engineering or focus on a small portion of engineering jobs (like a specific coding language). In the words of Morgan, our founder, “I think what makes EchoJobs different is the amount of jobs, frequency that we add new jobs (we add 2,000-3,000 new jobs daily!), and the powerful search engines to find exactly the job you want more easily and efficiently. We can provide you with the most jobs that are vetted by us, we’ll continually find more new jobs for you, and we make it easier for you to apply and get hired.

What Fellow Engineers Say