NVIDIA is hiring a Senior Systems Software Engineer for the ML Data Platform to join the TAO Toolkit Team. Our team builds frameworks, services, algorithms, and tools that power the largest NVIDIA Multi-Modal Foundation Models and their customization. We are seeking someone who can help develop novel, scalable, and automated pipelines to make sense of petabytes of unstructured data and collaborate with multiple deep-learning architects and engineers to enable the development of pioneering AI models.
What you’ll be doing:
Design, develop, and support a platform to access large datasets, integrating data from various sources.
Build scalable and robust ETL pipelines to deliver high-quality datasets.
Implement lake house structures and model data for optimized reporting to analyze the datasets.
Develop and maintain cloud services for data management and machine learning workflows in a production environment.
Help to find the right data for a Multi-Modal model with scalable query-retrieval systems.
Work with internal teams to define requirements, enhance products, and automate workflows.
What we need to see:
Bachelor's degree (or equivalent experience) in Computer Engineering, Computer Science, Electrical Engineering, Robotics, or related field
5+ years of ML / related software engineering experience with strong architecture and design skills.
Proficient in Python and familiar with knowledge of the latest tools.
Experience with SQL databases and cloud infrastructure (AWS, GCP, Kubernetes).
Experience in high-performance computing environments and workflow automation frameworks (e.g., Airflow).
Knowledge of PyTorch, distributed machine learning, and distributed file systems.
3+ years leading complex sometimes ambiguous projects, particularly in high-throughput services at supercomputing scale.
Proficient in running applications on cloud platforms using Kubernetes and Docker, and ML frameworks like Pytorch.
Ways to stand out from the crowd:
Familiar with GPU programming concepts, and writing custom CUDA kernels.
Experience with Dagster, Terraform.
Proficient in building systems and familiar with deep learning architectures and tools like Nvidia TensorRT-LLM, Multimodal-LLM, and Triton Server.
With a competitive salary package and benefits, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. Are you a creative and autonomous Senior Software Engineer, who loves challenges? Do you have a genuine passion for advancing the state of Data Science across a variety of industries? If so, we want to hear from you.
NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you are creative and autonomous, we want to hear from you!
The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.
Other Jobs from NVIDIA
DPU Firmware QA Engineer
Developer Advocate Engineer
Software Engineer, Infrastructure
System Software Engineer - USB (RDSS Intern)
Software QA Intern, Deep Learning - 2025
Software QA Engineer Intern - 2025
Similar Jobs
Senior Software Developer, ML Platform
Senior Solution Architect, HPC and AI - NVIS
Senior Data Scientist - AI/ML
Principal Data Scientist
Senior Software Engineer (Back-End)
Machine Learning Developer (MLOps)
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say