Senior Software Engineer, Data Science--LLM MLOps Platform

NVIDIA has continuously reinvented itself over two decades. Our invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing. NVIDIA is a “learning machine” that constantly evolves by adapting to new challenges that are hard to address, that only we can pursue, and that matter to the world. This is our life’s work, to amplify human creativity and intelligence. Make the choice to join us today! NVIDIA is seeking a highly skilled and experienced Senior Software Engineer to join our growing team. You will work at the intersection of AI and software engineering, responsible for the design, development, and maintenance of the LLM MLOps platform at Nvidia.

What you'll be doing:

• Collaborate across high-performance software engineering teams to develop innovative ML solutions using NVIDIA Deep Learning Software and GPU stack.

• Build high performance data pipelines of Big Data solutions in real time for inferencing, training and ETL.

• Utilizing Data Engineering, ETL, machine learning technologies for training, inferencing and deployment of ML models into production applications.

• Showcase leadership and lead the product development roadmap to align with business priorities and vision.

What we need to see:

• Masters in Computer Science, Electrical Engineering or equivalent experience

• 5+ years of experience architecting, crafting and implementing software solutions, preferably in product development space and 3+ years hands-on experience in distributed computing, data engineering and data analytics.

• Solid computer science fundamentals in algorithms/data structures/complexity analyses

• Software development experience in any of the following core languages/frameworks: Python, Java, GO, Spring/Hibernate.

• Excellent grasp of distributed systems and microservices.

• Experience using end-to-end MLOps platforms such as Kubeflow, MLFlow, AirFlow.

• Experience with extracting data from storage systems (e.g. Hive, Cassandra, S3, Swiftstack) and understanding of how big data processing systems (e.g. Spark or Map/Reduce) work and help scale the processes.

• Solid understanding of Amazon Web Services, Kubernetes, Docker is a plus

• Strong communication skills

Ways to stand out from the crowd:

• Experience using one or more of the Cloud Based solutions like Kendra, AWS SageMaker, Auto-ML, Big Query, RedShift, Glue, Athena, FireHose etc.

• Experience in building and handling MLOps pipelines.

• Ability to solve problems using machine learning techniques (statistics, clustering, classification, outlier analysis, etc.). Experience with Deep Learning and LLM prompt engineering or prompt tuning is a plus.

With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working with us and our engineering teams are growing fast in some of the hottest innovative fields: Deep Learning, Artificial Intelligence, and Large Language Models. If you're a creative engineer with a real passion for robust and enjoyable user experiences, we want to hear from you!

The base salary range is 148,000 USD - 276,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.