d-Matrix

Machine Learning Engineer, Staff - Model Factory

Santa Clara, CA
USD 155k - 250k
Machine Learning PyTorch TensorFlow AWS GCP Azure Python Docker Kubernetes
Description

At d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution.  Ready to come find your playground? Together, we can help shape the endless possibilities of AI. 

Location:

Hybrid, working onsite at our Santa Clara, Ca headquarters 3-5 days per week.

Job Title: Machine Learning Engineer - d-Matrix Model Factory

What You Will Do:

d-Matrix is a pioneering company specializing in data center AI inferencing solutions. Utilizing innovative in-memory computing techniques, d-Matrix develops cutting-edge hardware and software platforms designed to enhance the efficiency and scalability of generative AI applications.

The Model Factory team at d-Matrix is at the heart of cutting-edge AI and ML model development and deployment. We focus on building, optimizing, and deploying large-scale machine learning modelswith a deep emphasis on efficiency, automation, and scalability for the d-Matrix hardware. If you’re excited about working on state-of-the-art AI architecturesmodel deployment, and optimization, this is the perfect opportunity for you!

What You Will Bring:

  • Design, build, and optimize machine learning deployment pipelines for large-scale models.

  • Implement and enhance model inference frameworks.

  • Develop automated workflows for model development, experimentation, and deployment.

  • Collaborate with research, architecture, and engineering teams to improve model performance and efficiency.

  • Work with distributed computing frameworks (e.g., PyTorch/XLA, JAX, TensorFlow, Ray) to optimize model parallelism and deployment.

  • Implement scalable KV caching and memory-efficient inference techniques for transformer-based models.

  • Monitor and optimize infrastructure performance across different levels of custom hardware hierarchy - cards, servers, and racks, which are powered by the d-Matrix custom AI chips

  • Ensure best practices in ML model versioning, evaluation, and monitoring.

Required Qualifications:

  • Strong programming skills in Python and experience with ML frameworks like PyTorch, TensorFlow, or JAX.

  • Hands-on experience with model optimization, quantization, and inference acceleration.

  • Deep understanding of Transformer architectures, attention mechanisms, and distributed inference (Tensor Parallel, Pipeline Parallel, Sequence Parallel).

  • Knowledge of quantization (INT8, BF16, FP16) and memory-efficient inference techniques.

  • Solid grasp of software engineering best practices, including CI/CD, containerization (Docker, Kubernetes), and MLOps.

  • Strong problem-solving skills and ability to work in a fast-paced, iterative development environment.

Preferred Qualifications:

  • Experience working with cloud-based ML pipelines (AWS, GCP, or Azure).

  • Experience with LLM fine-tuning, LoRA, PEFT, and KV cache optimizations.

  • Contributions to open-source ML projects or research publications.

  • Experience with low-level optimizations using CUDA, Triton, or XLA.

Why Join Model Factory?

  • Work at the intersection of AI software and custom AI hardware, enabling cutting-edge model acceleration.

  • Collaborate with world-class engineers and researchers in a fast-moving AI-driven environment.

  • Freedom to experiment, innovate, and build scalable solutions.

  • Competitive compensation, benefits, and opportunities for career growth.

This role is ideal for a self-motivated engineer interested in applying advanced memory management techniques in the context of large-scale machine learning inference. If you’re passionate about implementing and optimizing machine learning models for custom Silicon, and are excited to explore cutting-edge solutions in model inference, we encourage you to apply.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.

d-Matrix
d-Matrix
Artificial Intelligence (AI) Cloud Infrastructure Data Center Semiconductor

0 applies

1 views

Similar Jobs

Principal Data Scientist

Remote Bengaluru, India

Senior Machine Learning Engineer - II

Bengaluru, India Noida, India

Senior Machine Learning Engineer

Remote Tallinn, Estonia

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say

Sid avatar
Sid
Very nice portal for searching jobs in this rough market.
Mar 6, 2025
Michael Duran avatar
Michael Duran
Software Engineer
I've been using this job search site for a while now, and it’s honestly one of the best out there! The clean and easy-to-navigate UI makes the whole job-hunting process so much smoother. Plus, the job postings are always up-to-date, so I never feel like I’m wasting time. The cherry on top is the owner—super kind and always quick to respond. Definitely recommend checking it out if you're on the job hunt!
Aug 21, 2024
Sai avatar
Sai
It’s really great website for finding jobs based on skills it’s really helpful give a go
Aug 21, 2024
Adinadh avatar
Adinadh
What I like most about Echo Jobs is how easy it is to use. The platform helps me quickly find jobs that match my skills and interests, thanks to its great recommendations and filters. Yes, I would definitely recommend Echo Jobs to a friend. It makes job searching simple and efficient, making it a great tool for anyone looking for a new job.
Jul 23, 2024
As a student navigating the job market, I've found LinkedIn increasingly frustrating due to numerous fake postings by consultancies. In contrast, this job posting website has been a game-changer for me. It offers genuine opportunities and a straightforward application process, making it much easier to find and apply for real jobs. Highly recommend it to fellow students seeking reliable job listings!
Jul 16, 2024
Cliff Gor avatar
Echo Jobs has been exceptional in my job hunt where it provides one platform to job hunt and I don't have to open 10 websites just to look for a job. It has also helped me focus much on the job skill and the location filtering out the onsite jobs and remote ones. The only feature that I would request is to display fully remote jobs that are not restricted to a country since the one available shows ie, Remote, US yet. But if it could show remote only, that would be helpful not only to me but to other people applying for full remote and not tied to only US candidates
Apr 22, 2024
I found EchoJobs in 2022, and I love it. It has a lot of remote jobs. It's exclusive to software and technology jobs (helpful for devs like me). What I like the most are its filters and its API. If you're a tech professional seeking remote work, I highly recommend giving it a try to EchoJobs.
Mar 4, 2024
Would definitely recommend it! Excellent product, dedicated founder, Jobs are easier to find. Congrats 🎉 to the entire team!
Mar 3, 2024
Brandon Banks avatar
Brandon Banks
Echo Jobs is really impressive. It provides a great user experience with an ability to quickly search through the many job postings. There is an impressive amount of jobs here and it is quickly updated. The details in the each job posting is helpful when determining if it is worth pursuing. I would highly recommend using Echo Jobs to find the next step in your career.
Mar 2, 2024
Tyler Young avatar
Tyler Young
tylerayoung.com
Best wishes with EchoJobs—it's become my favorite job board overnight!
Dec 16, 2023
Simply put, it's the most up to date tech jobs aggregator I’ve found. I'm like... "I don't have to check 10+ jobs boards daily just to see if there's a new job listing? sign me up!" The filters are also quite helpful! The UI is very clean and straightforward. Love it!
Oct 5, 2023