Real job — pulled straight from Tenstorrent’s careers page · Verified July 16, 2026 · No reposts.
Job description
Tenstorrent is hiring a Server Inference Engineer — a full-time, based in Belgrade, Serbia role. Apply directly on Tenstorrent's careers page below.
Sr Engineer, Server Inference
Location: Belgrade, Serbia
Department: Product Software Engineering
Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.
Join our Inference Server Technologies team, where we develop software that powers state-of-the-art AI inferencing on Tenstorrent’s cutting-edge hardware. Our team builds the layer that works on top of the Tenstorrent ML libraries - designing APIs, deploying workloads, and benchmarking end-to-end inference speed. You’ll help us shape how developers consume and scale model execution on Tenstorrent’s stack.
This role is hybrid based in Belgrade, Serbia.
We welcome candidates at various experience levels. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting.
Who You Are
- An engineer who enjoys designing modern APIs and improving how ML models are deployed in production.
- Curious about performance gains through techniques like batching, caching, and model parallelism.
- Passionate about clean software architecture and effective abstraction layers.
- Motivated to deliver backend systems that developers trust and rely on.
What We Need
- Backend engineers who enjoy solving performance bottlenecks and scaling infrastructure.
- Experience with web technologies, protocols, and system design.
- Familiarity with Python, Docker, and Linux-based environments.
- Strong coding practices and a clear ability to break down complex problems into high-quality, maintainable code.
What You Will Learn
- How to optimize end-to-end ML inference on custom silicon.
- Strategies for building scalable, reliable software interfaces for real-world AI applications.
- How to shape the experience developers have when using Tenstorrent’s hardware for AI workloads.
Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.
This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology. Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2). These requirements apply to persons located in the U.S. and all countries outside the U.S. As the position offered will have direct and/or indirect access to information, systems, or technologies subject to these laws, the offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency. If employment is not possible due to U.S. export laws, any offer of employment will be rescinded.
Get Server Inference Engineer jobs like this→
New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.
Email me new jobsSimilar jobs
Frequently asked questions
What skills are required for Server Inference Engineer at Tenstorrent?
The required skills for Server Inference Engineer at Tenstorrent include: Python, Docker, Linux, API, Backend, Machine Learning.
What is the seniority level for Server Inference Engineer at Tenstorrent?
Server Inference Engineer at Tenstorrent is a Mid Level / Senior / Staff / Principal level position.
How do I apply for Server Inference Engineer at Tenstorrent?
You can view the full description and apply for Server Inference Engineer at Tenstorrent on EchoJobs: https://echojobs.io/job/tenstorrent-sr-engineer-server-inference-nyvk7.