LLM Inference Engineer jobs

Sourced directly from company career pages. Updated hourly.

109 LLM Inference Engineer jobs

N

NVIDIA

New

Senior System Software Engineer, Agentic Inference

$224k–$431kRemote · US-eligible

✓ From careers page· 8h ago

N

NVIDIA

New

Engineering Manager, Deep Learning Inference

$184k–$357kRemote · US-eligible

✓ From careers page· 8h ago

H

Hewlett Packard Enterprise

Principal Software Engineer, Inference

$157k–$361kSpring, TX

✓ From careers page· 2d ago

M

Modular

Cloud Inference Engineer

$180k–$270kRemote · US, Canada

✓ From careers page· 2d ago

H

Harmonic

Research Engineer, Training & Inference

$200k–$450kPalo Alto, CA

✓ From careers page· 3d ago

R

Recogni

Senior Software Engineer, ML Inference & Numerics

Munich, Germany

✓ From careers page· 1w ago

C

Crusoe Energy

Senior Engineering Manager, AI Inference

$250k–$300kSan Francisco, CA

✓ From careers page· 1w ago

C

Crusoe Energy

Applied AI Inference Engineer

$250k–$300kSan Francisco, CA

✓ From careers page· 1w ago

C

Crusoe Energy

Staff Applied AI Inference Engineer

$215k–$260kSan Francisco, CA

✓ From careers page· 1w ago

P

Positron

Performance & Debug Software Engineer, AI Inference

$200k–$300kRemote · US-eligible

✓ From careers page· 1w ago

I

Intellipro

Machine Learning Engineer, Inference & Serving (Speech LLM)

$170k–$320kSan Francisco, CA

✓ From careers page· 1w ago

A

Amazon

Senior Software Development Engineer, Alexa LLM Inference, Capacity, & Efficiency

Bengaluru, Karnataka

✓ From careers page· 2w ago

A

Amazon

Machine Learning Engineer, SageMaker Inference

$168k–$227kBellevue, WA

✓ From careers page· 2w ago

C

Cohere

Forward Deployed Engineer, Inference

$240k–$415kUnited States

✓ From careers page· 2w ago

C

Cerebras Systems

Senior Software Engineer, ML API (AI Inference)

Toronto, CAN

✓ From careers page· 2w ago

C

Cerebras Systems

Staff Software Engineer, GPU Inference

Toronto, CAN

✓ From careers page· 2w ago

L

Lila Sciences

Associate Director/Director, Inference Engineering

$204k–$348kCambridge, MA

✓ From careers page· 2w ago

N

Nebius AI

Staff Machine Learning Engineer, LLM Inference Optimization

Amsterdam, Netherlands

✓ From careers page· 3w ago

K

KRAFTON

AI Inference Platform & Operations Engineer

Seoul, South Korea

✓ From careers page· 3w ago

A

Amazon

Machine Learning Engineer, AWS Inference Optimization

$165k–$224kSanta Clara, CA

✓ From careers page· 3w ago