Real job — pulled straight from Tarento’s careers page · Verified September 30, 2026 · No reposts.
Job description
Tarento is hiring a AI ML Ops Engineer — a full-time, based in Indore, India role. Apply directly on Tarento's careers page below.
AI ML Ops Engineer
Location: Bengaluru, India; Indore, India
Department: Digital
Experience: 3-5 Years
Skills: Linus, GCP, CICD, kubernetes, azure, monitoring tools, python, Docker, AWS
- Deploy and scale ASR, NMT and TTS models on GPU servers using Docker, Kubernetes and Triton Inference Server
- Build and maintain CI/CD pipelines that take models from training to production
- Monitor services for latency, throughput, errors and GPU utilization, and help debug production issues
- Help optimize inference performance for real-time use cases such as live transcription and voice agents
- Help manage GPU capacity across cloud and on-prem environments
- 2+ years of hands-on Docker and Kubernetes experience
- CI/CD tooling (GitHub Actions, GitLab CI or Jenkins)
- Strong Python for automation and tooling
- Experience on any cloud platform (AWS, Azure or GCP)
- Has deployed at least one ML model to production with any serving framework (Triton, TorchServe, FastAPI or similar)
- Comfortable with Linux and debugging services
- Triton Inference Server: model repositories and dynamic batching
- GPU infrastructure (NVIDIA drivers/CUDA, GPUs on Kubernetes)
- Prometheus and Grafana
- ONNX or TensorRT model conversion
- Serving speech or LLM models where latency matters
- gRPC or streaming services
- NVIDIA NVCF or NIM
- Helm or Terraform
Get AI ML Ops Engineer jobs like this→
New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.
Email me new jobsSimilar jobs
Frequently asked questions
What skills are required for AI ML Ops Engineer at Tarento?
The required skills for AI ML Ops Engineer at Tarento include: Docker, Kubernetes, CI/CD, Python, AWS, Azure, GCP, Linux, MLflow, Prometheus, Grafana, gRPC, Terraform, Helm, OpenTelemetry, Elasticsearch.
What is the seniority level for AI ML Ops Engineer at Tarento?
AI ML Ops Engineer at Tarento is a Mid Level / Senior level position.
How do I apply for AI ML Ops Engineer at Tarento?
You can view the full description and apply for AI ML Ops Engineer at Tarento on EchoJobs: https://echojobs.io/job/tarento-ai-ml-ops-engineer-2dc9f.