Software Development Engineer - AI / LLM Systems (Python Backend)
Location: India
Department: VP's_Client and Project Services Division
Workplace: remote
Employment Type: full
Description
Company: Volga Partners
Location: Fully Remote (Occasional office visits 1–2 times/year)
Compensation: ₹23–₹30 LPA (based on experience)
Job Type: Full-time
Start Date: Urgently hiring — must be available to start within 1–2 weeks
Work Hours: 8 AM – 5 PM IST or 9 AM – 6 PM IST
(Collaboration with USA Pacific Time teams)
About the Role
Volga Partners is looking for a skilled Software Development Engineer with strong expertise in Python backend systems and AI/LLM applications.
In this role, you will build and maintain production-grade AI-powered systems, integrating large language models into real-world workflows. You will work across backend services, orchestration layers, and data pipelines—ensuring that AI features are reliable, scalable, and performant.
This is a hands-on engineering role requiring strong problem-solving, system design, and the ability to operate in fast-evolving AI environments.
Key Responsibilities
- Build and maintain backend services and internal tools in Python for AI-powered applications.
- Integrate LLM APIs into production workflows, including prompt handling, response processing, validation, and retries.
- Design and implement scalable REST APIs, async workflows, and background job systems.
- Maintain and enhance components of a multi-language codebase (C#/C++, Python, web technologies) where applicable.
- Work with structured and unstructured data to prepare inputs, transform outputs, and support downstream systems.
- Develop systems for prompt management, model routing, response validation, and failure handling.
- Debug complex issues across backend logic, API integrations, and distributed services.
- Monitor system performance using telemetry tools and proactively identify and resolve bottlenecks.
- Automate recurring workflows related to data processing, evaluation, and reporting.
- Collaborate with cross-functional teams to turn ambiguous product ideas into production-ready features.
- Contribute to architecture decisions around scalability, performance, and safe use of AI systems.
- Write clean, testable, and maintainable code while helping establish engineering best practices for AI systems.
What You Bring
Education
- Bachelor’s degree in Computer Science or a related field.
Experience
- 3+ years of professional experience in backend or systems engineering.
- Strong experience in Python development for production systems.
- Experience integrating LLM APIs or AI-driven services into real applications.
- Proven ability to work within large codebases and collaborative environments.
Technical Skillset
Core Skills
- Python (strong), backend system design, API development
- Async workflows, job queues, and service orchestration
- Debugging across APIs, services, and data pipelines
Languages
- Python, C#, C/C++, JavaScript/TypeScript, SQL
Frameworks & Libraries
- .NET Web API, ASP.NET (MVC & WebForms), Entity Framework
- React, Bootstrap, Ajax
- Testing frameworks (xUnit or similar)
AI / LLM Systems
- Prompt design, response parsing, and guardrails
- Model integration patterns and failure handling
- Understanding of LLM limitations and production constraints
Tools & Platforms
- Azure DevOps, Git, Docker, Terraform
- SQL Server or similar databases
- Elastic Stack, Postman, Swagger
- AWS or Azure cloud environments
Architecture
- Microservices, distributed systems, modular architectures
Operating Systems
- Windows, Linux
Build Tools
- Make, Ninja (preferred)
Nice to Have
- Experience with RAG, embeddings, vector databases, or retrieval systems
- Familiarity with agent workflows or multi-step orchestration
- Experience with model monitoring, prompt versioning, or evaluation systems
- Understanding of AI safety, privacy, and secure data handling
- Exposure to cloud-native deployments and scalable infrastructure
Why Join Us
- Remote-first culture with minimal in-person requirements
- Work with global teams on cutting-edge AI systems
- Opportunity to build real-world LLM applications at scale
- High ownership, fast-moving environment with strong growth potential
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say