Kotak Mahindra Bank logo

AI Engineer, LLM & Enterprise AI Solutions

Kotak Mahindra Bank

Hybrid
Bengaluru, India
Full-time
Senior
6+ yrs
Salary not listedPosted 2w ago

Real job — pulled straight from Kotak Mahindra Bank’s careers page · Verified July 28, 2026 · No reposts.

Job description

Kotak Mahindra Bank is hiring a AI Engineer, LLM & Enterprise AI Solutions — a full-time, based in Bengaluru, India role. Apply directly on Kotak Mahindra Bank's careers page below.

Software Engineering II-SUPPORT SERVICES-Data & Analytics - In House Engineering

Location: Bangalore, Karnataka, India

Job Description: AI Engineer – LLM & Enterprise AI Solutions (6–8 Years)

Location

Bengaluru / Hybrid

Experience

6–8 years (with 3+ years in AI/ML and at least 1–2 years in GenAI/LLM-based solutions)

Role Overview

We are seeking an experienced AI Engineer to partner with Data Scientists and build production-grade AI solutions leveraging Large Language Models (LLMs) and enterprise knowledge bases. This role focuses on bridging research and engineering by converting models and prototypes into scalable, secure, and reliable applications following full SDLC practices.

Key Responsibilities
  • Collaborate closely with Data Scientists to operationalize ML/AI models into production systems
  • Design and develop LLM-powered applications such as copilots, chatbots, and knowledge assistants
  • Build Retrieval-Augmented Generation (RAG) pipelines using enterprise data
  • Integrate AI solutions with knowledge bases, document stores, and vector databases
  • Develop end-to-end pipelines for ingestion, embedding, retrieval, and inference
  • Ensure adherence to SDLC processes including testing, deployment, and monitoring
  • Deploy solutions on cloud platforms with focus on scalability and reliability
  • Implement MLOps practices including CI/CD, monitoring, and retraining
  • Ensure security, governance, and responsible AI practices
Required Skills
  • Hands-on experience with LLMs (OpenAI, Azure OpenAI, Hugging Face)
  • Strong understanding of RAG, embeddings, prompt engineering
  • Proficiency in Python / Java and API development
  • Experience with Java Spring boot / FastAPI/ Flask and microservices
  • Knowledge of vector databases like FAISS or Pinecone
  • Experience in SQL, big data technologies (Spark, Redshift), complex data processing, and data modeling.
  • Cloud deployment experience (Azure/AWS/GCP)
  • Familiarity with Docker, Kubernetes, CI/CD
Preferred Qualifications
  • Experience in enterprise environments
  • Knowledge of LangChain, LlamaIndex, Semantic Kernel
  • Understanding of model monitoring and observability
  • Awareness of security, compliance, and data privacy
Education

Bachelor’s or Master’s in Computer Science, Data Science, AI, or related field

Get Machine Learning Engineer jobs like this

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
Devoteam logo

Senior Data Engineer

Lyon, FR
✓ From careers page· 31m ago
INTECH Process Automation logo

Principal Full Stack Engineer

Lahore, PK
✓ From careers page· 31m ago
Devoteam logo

Senior Data Engineer

Lyon, FR
✓ From careers page· 31m ago
Devoteam logo

Senior Data Scientist, Generative AI

Lyon, FR
✓ From careers page· 31m ago

Frequently asked questions

What skills are required for AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank?

The required skills for AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank include: Python, Java, Spring Boot, FastAPI, Flask, Microservices, SQL, Spark, Redshift, Azure, AWS, GCP, Docker, Kubernetes, CI/CD, LLM, RAG, LangChain, MLOps.

What is the seniority level for AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank?

AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank is a Senior level position.

How do I apply for AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank?

You can view the full description and apply for AI Engineer, LLM & Enterprise AI Solutions at Kotak Mahindra Bank on EchoJobs: https://echojobs.io/job/kotak-mahindra-bank-software-engineering-ii-support-services-data-analytics-in-house-engineering-o13dp.