Description
Senior Product Analyst - AI Engineering
Location: Bangalore, India
Experience: 3-6 years
About Us:
Skit.ai is pioneering the new frontier of customer engagement. As a leading Conversational AI company, we are fundamentally transforming the collections industry with our suite of Generative AI-powered voice and message assistants. Our flagship Collection Orchestration Platform—the first of its kind—harmonizes communications across all channels, while our proprietary Large Collection Model (LCM) serves as the strategic brain, optimizing every interaction for unparalleled efficiency and customer experience.
Our trophy shelf, which includes the BIG AI Excellence Award 2024 and a Stevie Gold Winner for Most Innovative Company, reflects our commitment to innovation. But our true north is the tangible impact we deliver. We are a global team of pioneers headquartered in New York City, and we are looking for a visionary product leader to take ownership of our core intelligence engine from our Bangalore innovation hub.
Job Title: Senior Product Analyst - AI Engineering
Location: Bangalore, India (100% WFO)
Shift Hours: 1:00 PM - 10:00 PM IST
Key Responsibilities:
1. Center of Excellence (CoE) Leadership:
• Establish and maintain Skit.AI's AI Engineering CoE with documented best practices, prompt libraries, and quality frameworks
• Develop standardised prompt templates, ASR and TTS best practices, patterns for common use cases (debt collection, appointment setting, payment processing, etc.)
• Work on Voice Bot evaluation frameworks and testing protocols to measure effectiveness
• Build and maintain a knowledge repository of high-performing prompts across different LLM models and use cases
2. Cross-Client Analysis & Pattern Recognition:
• Analyse Voice Bot performance data across all active client deployments to identify trends, common failure patterns, and optimization opportunities
• Conduct root cause analysis on bot performance issues and trace them back to prompt design decisions
• Generate monthly insights reports highlighting prompt-related improvements and their business impact
• Identify opportunities for prompt reusability and standardization across similar client use cases
3. Continuous Improvement & Innovation:
• Monitor latest developments in LLM capabilities, prompt engineering techniques, ASR, TTS and conversational AI research
• Experiment with emerging prompting strategies (chain-of-thought, few-shot learning, retrieval-augmented generation, etc.)
• Pilot new prompt architectures and evaluate their effectiveness for collections/customer service scenarios
• Develop A/B testing frameworks for prompt variations and measure impact on KPIs (containment rate, NPS, compliance, etc.)
4. Technical Implementation:
• Design and optimize system prompts, user prompts, and guardrails for voice AI applications
• Collaborate with engineering teams to implement prompt versioning, testing, and deployment workflows
• Work with data teams to build feedback loops between prompt changes and performance metrics
• Ensure Voice Bots maintain compliance with FDCPA, CFPB, TCPA, and other regulatory requirements
5. Stakeholder Collaboration:
• Partner with Delivery/PM teams to understand client-specific requirements and constraints
• Train and mentor AI Engineers on best practices and emerging techniques
• Present Voice Bot performance insights to leadership and clients during QBRs
• Support pre-sales and solutioning teams with prompt strategy for new opportunities
Required Work Experience & Skills:
Essential:
• 3-6 years in product analysis, AI/ML product roles, or conversational AI development
• Hands-on experience with LLM prompting
• Strong analytical skills with proficiency in Python, or similar data analysis tools
• Experience designing and analyzing A/B tests or controlled experiments
• Deep understanding of NLP, conversational AI, and voice bot architectures
• Proven ability to identify patterns in large datasets and translate insights into actionable recommendations
Preferred:
• Prior experience in voice AI, chatbot development, or conversational design
• Strong educational background from Tier-1 institutions
• Knowledge of collections industry, financial services, or regulated customer communication
• Experience with prompt engineering frameworks and evaluation tools
• Publication or thought leadership in prompt engineering or conversational AI space
Technical Skills:
• Advanced prompt engineering across multiple LLM providers
• Data analysis and visualization (SQL, Python, Tableau/Looker)
• Understanding of RAG (Retrieval-Augmented Generation) architectures
• API integration and web-hook workflows for voice systems
• Git/version control for prompt management
Soft Skills:
• Exceptional written communication for crafting precise, effective prompts
• Systems thinking to understand how prompt changes impact overall bot performance
• Curiosity and continuous learning mindset in a rapidly evolving field
• Ability to balance innovation with production stability
• Strong documentation and knowledge-sharing practices
Other Qualifications:
• Must be comfortable working US business hours
• Self-starter who can establish Problem-Solve from the ground up
• Comfortable working in a fast-paced, ambiguous environment
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say