Prompt Engineer

Location: Bengaluru, India

Department: Product

Experience: 2-5 YOE

• You’ll own the end-to-end lifecycle of AI voice agents, designing and optimizing prompt flows that drive real customer conversations across multiple use cases.
• This role sits at the intersection of product, AI, and operations; where you’ll continuously refine agent behavior using data, evaluation frameworks, and real-world feedback. If you enjoy solving for clarity, control, and scale in AI systems, this is where you build and ship impact fast.

Key Responsibilities:

• Own and drive the end-to-end lifecycle of AI Voice Agents at ClickPost - from prompt design and flow creation to deployment, evaluation, and continuous optimization.
• Design, refine, and optimize prompt flows for multiple agent use cases (NDR, Order Confirmation, NPR, NPS, Inbound Support), ensuring clarity, brevity, tone alignment, and objective completion.
• Build and enforce behavioral guardrails for agents, including tone control, hallucination prevention, fallback handling, and edge-case management (e.g., emotional users, repetitive intents, interruptions).
• Define and implement a modular evaluation framework for AI agents across:
• Pre-call (prompt quality, edge-case readiness)
• Live-call (response accuracy, sentiment handling)
• Post-call (intent fulfilment, outcome tracking)
• Leverage “LLM as a Judge” frameworks and transcript analysis to automate evaluation and continuously improve agent performance.
• Analyze call logs, transcripts, and performance metrics to identify failure points (e.g., STT errors, drop-offs, misalignment) and drive prompt-level improvements.
• Own and maintain a centralized prompt library, documentation, and version-controlled playbooks for all agents.
• Develop new AI agent use cases and flows (e.g., NPR, NPS, inbound support), including prompt design for edge cases and real-world scenarios.
• Enable multilingual capabilities for agents (Tier 2/3 languages), including prompt localization, validation, and mid-call language switching.
• Collaborate closely with Product, Engineering, Data, and Operations teams to integrate prompt logic into production systems and improve overall system performance.
• Support client-specific customizations by adapting agent tone, behavior, and flows based on brand requirements (D2C, enterprise, luxury, etc.).
• Continuously explore and experiment with new LLM models, prompting techniques, and AI capabilities to improve agent quality and efficiency.
• Contribute to building organization-wide frameworks for designing, scaling, and monitoring AI agent products across use cases.

Skills & Qualifications:

• 2–5 years of experience in prompt engineering, AI product development, conversational AI, or related roles in a SaaS / tech environment.
• Strong understanding of LLMs, prompt design techniques, and context engineering for generating reliable and high-quality outputs.
• Experience working with AI tools, voice agents, chatbots, or automation workflows in real-world use cases.
• Strong analytical and problem-solving skills; ability to evaluate model outputs, identify gaps, and iteratively improve performance.
• Comfortable working with technical concepts like APIs, webhooks, logs, transcripts, and evaluation metrics (coding not mandatory but preferred).
• Strong written and verbal communication skills with high attention to detail and clarity.
• Ability to work in a fast-paced, ambiguous environment with high ownership and end-to-end responsibility.

Nice to Have:

• Experience working on voice-based AI agents or conversational AI systems.
• Familiarity with evaluation frameworks, LLM-based grading (“LLM as a judge”), or automated testing systems.
• Exposure to multilingual AI systems or regional language adaptation.
• Experience in building AI-driven workflows, automation tools, or internal productivity systems.
• Prior experience in logistics, e-commerce, or customer experience domains.

What You’ll Learn:

• How to build and scale production-grade AI voice agents across multiple real-world use cases.
• How to design robust prompt systems with guardrails, evaluation layers, and continuous optimization loops.
• How to translate complex business workflows into AI-driven conversational experiences.
• How to build organization-wide frameworks for AI product development, evaluation, and monitoring.
• How to work closely with enterprise clients and build highly personalized, high-impact AI solutions.

• Ownership and autonomy: You will have immense ownership and responsibility. You own and drive the execution.

• We value velocity in all things we do. You would be expected to move fast, experiment and be updated with the newest technologies
• We give a lot of ownership to our people. There is no micro-management, and you would be expected to own projects end to end
• We have seen people grow super-fast at ClickPost when they focus on the impact of the work, are detailed in their way of working and are willing to take risks
• Our team thrives on transparency.

• Health insurance
• Generous vacation policy
• Learning and development budget
• Team events and company offsite
• Company laptop and devices
• Maternity and paternity benefits