Description
Engineering Manager, AI
Location: San Francisco
Department: Engineering
Location Type: HYBRID
Employment Type: FULL_TIME
WHY WE’RE LOOKING FOR YOU
As Retool’s AI surface area grows, quality becomes the product. In this role, you’ll lead the team responsible for defining, measuring, and continuously improving quality across Retool’s Assist experience and related platform capabilities. Your mission is to build the systems, tools, and culture that help teams answer a deceptively hard question: “Is this actually good and how do we make it better?”
This work sits at the intersection of AI, product, and platform engineering. While some of the problems involve LLMs and AI evaluation, success in this role is less about prior specialization in AI research and more about strong instincts for building scalable quality systems—the kind that make correctness, relevance, and reliability measurable and repeatable as products evolve.
Prior experience with LLMs or AI evaluation tools is helpful, but not required. We’re excited about leaders who bring strong quality instincts and are eager to apply them to an emerging problem space. The systems you build will shape how our customers trust AI-powered software. You’ll influence not just what we ship, but how we ship: faster, more confidently, and with quality baked in from the start.
You’ll lead engineers working on:
- Evaluation & experimentation platforms that let teams compare performance across models, configurations, and releases
- Quality systems that define rubrics, metrics, and feedback loops for both AI and non-AI experiences
- Data curation & feedback pipelines grounded in real-world usage
- Search, retrieval, and relevance quality, ensuring results are accurate, fast, and trustworthy
- Reusable infrastructure that other teams can leverage to ship higher-quality features with confidence
- A culture of continuous improvement, where measurement, iteration, and learning are the default
IN THIS ROLE, YOU WILL
- Lead and grow a team of engineers, supporting their development through coaching, feedback, and clear expectations
- Partner closely with Product, Design, and other Engineering leaders to define quality goals aligned with business outcomes
- Translate ambiguous problem spaces into clear strategies, roadmaps, and execution plans
- Build scalable, repeatable processes that help teams ship faster without sacrificing quality
- Establish standards and tooling that enable rapid iteration with confidence
- Act as a multiplier across the organization by building platforms other teams rely on
- Partner with Recruiting to build a diverse, high-performing team of motivated engineers
THE SKILLSET YOU’LL BRING
- 3+ years of experience leading and managing engineering teams
- Experience designing or operating systems that measure quality, correctness, or performance at scale
- Strong technical curiosity. You enjoy engaging in architecture, reviewing designs, and getting hands-on when it matters
- A track record of leading teams through change and ambiguity
- The ability to set clear strategy while staying grounded in execution and impact
- A product-minded approach: you care deeply about customers, outcomes, and long-term maintainability
- Thoughtfulness around engineering culture, process, and team health
- Clear, structured communication and strong stakeholder management skills
- A collaborative mindset and comfort partnering across functions
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say