Applied AI Engineer - Agent
Department: Agents
Location: New York
Compensation: $250K – $300K • 0.3% – 0.6%
Employment Type: FullTime
We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent. You’ll own core backend systems and applied LLM work: advancing agent reliability and autonomy, building evaluation pipelines, and shipping techniques that measurably improve agent performance. This is a hands-on role with high ownership across research-to-production: prototyping, instrumenting, evaluating, and deploying improvements that show up directly in user outcomes.
What You’ll Do
Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction
Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes
Partner with product and infra to define success metrics and ship fast, safe iterations
Write clean, well-tested code; document design decisions and runbooks
What You’ll Bring
4+ years backend engineering experience, preferably Python (we care about impact over years)
Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you’ve shipped LLM features to production
Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management
Pragmatic experimentation: hypothesis → prototype → measured improvement → rollout
Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild
Nice To Have
Experience with agent frameworks, tool orchestration, and memory architectures
RAG systems in production (chunking, retrieval quality, freshness strategies)
Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs
Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization
Why Join Us
Mission: build autonomous agents that run entire businesses
Impact: ship core agent improvements that users feel immediately
Velocity: small, senior team; fast decision cycles; high ownership
Stack: modern tooling across AI orchestration, integrations, and memory systems
Compensation
Competitive salary and meaningful equity
Comprehensive benefits and flexible work setup
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
