AI Product Engineer
Team: R&D Engineering
Location: Austin, TX
Commitment: Full-time
Workplace Type: hybrid
Salary:
Your final offer will consider your unique skills, experience, and location. In addition to base salary, total compensation may include performance bonuses, equity, and a comprehensive benefits package.
If you’d like more details about how compensation is determined or how benefits factor in, please get in touch. We’re committed to fair, transparent pay and want to make sure you have the information you need.
About the Role:
In this senior-level role, you will lead the architecture and evolution of AI-powered systems that transform probabilistic model outputs into reliable, production-grade product capabilities. You will design and ship systems around agents, retrieval pipelines, orchestration layers, and evaluation frameworks, while defining the architectural standards that ensure AI-driven features operate safely and at scale across our platform.
This is not a feature-delivery role — it is a systems-definition role. Your decisions will shape how AI capabilities are built, evaluated, and deployed across the organization.
About the Team:
Our AI Foundations team is building the foundation for how AI will power the next generation of products at Employ. This is a high-ownership, high-autonomy team responsible for turning rapidly evolving model capabilities into reliable, customer-facing systems.
What You'll Do:
-
Lead the architecture and delivery of end-to-end AI-powered systems, including agents, RAG pipelines, orchestration layers, and reasoning workflows.
-
Translate product vision into scalable technical systems.
-
Define contracts, state management strategies, and guardrails for AI-driven workflows.
-
Own and evolve API contracts that AI systems interact with, ensuring reliability, idempotency, authentication safety, and rate limiting.
-
Design schema enforcement and validation layers for AI-generated outputs.
-
Implement retries, fallback strategies, and failure-mode containment.
-
Establish evaluation frameworks for benchmarking, regression testing, and drift detection.
-
Create observability standards for AI systems, including structured logging, telemetry, tracing, and performance monitoring.
-
Productionize experimental AI capabilities into scalable, secure services.
-
Establish architectural patterns and standards adopted across teams.
-
Mentor engineers in AI-native and spec-driven development practices.
-
Influence engineering culture through clarity, urgency, and execution.
-
Decompose high-level business outcomes into executable technical systems.
Architect & Ship AI-Native Systems
Engineer Reliability at Scale
Set Direction & Elevate the Organization
What You Bring:
- 4+ years building AI-augmented product capabilities (LLMs, RAG systems, agents, orchestration frameworks).
- Event-Driven & Asynchronous Systems : Experience designing decoupled systems using queues such as Kafka, SQS, or BullMQ, and implementing asynchronous workflows that prevent blocking operations in user-facing systems.
- State Management Strategy : Experience persisting state across sessions, managing context windows efficiently, and handling concurrency and race conditions when multiple agents interact with shared data.
- Structured Data Enforcement : Experience enforcing structured outputs using schema validation tools such as Pydantic, Zod, or JSON Schema to ensure AI-generated outputs are reliable and machine-readable.
- API Design & Integration : Strong understanding of REST, GraphQL, or RPC interface design, along with authentication, rate limiting, and idempotent API patterns.
Tech Stack & Hard Skills:
Languages: Python, including asyncio, decorators, and the modern Python ecosystem. TypeScript / Node for integration and application-layer logic
AI Stack: Orchestration frameworks such as LangChain, LangGraph, or custom agent loops. Retrieval-Augmented Generation (RAG) systems. Hybrid search, re-ranking, and chunking strategies. Vector databases such as Pinecone, pgvector, or Weaviate
Database & Infrastructure: Advanced SQL skills including query optimization and indexing strategies. Containerization using Docker, Kubernetes or similar orchestration platforms. Experience running isolated environments for code execution
Why You’ll Love Working Here:
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
