Responsibilities:
- Improve and optimize critical LLM inference pipelines to generate high-quality deal assessments while maintaining cost efficiency.
- Develop and implement new AI features, such as integrating external data sources (e.g., company news) into deal risk assessments.
- Enhance monitoring systems to improve pipeline visibility, accelerate debugging, and reduce failure resolution time by 50%.
- Scale inference pipelines effectively to handle increased volumes, targeting 5 million AI-generated insights monthly.
- Write clean, maintainable, and well-documented code, following engineering best practices.
- Build tooling to enable customer support teams to independently resolve common issues.
- Demonstrate behaviors consistent with our Engineering Leveling Guidelines.
Requirements:
- 3+ years professional experience developing distributed systems in a cloud environment (AWS preferred).
- Strong experience analyzing large structured and unstructured datasets.
- Proficiency with Spark or equivalent big data processing engines (Hive, Hadoop, MapReduce, Storm, Samza).Experience using Large Language Models (LLMs), familiarity with prompting techniques (chain-of-thought, RAG), and knowledge of common market models.
- Understanding of LLM limitations and strategies to mitigate them.
- Proven problem-solving abilities, with practical and elegant coding solutions.
- Passionate about engineering excellence—advocates for high-quality, reliable, and maintainable software.
- Experience improving existing codebases, automation, and tooling for operational efficiency.
- Bachelor’s Degree in Computer Science, Computer Engineering, or closely related discipline.
- Familiarity with Elasticsearch and Kafka.
- Experience with fine-tuning or advanced inference techniques for LLMs.

0 applies
19 views
Other Jobs from People.ai
Staff Solution Engineer
Sr. Product Manager, AI Powered Account & Opportunity Execution - Toronto
Senior Software Engineer, Data Modeling
Senior Software Engineer, Applications
Similar Jobs
Software Engineer, Backend
Software Engineer, Backend
Software Engineer, Backend
Software Engineer II
Senior Data Engineer
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say