Description
We are hiring for a Machine Learning Engineer / Research Scientist – Evals to join our AI team. As an early member of our Answer Quality group, you will play a pivotal role in developing and refining the evaluation methodologies that measure the quality, safety, and impact of our AI models. Your work will be central to ensuring that our search engine delivers high-quality answers that drive user engagement and reduce churn.
Responsibilities
- Design and Build Evaluation Systems, ensuring our evaluation metrics are reliable, scalable, and actionable. Design, implement, and analyze experiments (such as A/B tests) to validate hypotheses regarding answer quality.
- Integration with Product and Data Teams: Collaborate closely with our PM and AI teams to define common evaluation standards and integrate eval results into our product feedback loop.
- Research and Innovation: Conduct research into state-of-the-art evaluation methods and contribute to the long-term vision for a centralized, scalable evaluation platform.
- Drive Answer Quality via Culture and Tooling: As Perplexity ships new products, build the tools and establish organizational norms to drive answer quality up for each of the new products (Deep Research, Pro Search, Vertical Search, Enterprise, etc.)
Qualifications
- Have 4+ years of experience as an ML Engineer or Research Scientist, with a strong background in designing and running experiments in a fast-growing technology environment
- Solid understanding of Bayesian statistics, and various tools and methodologies for evaluating uncertainty in a way that is specific to the given product being shipped
- Possess deep knowledge in machine learning, including evaluation methods, statistical testing, and algorithm development
- Proficiency in Python and have hands-on experience with ML frameworks (e.g., TensorFlow, PyTorch) and data processing tools
Bonuses:
- Prior experience in evaluating large language models (LLMs) or building evaluation systems for consumer search products
- Exposure to research methodologies in ranking, retrieval, or natural language processing
- Experience in a startup or early-stage company environment
The cash compensation range for this role is $200,000 - $280,000.
At Perplexity, we've experienced tremendous growth and adoption since publicly launching the world's first fully functional conversational answer engine in 2022. We've grown from answering 2.5 million questions per day at the start of 2024 to around 20 million daily queries in December 2024. We also offer Perplexity Enterprise Pro, which counts leading companies like Nvidia, the Cleveland Cavaliers, Bridgewater, and Zoom as customers.
To support our rapid expansion, we've raised significant funding from some of the most respected technology investors. Our investor base includes IVP, NEA, Jeff Bezos, NVIDIA, Databricks, Bessemer Venture Partners, Elad Gil, Nat Friedman, Daniel Gross, Naval Ravikant, Tobi Lutke, and many other visionary individuals. In 2024, our employee base grew nearly 300%, and we're just getting started.Final offer amounts are determined by multiple factors, including, experience and expertise, and may vary from the amounts listed above.
Equity: In addition to the base salary, equity is part of the total compensation package.
Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.
Perplexity
Artificial Intelligence (AI)
Cloud Computing
CRM
SaaS
Sales Enablement
Software
Artificial Intelligence (AI)
Cloud Computing
CRM
SaaS
Sales Enablement
Software
Information Technology
Internet
Artificial Intelligence (AI)
Chatbot
Generative AI
Machine Learning
Natural Language Processing
Search Engine
0 applies
8 views
Other Jobs from Perplexity
Frontend Software Engineer - Enterprise
San Francisco, CA
Browser QA Engineer - Serbia
Belgrade, Serbia
Browser JavaScript Software Engineer - Serbia
Belgrade, Serbia
Backend Software Engineer - Enterprise
San Francisco, CA
Backend Software Engineer - Billing
San Francisco, CA
Similar Jobs
Staff Machine Learning Engineer ( Agents / Agentic AI )
Remote
Santa Clara, CA
Senior Machine Learning Modelling Engineer
Shanghai, China
Senior Software Engineer, Risk
Sao Paulo, Brazil
Machine Learning Model Engineer
Mountain View, CA
US
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
