Lifted logo

LLM Model Response Evaluation

Lifted

Remote
Full-time
Mid Level
3+ yrs
Salary not listedPosted 3w ago

Real job — pulled straight from Lifted’s careers page · Verified August 9, 2026 · No reposts.

Job description

Lifted is hiring a LLM Model Response Evaluation — a full-time, remote role. Apply directly on Lifted's careers page below.

Copy of LLM Model Response Evaluation

Location: Ottawa, ON, ca, Remote

Company Description

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

 

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information

Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly

Get LLM Model Response Evaluation jobs like this

New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.

Email me new jobs
Goodwin logo

AI Developer

Boston, MA
✓ From careers page· 27m ago
Goodwin logo

Senior Data Engineer

$150k–$165kBoston, MA
✓ From careers page· 28m ago
M9 Solutions logo

Junior Federal AI Engineer

$100k–$115kFt. Belvoir, VA
✓ From careers page· 30m ago
M9 Solutions logo

Federal AI Engineer

$138k–$153kFt. Belvoir, VA
✓ From careers page· 30m ago

Frequently asked questions

Is LLM Model Response Evaluation at Lifted a remote job?

Yes, LLM Model Response Evaluation at Lifted is a remote position. Candidates in Ottawa, ON may be preferred.

What skills are required for LLM Model Response Evaluation at Lifted?

The required skills for LLM Model Response Evaluation at Lifted include: AI, Machine Learning, LLM, Generative AI.

What is the seniority level for LLM Model Response Evaluation at Lifted?

LLM Model Response Evaluation at Lifted is a Mid Level level position.

How do I apply for LLM Model Response Evaluation at Lifted?

You can view the full description and apply for LLM Model Response Evaluation at Lifted on EchoJobs: https://echojobs.io/job/lifted-copy-of-llm-model-response-evaluation-92eym.