LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

NVNmSy9CZ1BFQlRPQmg2SjFkK3dZbzdIcUE9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Interim HealthCare of Bellevue

HCA | CNA - Mandarin Chinese Speaking Caregiver (中文) Job at Interim HealthCare of Bellevue

 ...caregivers and clients. We invest in our staff, providing orientation and ongoing training.We are currently seeking a Cantonese-speaking caregiver to work in Seattle!Job details include, but are not limited to:* $20.00-$23.00/Hr* Flexible Schedules* Weekly... 

Alignerr

Population Health Informaticist Job at Alignerr

 ...insights will directly shape how AI understands population health trends, disparities, and interventions. This is a fully remote, flexible contract role work on your own schedule and contribute to some of the most meaningful AI work being done today. Organization:... 

SGS Consulting

Drug Safety Specialist - GPV Job at SGS Consulting

 ...global Data Assurance teams and other internal departments, as appropriate Skills: ~5+ years relevant experience within Pharmacovigilance ~ Knowledge and understanding of PV regulatory requirements and ICSR processing procedures globally and in Americas region... 

NBC Universal

Associate Social Media Video Producer, TODAY Digital Job at NBC Universal

The 4th Hour of TODAY is looking for a Associate Social Media Video Producer to lead digital content for Jenna Bush Hager and Sheinelle Jones across social, digital, and TODAY.com.This role is fully embedded with the show and talent, requiring someone who is confident ...

Perfect Search Media

Digital Marketing Intern Job at Perfect Search Media

What's This All About?Perfect Search offers a Remote Digital Marketing Internship program focused on learning pay-per-click advertising/search engine marketing (PPC/SEM), display/programmatic advertising, and social media advertising, as well as search engine optimization...