Home › Jobs › Careerflow.ai

Legal Domain Expert – AI Evaluator & SME (Freelance)

Careerflow.ai · Remote (US) · Posted November 20, 2026 (today)

Apply on Careerflow.ai’s siteFill the application with AutoFillSee your fit for this role

Job description

About the Role We’re seeking qualified legal professionals to support generative AI research initiatives. As a Legal Domain Expert, you’ll use your legal research and analytical experience to evaluate and improve next-generation legal AI systems. You’ll verify legal citations, create realistic legal scenarios and evaluation rubrics, and assess AI-generated responses for accuracy, hallucinations, and procedural errors. This freelance role is suited to a detail-oriented legal professional with strong research skills and an interest in AI evaluation. What You’ll Do Verify primary and secondary legal citations, identifying fabricated case law, misquoted statutes, and invalid references.

Draft realistic, multi-step legal scenarios grounded in source materials such as statutes, regulations, court opinions, contracts, and pleadings.

Create objective evaluation rubrics and high-quality reference answers that follow Bluebook or applicable local citation standards.

Analyze AI outputs and workflows for issues such as jurisdictional overreach, confusion between primary and secondary authority, and errors in document synthesis or deadline calculations.

Complete onboarding and calibration activities, conduct quality checks, and incorporate peer reviewer feedback.

What We’re Looking For A Juris Doctor (JD), Master of Laws (LLM), or bachelor’s degree in legal studies.

3–5 years of postgraduate experience in legal research, paralegal work, litigation support, or law firm practice.

An active bar license.

Strong legal research and citation verification skills, including familiarity with tools such as Westlaw, LexisNexis, or Casetext and standards such as The Bluebook.

An interest in or experience with generative AI evaluation, prompt testing, RLHF, data annotation, or reference-answer development.

Preferred Areas of Expertise Experience or interest in one or more of the following U.S. legal practice areas: Corporate law

Securities law

Labor and employment law

Commercial litigation

Engagement Details Engagement type: Freelance

Location: United States (remote)

Work Arrangement: Remote

Payment : $100-$120 Per hour - 35 hours per week

Posting 24c1b7d0-17f6-4bd7-9006-2d3798cf5e37 on dover. Source: the employer’s listing. Valid through January 4, 2027 unless closed earlier.