# Sr. Legal AI Prompter, Evaluator — Thomson Reuters

- Location: United States
- Posted: Nov 9, 2026
- Status: open (checked Nov 21, 2026)
- Apply (employer's site): https://thomsonreuters.wd5.myworkdayjobs.com/External_Career_Site/job/United-States-of-America-Eagan-Minnesota/Sr-Legal-AI-Prompter--Evaluator_JREQ205051
- Employer record: https://visajobs.io/company/thomson-reuters-holdings.md

## Sponsorship history
- Tier: Employer history only
- With this exact title: 0

## Description
Sr. Legal AI Prompter / Evaluator
Job Description
Sr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing and refining prompts, skills, and agent configurations; experimenting with large language models (LLMs), including Thomson, our proprietary LLM; and evaluating the results. They partner closely with specialized legal subject matter experts (SMEs), software engineers, and data scientists to make sure our products deliver accurate, legally sound outputs that legal professionals can trust. As senior members of the team, they take a leading role in the hands-on development of LLM-driven solutions, design and run experiments to find out what works, and help raise the team’s capabilities. The ideal candidate is an experienced, practiced lawyer with a passion for technology and a strong understanding of emerging technologies in the legal profession, who can think critically about AI risks and opportunities and translate legal expertise into practical, high-quality AI outputs.
Key Responsibilities
Create , test, and refine prompts, skills, and agent configurations for CoCounsel Legal to ensure accurate, legally sound, and contextually appropriate responses
Experiment with Thomson and other LLMs on legal tasks, comparing results to inform which model best fits each use case
Build gold-standard datasets with SMEs, coordinate evaluations, and design evaluation schemes, including rubrics, metrics, success criteria, and LLM-as-judge prompts, to test model outputs and inform launch readiness decisions
Write and run scripts, experiments, and automated tests that ensure quality and consistency over large datasets and time periods
Monitor production performance, analyze failure modes and identify where in the pipeline they originate (prompting, tooling, retrieval, or content), and provide strategic feedback to software engineers and data scientists
Collaborate with software engineers, data scientists, and cross-functional teams as they integrate LLMs into multi-step systems, and evaluate the feasibility and potential impact of new product ideas
Engage with legal professionals, industry leaders, and internal stakeholders to gather insights and validate product concepts, and stay informed about developments in legal technology and LLMs
Mentor colleagues and draft guidance materials, reusable prompts, and best-practice documentation on getting the most out of LLMs
Required Qualifications
Juris Doctor degree or equivalent law degree and bar admission in a US or Canadian jurisdiction
5-7 years of combined experience, including at least 2-3 years of legal practice, with the remaining years in related work such as collaborating with software engineers, building or testing products, applying generative AI, or writing code
Proven expertise applying generative AI, including prompt engineering and evaluating model outputs, and an understanding of how LLMs work and where they fail
Proficiency working in a Python code base and using Git, including writing, modifying, and debugging Python scripts, calling LLMs through code (e.g., OpenAI, Anthropic, Gemini), and using coding agents to build and iterate on that work
Excellent communication and collaboration skills, with the ability to work effectively with legal SMEs and across functions
Preferred Qualifications
Have substantial experience working with and testing legal products and technology, including online legal research and practice tools
Have hands-on experience designing evaluations, such as rubrics, human grading frameworks, or LLM-as-judge prompts
Are familiar with agentic and RAG systems, including how retrieval, tool use, and prompting each affect output quality
Are a self-starter who is comfortable with ambiguity and learns new tools and models quickly
#LI-DS4
Replacement: This position is open due to an existing vacancy to support our evolving business needs.
What’s in it For You?
Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering a seamless experience that is digitally and physically connected.
Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
Making a Real-World Impact:  We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide truste

> History, not a promise: past H-1B filings do not mean an employer will sponsor you or a given role. Data: U.S. DOL OFLC LCA disclosure (FY2024–FY2026 for role counts, certified LCAs) and the USCIS H-1B Employer Data Hub. Not legal advice. Methodology: https://visajobs.io/methodology
