Overview

Company
Mercor
Location
Remote
Employment type
CONTRACTOR
Mercor

AI & Data • Remote

In-House Counsel (Japan)

RemoteCONTRACTORPosted 3 months ago
Remote

About the Role

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Japanese law. We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.

What you'll do

  • Run the same set of prompts across two AI (LLM) platforms

  • Compare the outputs from both platforms side by side

  • Score each response against a standardized rubric we provide

  • Submit concise written feedback for every evaluation

Requirements

  • 5+ years as in-house legal counsel practising in Japan

  • Strong command of Japanese law, especially commercial and contract matters

  • Sharp attention to detail and precise written communication

  • Able to work independently to a rubric and to deadlines

Logistics

  • Initial commitment: ~10 hours, with strong potential for more

  • Confidentiality: all work is covered by NDA

What You'll Do

Mercor is partnering with a leading legal AI company to benchmark how well AI systems answer real questions of Japanese law .
We are hiring experienced in-house counsel to serve as expert reviewers — running the same prompts through two AI platforms, comparing the answers, and scoring them against a standardized rubric.
What you'll do Run the same set of prompts across two AI (LLM) platforms Compare the outputs from both platforms side by side Score each response against a standardized rubric we provide Submit concise written feedback for every evaluation Requirements 5+ years as in-house legal counsel practising in Japan Strong command of Japanese law, especially commercial and contract matters Sharp attention to detail and precise written communication Able to work independently to a rubric and to deadlines Logistics Initial commitment: ~10 hours, with strong potential for more Confidentiality: all work is covered by NDA