English Linguistic Expert - Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: English Language and Literature Expert
Type:Contract
Compensation:$50/hour
Location:Remote

Role Responsibilities

• Evaluate the quality and accuracy of LLM-generated English text across various use cases such as summarization, dialogue, grammar correction, rewriting, and reasoning.
• Edit, refine, or rewrite English content to meet high linguistic, stylistic, and cultural standards.
• Annotate English text for grammatical, syntactic, semantic, and stylistic features to enhance model understanding.
• Identify model errors, inconsistencies, and language gaps, providing feedback to improve LLM performance.
• Provide detailed linguistic feedback and analysis to guide ongoing model training efforts.

Qualifications

Must-Have

• Native or near-native fluency in English, with an excellent command of grammar, syntax, vocabulary, and stylistics.
• Professional experience in editing, proofreading, writing, linguistic annotation, language evaluation, or NLP data work in English.
• Strong understanding of linguistic nuances, regional variations, tone, and context-appropriate English usage.
• Excellent ability to identify subtle grammatical errors, awkward phrasing, ambiguity, and unnatural language.
• Strong attention to detail, analytical judgment, and written communication skills.
• Ability to work independently in a distributed, remote environment.

Preferred

• Interest in AI and LLM-driven language technologies.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.