STEM Generalist Evaluator Part-time

STEM Generalist Evaluator

$35–$60 per hour

Hourly contract

Remote

Posted by Mercor

Mercor is seeking PhD holders, doctoral candidates, and exceptional Master's graduates in biology, physics, chemistry, or related disciplines to join a high-impact AI research initiative in partnership with a leading AI lab. This role involves evaluating and enhancing large language models (LLMs) by applying deep subject-matter expertise in graduate-level science to rigorously benchmark model performance.

Key Responsibilities:

• Evaluate accuracy, scientific depth, and domain relevance of LLM-generated answers across the listed domains.
• Review outputs spanning advanced topics in molecular biology, genetics, classical mechanics, quantum physics, physical chemistry, computer science, engineering, and humanities.
• Identify factual inaccuracies, logical flaws, and reasoning gaps.
• Work independently and asynchronously using provided tools.

Requirements:

• PhD (or PhD candidate) in Biology, Physics, Chemistry, Engineering, Computer Science, Mathematics, or related STEM field.
• Strong familiarity with graduate-level science and research problem solving.
• Excellent written communication and attention to detail.
• Comfortable working independently and remotely.
• Basic Python knowledge preferred, not required.

Role Details:

• Part-time (20 hours/week).
• Remote and asynchronous.

Compensation:

• Contractor position via Mercor.
• $35–$60/hour based on expertise.
• Weekly payments via Stripe Connect.

About Mercor:

Mercor is a San Francisco-based company connecting top professionals with leading AI initiatives. Investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.