$50-$60 per hour
Hourly contract
Remote
Posted by Mercor
Mercor is looking for a STEM Expert with experience in biology / physics / chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology / physics / chemistry will ensure the accuracy, rigor, and instructional quality of these test items.
Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubric.
Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.
BS or BA in Biology / Physics / Chemistry
Familiarity with undergraduate-level biology / physics / chemistry topics
Strong writing and critical thinking skills.
Ability to work independently and meet deadlines.
2+ years of experience in teaching, research, or applied STEM discipline field.
Complete an AI-led interview, this should take around 15 minutes.
Complete a 45-minute written assessment that will guide you through writing rubrics.
If selected, you will be invited to work on the project.
This is a remote and asynchronous role — work on your own schedule.
Expect to contribute at least 20 hours per week.
Expect a commitment of around 1 month.
You'll be working in a structured project environment with clear goals and tools.
Our team is based in San Francisco, CA
We specialize in recruiting experts for top AI labs
Our investors include Benchmark, General Catalyst, Adam D'Angelo, Larry Summers, and Jack Dorsey
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Tagged as: Chemistry, Computer Science, Data Science, Earth Science, Engineering, Environmental Science, Life Sciences, Mathematics, Physics
Job Title The Analytical Research & Development team is seeking a talented, highly motivated candidate with experience in small molecule...
ApplyPost-Doctoral Scientist At Lilly, we unite caring with discovery to make life better for people around the world. We are...
ApplySenior Scientist, Cell & Gene Therapy API Our expertise in Innovative Medicine is informed and inspired by patients, whose insights...
ApplyBeOne Medicines Ltd. Job Opportunity BeOne Medicines Ltd. has proposed to change its name to BeOne Medicines Ltd. The new...
ApplyDirector (Principal Scientist) Oncology The Director (Principal Scientist) has primary responsibility for the planning and directing of clinical research activities...
ApplySr. Scientist Or Engineer Today, Lonza is one of the world's largest healthcare manufacturing organizations operating across five continents. While...
ApplyPlease visit work.mercor.com.
Don't forget to mention that you found the position on jobRxiv!