$18-$53 per hour
Hourly contract
Remote
Posted by Mercor
Location Requirements: ESP, CHL, USA, MEX
Mercor is seeking a Bilingual Spanish STEM Expert who is native to the United States (Spanish-speaking), Spain, Chile, or Mexico, with experience in biology/physics/chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.
Your expertise in biology/physics/chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate Spanish/English prompts and responses, ensuring scientific precision while maintaining clear, natural Spanish phrasing consistent with academic conventions in the United States (Spanish-speaking), Spain, Chile, or Mexico, and alignment with English where needed.
Create detailed prompts in Spanish and/or English with multiple constraints and scientifically accurate instructions.
Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in Spanish—linguistic clarity, regionally appropriate terminology (United States [Spanish-speaking], Spain, Chile, or Mexico usage), and academic tone.
Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare Spanish and English responses where needed.
Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across Spanish-language benchmarks prior to integration into official evaluation sets.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Share the referral link below, and earn up to $220 for each successful referral through this unique link. There's no limit on how many people you can refer. Restrictions may apply.
Learn more
Don't know who to refer? Find relevant LinkedIn connections here
Tagged as: Chemistry, Computer Science, Data Science, Earth Science, Engineering, Environmental Science, Life Sciences, Mathematics, Physics
Associate Director, Data Strategy & Partnerships In BARDS (Biostatistics and Research Decision Sciences), a distinguished department within our company's renowned...
ApplyPostdoctoral Fellowships in Personalized Medicine The laboratories of Dr. Jeff Milbrandt and Dr. Rob Mitra invite highly motivated candidates to...
ApplyJunior Specialist in the Bove Lab Department of Neurology University of California, San Francisco Job Description: The Bove lab at...
ApplyFeeney Lab – Junior, Assistant, Associate, or Full Specialist The Feeney Lab at UCSF (ZSFG campus) seeks a highly motivated...
ApplyPhysician Scientist Opportunity We are looking for an exceptional Physician Scientist to join our Cardiometabolic Therapeutic Area Genetics (TAG) team...
ApplyPrincipal Scientist I (Level 4) We are seeking a highly motivated, detail-oriented and experienced compound logistics expert and lab leader...
ApplyPlease visit work.mercor.com.
Don't forget to mention that you found the position on jobRxiv!
