Mercor is seeking a Bilingual Portuguese STEM Expert who is native to Brazil or Portugal, with experience in biology/physics/chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.
Your expertise in biology/physics/chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate Portuguese/English prompts and responses, ensuring scientific precision while maintaining clear, natural Portuguese phrasing consistent with academic conventions in Brazil or Portugal, and alignment with English where needed.
Create detailed prompts in Portuguese and/or English with multiple constraints and scientifically accurate instructions.
Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in Portuguese—linguistic clarity, regionally appropriate terminology (Brazil or Portugal usage), and academic tone.
Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare Portuguese and English responses where needed.
Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across Portuguese-language benchmarks prior to integration into official evaluation sets.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Share the referral link below, and earn up to $170 for each successful referral through this unique link. There's no limit on how many people you can refer. Restrictions may apply.
Tagged as: Chemistry, Computer Science, Data Science, Earth Science, Engineering, Environmental Science, Life Sciences, Mathematics, Physics
Senior Principal Scientist, Spatial Omics At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers...
ApplyBiologics Drug Discovery Scientist This position will support our company's biologics drug discovery and development efforts in the Drug Metabolism...
ApplyResearch/Lab Technician Our two neighboring labs in the Biology Department are seeking a Research/Lab Technician to support our work studying...
ApplyAssistant/Associate/Full Specialist in Brain Imaging and Network Neuroscience We are seeking a brain imaging researcher and data analyst to join...
ApplyResearch Technician Join an exciting translational research group with a mission to improve the lives of patients with cancer and...
ApplyPrincipal Scientist, Biotherapeutics Discovery Biotherapeutics and Genetic Medicine (BGM) at AbbVie is seeking a highly motivated Principal Scientist to join...
ApplyPlease visit work.mercor.com.
Don't forget to mention that you found the position on jobRxiv!
