Bilingual Italian STEM Expert Part-time

Bilingual Italian Stem Expert

Mercor is looking for a Bilingual Italian STEM Expert with experience in biology/physics/chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology/physics/chemistry will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate Italian/English prompts and responses, ensuring scientific precision while maintaining clear, natural Italian phrasing and alignment with English where needed.

Job details:

• Design and optimize STEM-based prompts (bilingual): Create detailed prompts in Italian and/or English with multiple constraints and scientific instructions.
• Define and document evaluation standards: Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in Italian—linguistic clarity and appropriate academic tone.
• Conduct model testing and grading (bilingual): Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing Italian vs. English where needed.
• Support benchmarking and quality assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across Italian-language benchmarks before integration into official benchmarks.

Minimum qualifications:

• Native-level fluency in Italian (written) with strong reading/writing ability in English
• BS or BA in Biology/Physics/Chemistry
• Familiarity with undergraduate-level biology/physics/chemistry topics
• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines

Preferred qualifications:

• 2+ years of experience in teaching, research, or an applied STEM discipline field

Application and onboarding process:

• Complete an AI-led interview (around 15 minutes)
• Complete a 45-minute written assessment that will guide you through writing rubrics
• If selected, you will be invited to work on the project

More details about this role:

• Expect to contribute at least 20 hours per week
• Expect a commitment of around 1 month
• You'll be working in a structured project environment with clear goals and tools

Contract and payment terms:

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note: We are unable to support H1-B or STEM OPT candidates at this time.

About Mercor:

Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.