Qa Jobs in Modesto, CA

Mercor is seeking a **Bilingual German STEM Expert who is native to Switzerland (German-speaking), Germany, or Austria**, with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models. Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate German/English prompts and responses, ensuring scientific precision while maintaining clear, natural German phrasing consistent with academic conventions in Switzerland (German-speaking), Germany, or Austria, and alignment with English where needed. * * * ## **Job Details** ### **Design and Optimize STEM-Based Prompts (Bilingual)** Create detailed prompts in German and/or English with multiple constraints and scientifically accurate instructions. ### **Define and Document Evaluation Standards** Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in German—linguistic clarity, regionally appropriate terminology (Switzerland \[German-speaking\], Germany, or Austria usage), and academic tone. ### **Conduct Model Testing and Grading (Bilingual)** Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare German and English responses where needed. ### **Support Benchmarking and Quality Assurance** Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across German-language benchmarks prior to integration into official evaluation sets. * * * ## **Minimum Qualifications** - Native-level fluency in German (written), specifically native to Switzerland (German-speaking), Germany, or Austria - Strong reading and writing proficiency in English - BS or BA in Biology / Physics / Chemistry - Familiarity with undergraduate-level biology / physics / chemistry topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines * * * ## **Preferred Qualifications** - 2+ years of experience in teaching, research, or an applied STEM discipline field - Experience working with German-language STEM curricula or academic standards in Switzerland, Germany, or Austria * * * ## **Application & Onboarding Process** - Complete a short AI-led interview (approximately 15 minutes) - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## **More Details About This Role** - Expected commitment: Minimum 20 hours per week - Expected duration: Approximately 3–6 months - Work environment: Structured project environment with clear goals and tools