Qa Jobs in Modesto, CA

Mercor is seeking a Bilingual German STEM Expert who is native to Switzerland (German-speaking), Germany, or Austria , with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.

Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate German / English prompts and responses, ensuring scientific precision while maintaining clear, natural German phrasing consistent with academic conventions in Switzerland (German-speaking), Germany, or Austria, and alignment with English where needed. * * * ## Job Details ### Design and Optimize STEM-Based Prompts (Bilingual) Create detailed prompts in German and / or English with multiple constraints and scientifically accurate instructions. ### Define and Document Evaluation Standards Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in German—linguistic clarity, regionally appropriate terminology (Switzerland \[German-speaking\], Germany, or Austria usage), and academic tone. ### Conduct Model Testing and Grading (Bilingual) Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare German and English responses where needed. ### Support Benchmarking and Quality Assurance Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across German-language benchmarks prior to integration into official evaluation sets. * * * ## Minimum Qualifications - Native-level fluency in German (written), specifically native to Switzerland (German-speaking), Germany, or Austria - Strong reading and writing proficiency in English - BS or BA in Biology / Physics / Chemistry - Familiarity with undergraduate-level biology / physics / chemistry topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines * * * ## Preferred Qualifications - 2+ years of experience in teaching, research, or an applied STEM discipline field - Experience working with German-language STEM curricula or academic standards in Switzerland, Germany, or Austria * * * ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes) - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## More Details About This Role - Expected commitment : Minimum 20 hours per week - Expected duration : Approximately 3–6 months - Work environment : Structured project environment with clear goals and tools