Qa Jobs in Modesto, CA

Mercor is seeking a Bilingual Traditional Chinese STEM Expert who is native to Hong Kong or Taiwan , with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models.

Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate Traditional Chinese / English prompts and responses, ensuring scientific precision while maintaining clear, natural Traditional Chinese phrasing consistent with academic conventions in Hong Kong or Taiwan, and alignment with English where needed. * * * ## Job Details ### Design and Optimize STEM-Based Prompts (Bilingual) Create detailed prompts in Traditional Chinese and / or English with multiple constraints and scientifically accurate instructions. ### Define and Document Evaluation Standards Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in Traditional Chinese—linguistic clarity, regionally appropriate terminology (Hong Kong or Taiwan usage), and academic tone. ### Conduct Model Testing and Grading (Bilingual) Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare Traditional Chinese and English responses where needed. ### Support Benchmarking and Quality Assurance Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across Traditional Chinese-language benchmarks prior to integration into official evaluation sets. * * * ## Minimum Qualifications - Native-level fluency in Traditional Chinese (written), specifically native to Hong Kong or Taiwan - Strong reading and writing proficiency in English - BS or BA in Biology / Physics / Chemistry - Familiarity with undergraduate-level biology / physics / chemistry topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines * * * ## Preferred Qualifications - 2+ years of experience in teaching, research, or an applied STEM discipline - Experience working with academic terminology specific to Hong Kong or Taiwan educational standards * * * ## Application & Onboarding Process - Complete a short AI-led interview (approximately 15 minutes) - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## More Details About This Role - Expected commitment : Minimum 20 hours per week - Project duration : Approximately 3 - 6 months - Work environment : Structured project setting with defined goals, tools, and review processes