Qa Jobs in Tyler, TX

Mercor is seeking a **Bilingual Italian STEM Expert who is native to Italy or Italian-speaking Switzerland**, with experience in biology / physics / chemistry theory and problem-solving, to develop and refine high-quality reasoning questions that evaluate AI models. Your expertise in biology / physics / chemistry will ensure the scientific accuracy, rigor, and instructional quality of these assessment items. You will create and evaluate Italian/English prompts and responses, ensuring scientific precision while maintaining clear, natural Italian phrasing consistent with academic conventions in Italy or Italian-speaking Switzerland, and alignment with English where needed. * * * ## **Job Details** ### **Design and Optimize STEM-Based Prompts (Bilingual)** Create detailed prompts in Italian and/or English with multiple constraints and scientifically accurate instructions. ### **Define and Document Evaluation Standards** Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when written in Italian—linguistic clarity, regionally appropriate terminology (Italy or Italian-speaking Switzerland usage), and academic tone. ### **Conduct Model Testing and Grading (Bilingual)** Run prompts through AI models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity. Compare Italian and English responses where needed. ### **Support Benchmarking and Quality Assurance** Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific standards. Maintain consistency and reliability across Italian-language benchmarks prior to integration into official evaluation sets. * * * ## **Minimum Qualifications** - Native-level fluency in Italian (written), specifically native to Italy or Italian-speaking Switzerland - Strong reading and writing proficiency in English - BS or BA in Biology / Physics / Chemistry - Familiarity with undergraduate-level biology / physics / chemistry topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines * * * ## **Preferred Qualifications** - 2+ years of experience in teaching, research, or an applied STEM discipline - Experience working with Italian or Swiss secondary/university STEM curricula * * * ## **Application & Onboarding Process** - Complete a short AI-led interview (approximately 15 minutes) - If approved, complete a paid assessment focused on writing and rubric creation - Then, if selected, you will be invited to work on the project. * * * ## **More Details About This Role** - Expected commitment: Minimum 20 hours per week - Project duration: Approximately 3 - 6 months - Work environment: Structured project setting with defined goals, tools, and review processes