## Role Overview We are seeking expert physics researchers to author and verify golden reference solutions for the **CritPt benchmark (arXiv:2509.26574v3)** — a frontier research-level physics benchmark. Participants will solve CritPt research-level problems end-to-end, audit solutions from other experts, or adjudicate between parallel solution attempts, producing 100%-human-verified reference data used to evaluate large language models on frontier physics reasoning. ## Physics Subdomains Covered High Energy Physics & Mathematical Physics, Biophysics & Statistical Physics, Condensed Matter & AMO, Gravitation / Cosmology / Astrophysics, Quantum Information, Optical Properties of Materials, Magnetic Materials, Measurements in QM. ## Key Responsibilities - Solve research-level physics challenges end-to-end with verifiable derivations, code, and peer-reviewed references - Decompose challenges into standalone checkpoint sub-problems that require genuine physical reasoning - Author Python answer templates with auto-grading functions for symbolic or numerical answers - Audit submitted solutions for correctness, scope, and method soundness; deliver actionable feedback across iterations - Adjudicate between parallel solver attempts and decide which solution becomes the golden reference - Document chain-of-thought reasoning, error tolerances, equivalent symbolic forms, and verification test cases ## Ideal Qualifications - **Solver:** PhD or postdoc in the relevant subfield (senior PhD student minimum) - **Auditor:** Postdoc or junior professor in the relevant subfield (PhD minimum) - **Adjudicator:** Full professor or industry research PI in the relevant subfield (senior postdoc or junior professor minimum) - Hands-on familiarity with at least two canonical methods of the target subfield, demonstrable through publications (broader coverage strongly preferred) - 3–5 representative publications (arXiv ID or DOI), ideally within the last ~5 years and in the target subfield - Working proficiency with LaTeX, Python, Jupyter, and SymPy - Strong written English (B2/C1/C2 minimum; native or near-native preferred) ## More About the Opportunity - Expected commitment: ~10 hours/week, sustained across an 8–10 week window per task pool - Pay range: $80–$135 per hour, based on role and demonstrated expertise - Asynchronous work
Remote Research Physics Expert - AI Trainer ($80-$135 per hour) • Roseville, Michigan, US
AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
We are urgently looking for people interested in taking online surveys for Fortune 500 brands.If you are a self-starter, looking for flexible hours throughout the week, this may be for you! Earn up... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
About the JobSTATUS: Part TimeDIVISION: Graduate StudiesREPORTS TO: Dean of Graduate StudiesSUPERVISES: N/AFLSA STATUS: Non ExemptPosition Description:College for Creative Studies (CCS) invites app... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more
AI data lab for training frontier models and evaluating AI agents.Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more.AI... Show more
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
DoorDash is the #1 category leader in food delivery, food pickup, and convenience store delivery in the US, trusted by millions of customers every day.As a Dasher, you’ll stay busy with a var... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
Join our distributed team and help evaluate online platforms through interactive testing assignments.This is a flexible, remote opportunity with full training provided and no prior experience requi... Show more
