[job_card.job_description]Fluent Language Skills Required :EnglishWhy This Role ExistsMercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In financial contexts, even small errors or unclear reasoning can have significant downstream impact. This project focuses onevaluating and improving how conversational AI systems reason about, explain, and respond to finance-related queries. Your expertise helps ensure model outputs reflect real-world financial knowledge, sound quantitative reasoning, and clear professional communication.What You’ll DoWrite and refine promptsto guide model behavior in financial contexts -Evaluate LLM-generated responsesto finance-related user queries for accuracy, reasoning quality, and clarity -Conduct fact-checkingusing trusted public sources, financial references, and external tools -Annotate model responsesby identifying strengths, areas of improvement, and factual or conceptual inaccuracies -Assess tone, completeness, and appropriateness of responsesfor real-world financial use cases - Ensuremodel responses align with expected conversational behaviorand system guidelines -Apply consistent evaluation standardsby following clear taxonomies, benchmarks, and detailed evaluation guidelinesWho You AreYou havea minimum of 5 years of real-world professional experience in Finance, supported by anassociated Bachelor’s, Master’s, or PhD degree(e.g., Finance, Accounting, Economics, Business, or related fields) - You have experience inone or more of the following sub-domains: - Investment Banking - Corporate Finance - Accounting & Auditing - Asset Management - You havesignificant experience using large language models(LLMs) and understand how and why people use them - You haveexcellent writing skillsand can clearly explain complex financial concepts - You havestrong attention to detailand consistently notice subtle issues others may overlookNice-to-Have SpecialtiesPrior experience with RLHF, model evaluation, or data annotation work - Experience writing or editing high-quality financial written content - Experience translating complex financial ideas for non-expert audiences - Familiarity with evaluation rubrics, benchmarks, or quality scoring systemsWhat Success Looks LikeYou identify financial inaccuracies, faulty assumptions, and weak reasoning in model responses - Your feedback directly improves the accuracy and usefulness of finance-related AI outputs - You deliver clear, reproducible evaluation artifacts that customers can act on - Mercor customers trust their AI systems in financial contexts because you’ve rigorously evaluated themWhy Join MercorAt Mercor, you’ll apply your financial expertise to shape how advanced AI systems reason and communicate about complex financial topics. This role offers flexible, remote contract work and the opportunity to influence AI systems used in real-world financial decision-making. Compensation is competitive and aligned with expertise and scope.