Talent.com
Annotation QA Lead (Quality Lead)
Annotation QA Lead (Quality Lead)Levit8 Technologies • Chicago, Illinois, US
Annotation QA Lead (Quality Lead)

Annotation QA Lead (Quality Lead)

Levit8 Technologies • Chicago, Illinois, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

QA Lead owns annotation quality : define gold standards, run audits, measure IAA, lead remediation and training for annotator panels. Critical to maintain high dataset reliability.

Responsibilities

Core responsibilities

  • Design QA processes, gold datasets and adjudication workflows.
  • Monitor IAA, gold check pass rates and annotator drift.
  • Coach annotators and run calibration sessions.
  • Author / update annotation guidelines; work with clients on edge cases.

Qualifications

Skills & experience

  • Must : strong analytical skills, prior QC / annotation experience.
  • Preferable : familiarity with inter-rater stats and dataset QA tooling.
  • Nice-to-have : domain knowledge for specialized datasets.
  • [job_alerts.create_a_job]

    Quality Lead • Chicago, Illinois, US

    [internal_linking.related_jobs]
    Customer Support Quality Lead

    Customer Support Quality Lead

    VirtualVocations • Chicago, Illinois, United States
    [job_card.full_time]
    A company is looking for a Customer Support Quality Lead to enhance customer support interactions.Key Responsibilities Establish and improve a QA program for evaluating agent performance across s...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Ecosystem Acceleration Lead Cortex

    Ecosystem Acceleration Lead Cortex

    Palo Alto Networks • Chicago, Illinois, USA
    [job_card.full_time]
    The Palo Alto Networks Ecosystem team is a critical pillar of company growth and we are seeking an Ecosystem Acceleration Lead who thrives in fast-moving environments and operates as the architect ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    AI Adoption & Enablement Lead

    AI Adoption & Enablement Lead

    Arete Capital Partners • Chicago, IL, US
    [job_card.temporary]
    [filters_job_card.quick_apply]
    COMPANY OVERVIEW Areté Capital Partners is a boutique, special-situation advisory firm that provides independent fiduciary and stewardship services to companies experiencing significant growth...[show_more]
    [last_updated.last_updated_variable_days]
    Lead Solutions Architect

    Lead Solutions Architect

    CoSourcing Partners - Enterprise-AI and IT Services Company • Chicago, IL, US
    [job_card.full_time]
    Lead Forward Deployed Architect (Palantir & Intelligent Automation Focus).Citizen or Green Card Required).CoSourcing Partners' AI Staffing and Digital Talent Enablement practice is expanding, a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Sr. Director, FSQA

    Sr. Director, FSQA

    Tovala • Chicago, IL, US
    [job_card.full_time]
    We're Tovala, a food-tech company reinventing home cooking to save consumers time.Through an innovative combination of hardware, software, and fresh food delivery, we make it incredibly simple for ...[show_more]
    [last_updated.last_updated_30] • [promoted]
    Remote Content QA Reviewer

    Remote Content QA Reviewer

    Outlier • Chicago, IL, United States
    [filters.remote]
    [job_card.full_time]
    Earn up to $15 / hour + performance bonuses.Outlier, a platform owned and operated by Scale AI, is looking for.If you're passionate about improving models and excited by the future of AI, this is you...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Senior SDET / QA Lead (Chicago)

    Senior SDET / QA Lead (Chicago)

    DSM-H Consulting • Chicago, IL, United States
    [job_card.full_time]
    Note : Need local candidates only and interview will be onsite.Role and Overview of the role : .Looking for a candidate who has 8 to 10 years of experience. It's a Senior lead kind of a role who would ...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    SDLC Lead

    SDLC Lead

    Blue Ribbon Global Technologies • Chicago, Illinois, USA
    [job_card.full_time]
    Remote supporting EST and CST time zones.Contract 6 months with potential to extend.Client is looking to hire an SDLC Methodology Lead focused on defining implementing governing and improving th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Global Configuration Management Leader

    Global Configuration Management Leader

    GE HealthCare • Chicago, IL, US
    [job_card.full_time]
    Global Configuration Management Leader.The Global Configuration Management Leader (CML) is responsible for collecting, understanding, creating, and maintaining global & regional product offerings.T...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Advanced Analytics Manager - Non-Alc

    Advanced Analytics Manager - Non-Alc

    undefined • Chicago, IL, US
    [job_card.full_time]
    Cheers to creating an incredible tomorrow!.At Molson Coors, we tackle big challenges and defy the status quo.With a proud legacy of excellence, an incredible portfolio of beer, seltzers, spirits, a...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Quality Lead

    Quality Lead

    Ferrara Candy Co • Forest Park, IL, US
    [job_card.full_time]
    For more than 115 years, Ferrara has created sugar confections that enable moments of sweetness, celebration, and connection for candy lovers of all generations. Today, the company is the #1 sugar c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    QA Manager

    QA Manager

    HICX • Chicago, IL, US
    [job_card.full_time]
    SaaS solutions for digital supplier management.HICX helps Global 5000 companies to organize and manage their supplier data. The HICX Supplier Management platform enables businesses with thousands of...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    SDLC Lead

    SDLC Lead

    Expert Technology Services • Chicago, Illinois, USA
    [job_card.full_time]
    Remote supporting EST and CST time zones.Contract 6 months with potential to extend.Client is looking to hire an SDLC Methodology Lead focused on defining implementing governing and improving th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Enablement Lead

    Enablement Lead

    eTeam • Chicago, IL, US
    [job_card.full_time]
    Location : Hybrid Chicago, IL / Bay Area / NYC Duration : 6 Months.Client is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their c...[show_more]
    [last_updated.last_updated_30] • [promoted]
    QA Manager

    QA Manager

    NinjaHoldings • Chicago, IL, US
    [job_card.full_time]
    NinjaHoldings was founded in 2017 by a team seeking to revolutionize the way everyday Americans interact with financial services. Through our CreditNinja and NinjaCard brands, we empower people over...[show_more]
    [last_updated.last_updated_30] • [promoted]
    SDLC Lead

    SDLC Lead

    SOMERSET STAFFING • Chicago, Illinois, USA
    [job_card.full_time]
    Remote supporting EST and CST time zones.Contract 6 months with potential to extend.Client is looking to hire an SDLC Methodology Lead focused on defining implementing governing and improving th...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Director, QA R&D - PV Audits

    Director, QA R&D - PV Audits

    Ccrps • Chicago, IL, United States
    [job_card.full_time]
    AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable i...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]
    Director, Quality Assurance and Accountability (QAA)

    Director, Quality Assurance and Accountability (QAA)

    Chicago Housing Authority • Chicago, IL, United States
    [job_card.full_time]
    Director, Quality Assurance and Accountability (QAA).Chicago Housing Authority provided pay range.Your actual pay will be based on your skills and experience — talk with your recruiter to learn mor...[show_more]
    [last_updated.last_updated_variable_days] • [promoted]