Talent.com
Futran Tech Solutions Pvt. Ltd.
Annotation Program LeadFutran Tech Solutions Pvt. Ltd. • Louisville, KY, United States
Annotation Program Lead

Annotation Program Lead

Futran Tech Solutions Pvt. Ltd. • Louisville, KY, United States
9 hours ago
Job type
  • Full-time
Job description

Annotation Program Lead

Location: Remote Note: Occasional travel to Louisville, Kentucky

We are looking for an Annotation Program Lead to manage our AI Quality Annotation Program. This individual will oversee the operational execution of human review activities that establish the gold-standard datasets used to measure conversational AI performance, safety, and compliance. The ideal candidate combines strong program management skills with experience in quality assurance, data annotation operations, and stakeholder engagement.

Responsibilities:

  • Lead the day-to-day operation of the AI annotation program.
  • Manage a team of annotators responsible for reviewing customer conversations and AI interactions.
  • Develop annotation guidelines, procedures, and quality standards.
  • Establish calibration programs and quality assurance processes to ensure consistency across reviewers.
  • Partner with Data Scientists to create and maintain gold-standard datasets.
  • Monitor annotation accuracy, throughput, and quality metrics.
  • Coordinate reporting and deliverables for Legal, Compliance, Responsible AI, and executive stakeholders.
  • Manage annotation workflows and tooling including setting up annotation jobs, running data processing scripts, and testing annotation UIs for quality before job launch.
  • Plan capacity requirements to support seasonal increases in review volume.
  • Support future expansion into multilingual evaluation programs.
  • Identify process improvements that increase efficiency and annotation quality.

Required Skills:

  • Bachelor's degree or equivalent experience in Linguistics/Psychology.
  • 5+ years of experience in program management, operations, quality assurance, data labeling, or related fields.
  • Experience leading teams and managing operational workflows.
  • Strong organizational and stakeholder management skills.
  • Ability to analyze quality metrics and drive continuous improvement initiatives.
  • Excellent written and verbal communication skills.
  • Familiarity with Python/R, SQL and Excel.
  • Should be familiar with running scripts on language data.
  • Experience supporting AI, machine learning, or data annotation programs.
  • Familiarity with Responsible AI, compliance, legal review, or governance processes.
  • Experience developing operational standards and quality frameworks.
  • Experience managing vendor or contractor resources.
Create a job alert for this search

Annotation Program Lead • Louisville, KY, United States

Similar jobs

Program Manager

TrialCardJeffersonville, IN, United States
Full-time

Valeris is a fully integrated life sciences commercialization partner that provides comprehensive solutions that span the entire healthcare value chain.Formed by the merger of PharmaCord and Mercal... Show more

 • Promoted

Sr. Director, Healthcare Product Manager

EquifaxLouisville, KY, United States
Full-time

Director, Healthcare Product Manager.Equifax is where you can power your possible.If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and... Show more

 • Promoted

Product Coach (Texas Roadhouse - Schraeger Market - Indiana/Michigan/Ohio)

Texas RoadhouseLouisville, KY, United States
Full-time

Ready to Love Your Job? Texas Roadhouse is looking for a legendary Product Coach to join our Support Center team.If you're ready to bring your energy, partnership, and heart to a place where fun me... Show more

 • Promoted

Information Technology Professional

US NavyScottsburg, IN, US
Full-time

Information Technology Professional (IT/CTN/IS).Information Systems Technicians, Cryptologic Technician Networks, and Intelligence Specialists keep the Fleet connected, informed, and secure by oper... Show more

 • Promoted

Louisville Program Specialist

BoosterLouisville, KY, United States
Full-time +1

Booster is a mission-driven school fundraising company focused on cultivating virtuous leaders who want to change the world.Booster partners with over 6,000 schools each year and impacts over 3 mil... Show more

 • Promoted

Salesforce QA with Automation-Louisville KY

StaffingLouisville, KY, United States
Full-time

Location: Louisville KY Duration: 4-5 months Rate: DOE.Strong Salesforce Service cloud or Health cloud background with 3-5 years of experience.At least 1 successful full implementation of Salesforc... Show more

 • Promoted

Lead Project Manager - Substation & Transmission

Sargent & LundyLouisville, KY, United States
Full-time

This position allows for a hybrid arrangement with a mix of work from home and in the office.This position will offer you the opportunity to manage the execution of multiple transmission, substatio... Show more

 • Promoted

Medical Billing and Coding - Entry Level Training Program

Dreambound Inc.Mount Washington, Kentucky, US
Full-time

Note : This is an educational program, not a job.Successful completion of the program does not guarantee employment but will equip you with valuable skills for the healthcare job market.Looking to ... Show more

 • Promoted

Louisville Program Leader

BoosterLouisville, KY, United States
Full-time

Booster is a school fundraiser on a mission to change the world.Proudly serving schools and millions of students nationwide, we are reinventing how schools do fundraising.If you love the idea of im... Show more

 • Promoted

Partnership and Programs Leader

Sazerac CompanyLouisville, KY, United States
Full-time

Build your career at Sazerac! With almost 400 years of rich history, Sazerac Company has thrived as an independent, American family-owned company with operations in the United States and around the... Show more

 • Promoted

Program Manager

Mango HealthJeffersonville, IN, United States
Full-time

Valeris is a fully integrated life sciences commercialization partner that provides comprehensive solutions that span the entire healthcare value chain.Formed by the merger of PharmaCord and Mercal... Show more

 • Promoted

Program Applications Specialist

Veterans Health AdministrationLouisville, KY, United States
Full-time +2

SummaryVacancy Identification Number (VIN): 12899915.Please read this announcement in its entirety before beginning the application process to ensure you submit all the required documents.See Requi... Show more

 • Promoted

Program Manager

ControlTouch SystemsLouisville, KY, United States
Full-time

ControlTouch Systems is looking for an experienced Controls Integration Program Manager to provide leadership and consistency to a group of projects that may include Controls programming and Electr... Show more

 • Promoted

Material Program Manager

RaytheonFairdale, KY, United States
Full-time

Raytheon is seeking a Material Program Manager (MPM) with demonstrated project management experience.You must be a self-starter, capable of developing and achieving organizational and program goals... Show more

 • Promoted

Regional Access & Reimbursement Associate Director

Vertex PharmaceuticalsLouisville, KY, United States
Full-time

Job DescriptionGeneral Summary:Vertex currently operates at the forefront of scientific innovation and has successfully developed and commercialized multiple breakthrough medicines for Cystic Fibro... Show more

 • Promoted

Remote Consumer Insights Participant

GL IncShepherdsville, Kentucky
$15.00 hourly
Remote
Part-time +1

Product Testers are wanted to work from home nationwide in the US to fulfill upcoming contracts with national and international companies.We guarantee 15-25 hours per week with an hourly pay of bet... Show more

 • Promoted

Program Manager (Contract Contingent)

ProSidian ConsultingLouisville, KY, United States
Full-time

Program Manager (Contract Contingent).The PM shall have a minimum of three years relevant experience managing, staffing, overseeing, and completing the same or similar in nature of work (i.Army Rec... Show more

 • Promoted

Innovation Portfolio Leader

Sazerac CompanyLouisville, KY, United States
Temporary

As the Innovation Portfolio Leader you will be part of the successful delivery of innovation which is critical to delivering Sazerac's growth plans.This role owns the full innovation pipeline and b... Show more

 • Promoted

Veteran Development Program

GE AppliancesLouisville, KY, United States
Full-time

This opportunity is for applicants interested in a hands-on Supply Chain Manufacturing career path when transitioning out of the military from a Commissioned Officer position.Relocation assistance ... Show more

 • Promoted

Sr. Director, CI Program Manager- Inventory Management

ShipMonkLouisville, KY, United States
Full-time

Director, CI Program Management - Inventory Management.ShipMonk isn't just a 3PL we're the tech-powered growth partner for ecommerce brands, running 12+ owned fulfillment centers across the US, Ca... Show more