Talent.com
Source Mantra Inc
QA SpecialistSource Mantra Inc • Louisville, KY, United States
No longer accepting applications
QA Specialist

QA Specialist

Source Mantra Inc • Louisville, KY, United States
14 days ago
Job type
  • Full-time
  • Quick Apply
Job description

Role Description

As QA at Centific specializing in Generative AI Data Services, you will play a pivotal role in driving the success of our cutting-edge projects focused on building and enhancing Large Language Models (LLMs). Your primary responsibility will be to adhere to quality review instructions, pass, review or reject human-labeled data crucial for training AI models. In this dynamic and evolving field, you will be at the forefront of bridging the gap between human expertise and artificial intelligence, contributing significantly to the development of next-generation AI technologies. As a problem solver and highly organized lead, you will collaborate closely with internal teams and a global workforce, ensuring seamless communication, efficient execution, and successful delivery of projects.

Task Overview:
As a Data Annotation Reviewer, you will evaluate data annotation and bounding box responses from annotators. Your job is to ensure the correct annotation was applied within the input parameters match and the output is accurate and relevant according to the guidelines.

Key Responsibilities:

  • Review annotations to confirm they match the intended purpose of the guidelines.
  • Validate that the annotator answer is appropriate for the chosen function.
  • Check if the Annotation output includes all necessary information to filfull the guidelines.
  • Identify and assess individual data points in the AI response for accuracy and relevance.
  • Provide comments and feedback to clarify decisions or flag inconsistencies.

Language Proficiency:

  • Native level fluency in English.
  • Strong written and verbal communication skills in English.

Skills and Responsibilities

  • Assisting in the development and implementation of quality assurance policies.
  • Collaboration on project guidelines and supplemental learning materials.
  • Ensure compliance with client-specific requirements and performance standards in quality aspects of project execution.
  • Provide feedback and recommendations to PM team regarding UI design.
  • Review annotators and arbitrators weekly via the production monitoring process.
  • Review metrics and spot check individual tasks.
  • Record and flag quality issues.
  • Conduct end-of-day reporting to ensure smooth project handoffs and continuity across shifts.

Key Qualifications:

  • Located in Lousiville, KY and ability to work at client- on-site.
  • Required: Diploma and at least 2-3 years of experience in quality management, particularly in data services for AI.
  • Desired: Bachelor's degree, Linguistics or other related field of study
  • Experience writing data-labeling project guidelines and materials (or similar work in another field).
  • Ability to create useful and impactful insights for annotators and clients.
  • Basic familiarity with Microsoft Office 365 including Outlook, Excel, and PowerPoint.
  • General knowledge of online communication
  • Excellent communication both written and spoken.
  • Collaborative and solution focused.
  • Confidence and the ability to give/take feedback.
  • Ability to follow project directions and perform time bound tasks accurately and efficiently.
  • Ability to maintain quality while performing repetitive tasks.
  • Detail-oriented and problem-solving mindset.
  • Organized and focused enough to work independently as a role player within a team environment.
Create a job alert for this search

QA Specialist • Louisville, KY, United States

Similar jobs

Pursue Your Passion with Purpose

MDA EdgeShepherdsville, KY, United States
Full-time

Healthcare Quality Assurance Supervisor.The Healthcare Quality Assurance (QA) Supervisor is responsible for communicating quality policies and objectives to support overall healthcare compliance wi... Show more

 • Promoted

Quality Manager

Owens & MinorLouisville, KY, United States
Full-time

Regulatory & Quality Compliance Manager.Owens & Minor is a global healthcare solutions company providing essential products, services and technology solutions that support care delivery in leading ... Show more

 • Promoted

Sr. Director, Healthcare Product Manager

EquifaxLouisville, KY, United States
Full-time

Director, Healthcare Product Manager.Equifax is where you can power your possible.If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and... Show more

 • Promoted

Digital Fulfillment Specialist

The Fresh MarketLouisville, KY, United States
Full-time

Digital Fulfillment Specialist.Our mission is to make everyday eating extraordinary for our guests.We create a warm, welcoming, and memorable experience through exceptional, personal service.We're ... Show more

 • Promoted

Quality Control Team Lead

Tennant CompanyLouisville, KY, United States
Full-time

Louisville, Ky Monday Friday; $50800 - $76,400 With more than $1B in revenue, Tennant Company is a globally recognized leader in the cleaning equipment industry.For the past 150 years, we have bee... Show more

 • Promoted

Supplier Engagement Specialist NBD

Sazerac CompanyLouisville, KY, United States
Full-time

Build your career at Sazerac! With almost 400 years of rich history, Sazerac Company has thrived as an independent, American family-owned company with operations in the United States and around the... Show more

 • Promoted

Quality Control Specialist

Sprink LLCNew Albany, IN, United States
Full-time

Description:Shift:Monday-Thursday (6a-4p), Monday-Thursday (4p-2a) Examine products for defects or deviations from specifications.Members of this team will evaluate, assess and re-evaluate company-... Show more

 • Promoted

Tooling Specialist

Independent Stave CompanyLouisville, KY, United States
Full-time

The Tooling Specialist is responsible for improving cost visibility and performance across all tooling used in stave mills and cooperages.This role works closely with plant maintenance, engineering... Show more

 • Promoted

Purchasing Inventory Specialist

PartsSource Inc.Louisville, KY, United States
Full-time

Louisville, Kentucky, United States.PartsSource is the leading technology and software platform for managing mission-critical healthcare equipment.Trusted by over 5,000 US hospitals and 15,000 clin... Show more

 • Promoted

Sr Tech Business Analyst (Client Service Specialist)

Automatic Data ProcessingLouisville, KY, United States
Full-time

Sr Technical Business Analyst (Client Service Specialist).Are you passionate about delivering exceptional client experiences while maintaining accuracy and operational excellence in complex retirem... Show more

 • Promoted

Quality Assurance Manager

Arbor HomesLouisville, KY, United States
Full-time

Arbor & Elite Homes is seeking a Quality Assurance Manager to join our team located in Louisville, KY.This position will assist the procurement initiatives of our Quality Assurance team.We are seek... Show more

 • Promoted

Quality Improvement Specialist in Northern Kentucky

Ohio Valley Independent PhysiciansLouisville, KY, United States
Full-time

ATTENTION CANDIDATES IN NORTH EASTERN KENTUCKY: THIS POSITION SERVES THE LEXINGTON/ASHLAND/COVINGTON REGION.Seeking a dynamic and relationship-driven healthcare professional to lead efforts in our ... Show more

 • Promoted

Identity & Access Management Specialist

Technology Consulting IncLouisville, KY, US
Temporary

TCI has an immediate need for twoIdentity Access Management Specialists in Louisville, KY (or can be in Washington D.This is NOT a remote opportunity.This is not a Corp2Corp opportunity.This is a 6... Show more

 • Promoted

Application Product Specialist - Case IH

CNH IndustrialLouisville, KY, United States
Full-time

CNH is a world-class equipment and services company dedicated to advancing the noble work of agriculture and construction workers.Driven by our shared purpose of Breaking New Ground, we are passion... Show more

 • Promoted

Tax Standards, Quality, and Risk Senior Associate

CroweLouisville, KY, United States
Full-time

Crowe LLP Tax SQR Senior Associate.At Crowe, you can build a meaningful and rewarding career.With real flexibility to balance work with life moments, you're trusted to deliver results and make an i... Show more

 • Promoted

Contract Specialist (m, f, d)

VeraltoLouisville, KY, United States
Full-time

Doing meaningful work that makes an everyday impact on the world around you.Growing your expertise and expanding your skillset with every project.Collaborating with a vibrant, inclusive, global tea... Show more

 • Promoted

Permitting Specialist

LedcorLouisville, KY, United States
Full-time

Ledcor Technical Services has been building and servicing communication networks for customers across North America since 1979.Utilizing our broad expertise and experience, we customize solutions t... Show more

 • Promoted

Product Specialist

NEFF AutomationLouisville, KY, United States
Full-time

Under the general supervision of Neff Automation Product Sales Manager, assumes responsibility for technical support of the product line within the assigned Neff sales territories.Directly reports ... Show more

 • Promoted

Warehouse Quality Control Specialist

TradeJobsWorkforce47102 Austin, IN, US
Full-time

As a Warehouse Quality Control Specialist, you will be responsible for assisting with warehouse operations and ensuring smooth logistics, including: organize inventory and ensure items are stored p... Show more

 • Promoted

Digital Delivery Specialist

bpLouisville, KY, United States
Full-time +1

The Digital Delivery Specialist plays a key role in supporting the execution of digital initiatives across BP's Mobility & Convenience Americas (M&CA) business.You will work closely with the Head o... Show more