Quality assurance manager serp_jobs.h1.location_city

Job Description

Job Description

Linguist and Software Quality Assurance I

Responsibilities :

• Expand this tool utilization to ASR / Bixby so that we can scale / expand MQL TC data sets.
• Prompt engineering on some of the internal platforms
• Support / drive NMT improvements (Main member that drives Spanish translation).
• Ensure the successful execution of multiple projects simultaneously.
• Continuously improve test coverage, efficiency, and effectiveness by identifying areas for automation and optimization.
• Exceptional problem-solving abilities and debugging and log analysis skills.
• Evaluate defects / issues based on market impact and product specification (Technical).
• Communicate high priority risk defects / events to middle and upper management.
• Prioritize and manage multiple projects in fast pace environment, communicating quickly with key project stakeholders.
• Maintain up-to-date competitive knowledge on voice quality market trends.
• Gather and analyze data from multiple sources, prepare spreadsheets, charts, graphs and tables of information and to plan and prioritize multiple work assignments.
• Communicate with internal / external teams in professional manner to build and maintain excellent rapport.
• Determine course of action for the completion of objectives and tasks with limited instruction.
• Works on problems of limited scope. Follows standard practices and procedures.
• Conduct usability testing across platforms to identify friction points and accessibility issues.
• Design, run, and evaluate prompt-based test scenarios to ensure consistent and high-quality language model outputs.
• Collaborate with UX designers and product managers to validate design assumptions through user-centered QA practices.
• Create and maintain prompt evaluation frameworks, including edge cases and expected output quality.
• Report usability bugs and inconsistencies in AI-driven features with user impact assessments.
• Define metrics and standards for prompt performance (e.g., coherence, relevance, tone).
• Work closely with ML / NLP engineers to give feedback on model behavior from a QA and UX standpoint.
• Automate prompt validation where possible, using tools generated internally (Gemini Prompt Tool).
• Support continuous improvement of UX and AI feature integration through data-driven QA practices.
• Document test cases, user flows, and prompt strategies for internal reference and training.
• Evaluate model output quality across diverse scenarios and edge cases.

Qualifications :

Compensation : $25 - $35 per hour

ID# : 36388404