Data visualization [h1.location_city]
[job_alerts.create_a_job]
Data visualization • bend or
[last_updated.last_updated_variable_days]
This role is responsible for ensuring the reliability, accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies.
We're looking for experienced ...[show_more][last_updated.last_updated_30]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more][last_updated.last_updated_30]
We’re looking for Customer Support Product Testers across the US to work from home and help top brands improve their products before they hit the market.[show_more][last_updated.last_updated_30]
SENIOR DATA PLATFORM ENGINEER / SDE (HEALTHCARE).Hybrid (In office 3 days / week) within.Oregon, Washington, Idaho or Utah.
Every day, Cambia’s Data & Analytics Engineering Team is living our mission ...[show_more][last_updated.last_updated_variable_days]
A leading engineering firm is seeking a Senior VDC Coordinator responsible for designing and leading wireless telecommunications systems, including Commercial DAS, Wi-Fi, and more.The ideal candida...[show_more][last_updated.last_updated_30]
Role Overview • • Mercor is partnering with a leading AI lab to engage independent • •Data Science Experts • • for diverse research and development initiatives.
These contractors will support data‑driven...[show_more][last_updated.last_updated_variable_days]
We’re looking for Data Entry Specialists for Customer Products across the US to work from home and help top brands improve their products before they hit the market.[show_more][last_updated.last_updated_30]
We are looking for a finance professional to join our team to train AI models.You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of ...[show_more][last_updated.last_updated_variable_days]
We're currently looking for individuals across the country to take part in online paid research, including remote focus groups, product trials, and consumer studies.
Earn up to $750 a week in your f...[show_more][last_updated.last_updated_variable_days]
Crunchbase helps over 75 million people around the world connect with the companies and people that matter.Powered by best-in-class proprietary data, Crunchbase is democratizing access to opportuni...[show_more][last_updated.last_updated_30]
As a Senior Data Scientist, you will work remotely on an hourly paid basis to review AI-generated analytical reasoning, code, and model outputs, as well as generate high-quality reference solutions...[show_more][last_updated.last_updated_30]
Senior AI Data Engineer
Veeva SystemsBend, Oregon[job_card.full_time]
Work From Home - Data Entry – Product Support – Entry Level
GLBend, Oregon[filters.remote]
[job_card.full_time]
- [promoted]
Data Entry Product Support - No Experience
GLOCPABend, Oregon[job_card.full_time]
Senior Data Platform Engineer / SDE
Cambia Health SolutionsBend, OR[job_card.full_time]
Senior VDC Wireless Design Lead - Data Center
JacobsBend, OR, United States[job_card.full_time]
Remote Data Science Expert - AI Trainer ($50-$90 per hour)
MercorBend, Oregon, US[filters.remote]
[job_card.full_time]
- [promoted]
Work from Home Data Entry Clerk
GL Inc.Bend, Oregon[filters.remote]
[job_card.full_time]
Remote Finance Director - AI Trainer ($50-$60 / hour)
Data AnnotationBend, Oregon[filters.remote]
[job_card.full_time] +1
Paid Focus Group Panel - Remote Work From Home Online (Data Entry Clerks Welcome)
Apex Focus Group LLCBend, Oregon, United States[filters.remote]
[job_card.full_time]
Staff Data Scientist
CrunchbaseOregon, United States[job_card.full_time]
Remote Senior Data Scientist - AI Trainer
SuperAnnotateBend, Oregon, US[filters.remote]
[job_card.full_time]
Senior AI Data Engineer
Veeva SystemsBend, Oregon[job_card.30_days_ago]
[job_preview.job_type]
- [job_card.full_time]
[job_card.job_description]Data Integrity & Validation : A strong, specialized understanding of data quality principles, including methods for validating datasets against bias, integrity concerns, and quality standards. Ability to craft diverse and adversarial test data to uncover AI edge cases Prompt Engineering & Model Expertise : Demonstrated skill in advanced prompt engineering techniques to create evaluation scenarios that test the AI's reasoning, action planning, and adherence to system instructions. Deep knowledge of LLM common failure modes (hallucination, incoherence, jailbreaking) Automated Evaluation Implementation : 5+ years of experience designing and deploying automated evaluation pipelines to assess complex, agentic AI behaviors. Familiarity with quality metrics such as task success rate, semantic similarity, and sentiment analysis for output measurement Debugging Agentic Systems : Must be comfortable with the specific challenges of debugging agentic systems, including tracing and interpreting an agent's internal reasoning, tool use, and action sequence to pinpoint failure points Programming & Frameworks : 5+ years of experience using Python to develop custom evaluation frameworks, writing scripts, and integrating pipelines with CI / CD systems. Familiarity with standard test automation tools (e.g., Pytest, modern web automation tools) Bachelor's degree in Data Science, Machine Learning, Computer Science, or a related field, with experience in Gen AI / LLMs High work ethic. Veeva is a hard-working company High integrity and honesty. Veeva is a PBC and a “do the right thing” company. We expect that from all employees Applicants must have the unrestricted right to work in the United States or Canada. Veeva will not provide sponsorship at this time Medical, dental, vision, and basic life insurance Flexible PTO and company paid holidays Retirement programs 1% charitable giving program Base pay : $110,000 - $270,000 The salary range listed here has been provided to comply with local regulations and represents a potential base salary range for this role. Please note that actual salaries may vary within the range above or below, depending on experience and location. We look at compensation for each individual and base our offer on your unique qualifications, experience, and expected contributions. This position may also be eligible for other types of compensation in addition to base salary, such as variable bonus and / or stock bonus.
The Role
This role is responsible for ensuring the reliability, accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies. We're looking for experienced candidates with :
1. A meticulous, critical, and curious mindset with a dedication to product quality in a rapidly evolving technological domain2. Exceptional analytical and systematic problem-solving capabilities3. Excellent ability to communicate technical findings to both engineering and product management audiences4. Ability to learn application areas quickly
Thrive in our Work Anywhere environment : We support your flexibility to work remotely or in the office within Canada or the US, ensuring seamless collaboration within your product team's time zone.Join us and be part of a mission-driven organization transforming the life sciences industry.
What You'll Do
- Evaluation Strategy & Planning : Define and establish comprehensive evaluation strategies for new AI Agents. Prioritize the integrity and coverage of test data sets to reflect real-world usage and potential failure modes
- LLM Output Integrity Assessment : Programmatically and manually evaluate the quality of LLM-generated content against predefined metrics (e.g., factual accuracy, contextual relevance, coherence, and safety standards)
- Creating High-Fidelity Datasets : Design, curate, and generate diverse, high-quality test data sets, including challenging prompts and scenarios. Evaluate LLM outputs to proactively identify system biases, unsafe content, hallucinations, and critical edge cases
- Automation of Evaluation Pipelines : Develop, implement, and maintain scalable automated evaluations to ensure efficient, continuous validation of agent behavior and prevent regressions with new features and model updates
- Root Cause Analysis : Understand model behaviors and assist in the trace and root-cause analysis of identified defects or performance degradations
- Reporting & Performance Metrics : Clearly document, track, and communicate performance metrics, validation results, and bug status to the broader development and product teams
Requirements
Perks & Benefits
Compensation