AI Data Engineer

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth potential ahead.

At the heart of Veeva are our values : Do the Right Thing, Customer Success, Employee Success, and Speed. We're not just any public company - we made history in 2021 by becoming a public benefit corporation (PBC), legally bound to balancing the interests of customers, employees, society, and investors.

As a Work Anywhere company, we support your flexibility to work from home or in the office, so you can thrive in your ideal environment.

Join us in transforming the life sciences industry , committed to making a positive impact on its customers, employees, and communities.

The Role

This role is responsible for ensuring the reliability, accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies. We're looking for experienced candidates with :

1. A meticulous, critical, and curious mindset with a dedication to product quality in a rapidly evolving technological domain

2. Exceptional analytical and systematic problem-solving capabilities

3. Excellent ability to communicate technical findings to both engineering and product management audiences

4. Ability to learn application areas quickly

Thrive in our Work Anywhere environment : We support your flexibility to work remotely or in the office within Canada or the US, ensuring seamless collaboration within your product team's time zone.

Join us and be part of a mission-driven organization transforming the life sciences industry.

What You'll Do

• Evaluation Strategy & Planning : Define and establish comprehensive evaluation strategies for new AI Agents. Prioritize the integrity and coverage of test data sets to reflect real-world usage and potential failure modes
• LLM Output Integrity Assessment : Programmatically and manually evaluate the quality of LLM-generated content against predefined metrics (e.g., factual accuracy, contextual relevance, coherence, and safety standards)
• Creating High-Fidelity Datasets : Design, curate, and generate diverse, high-quality test data sets, including challenging prompts and scenarios. Evaluate LLM outputs to proactively identify system biases, unsafe content, hallucinations, and critical edge cases
• Automation of Evaluation Pipelines : Develop, implement, and maintain scalable automated evaluations to ensure efficient, continuous validation of agent behavior and prevent regressions with new features and model updates
• Root Cause Analysis : Understand model behaviors and assist in the trace and root-cause analysis of identified defects or performance degradations
• Reporting & Performance Metrics : Clearly document, track, and communicate performance metrics, validation results, and bug status to the broader development and product teams

Requirements

Learn More

Perks & Benefits

Compensation

#LI-Remote

#LI-MidSenior

Veeva's headquarters is located in the San Francisco Bay Area with offices in more than 15 countries around the world.

Veeva is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity or expression, religion, national origin or ancestry, age, disability, marital status, pregnancy, protected veteran status, protected genetic information, political affiliation, or any other characteristics protected by local laws, regulations, or ordinances. If you need assistance or accommodation due to a disability or special need when applying for a role or in our recruitment process, please contact us at talent_accommodations@veeva.com .

Work Where It's Best for You

Work Anywhere means you can work in an office or at home on any given day. It's about getting the work done in the way and place that works best for each person. This applies across all locations and departments.

Work Anywhere does not mean work at any time. We have predictable core hours where employees are generally available for meetings and collaboration. Employees are focused and available during core hours.

We invest in our offices to make them places where our employees like to go. If you work in the office three or more days a week, you will have a dedicated office workspace. Our offices function as hubs to draw people in, create social bonds, and where random connections and mixing of ideas happen. We're investing more in offices, culture, and offsite meetings, not less.

Product teams are organized in regional product hubs for optimal collaboration and live within a time zone of their hub. Our current product hubs are located in Pleasanton, Columbus, Boston, Kansas City, New York City, Raleigh, and Toronto. We create opportunities for teams to get together in person regularly.

Customer-facing roles, such as Sales and Professional Services, live near and / or travel to their customers.

When an employee moves within a country it does not cause a change in salary. Where you live impacts you and your family. Not knowing if your compensation will change if you move can cause stress and uncertainty for everyone. We wanted to eliminate that.

Work at Veeva. Work where it's best for you.