Talent.com

Program evaluation [h1.location_city]

[job_alerts.create_a_job]

Program evaluation • boston ma

[last_updated.last_updated_1_day]
  • [promoted]
Principal Engineer, Behavior Understanding and Evaluation

Principal Engineer, Behavior Understanding and Evaluation

MotionalBoston, MA, US
[job_card.full_time]
The AV Behavior Design and Evaluation Team is responsible for owning the design and assessment of the AV behavior utilizing the concept of AV behavior competencies. The team relies on systematic dec...[show_more][last_updated.last_updated_30]
  • [promoted]
Senior Analyst, Applied Research and Evaluation

Senior Analyst, Applied Research and Evaluation

National Institute for Children s Health QualityBoston, MA, US
[job_card.full_time]
The National Institute for Children’s Health Quality (NICHQ) is a mission-driven nonprofit dedicated to driving dramatic and sustainable improvements in the complex issues facing children&rsq...[show_more][last_updated.last_updated_variable_days]
  • [promoted]
Program Director

Program Director

Behavioral Health Network, Inc (BHN)Boston, MA, US
[job_card.full_time]
Behavioral Health Network (BHN) is the largest provider of behavioral health services in Western Massachusetts since 1938 and is now expanding into Eastern Massachusetts. We were recently recognized...[show_more][last_updated.last_updated_variable_days]
Program Manager

Program Manager

AdvocatesDedham, Massachusetts, USA
[job_card.full_time]
The Program Manager is responsible for the overall direction and operation of the residential program.This role will provide supervision and rehabilitative direction and emergency on-call services ...[show_more][last_updated.last_updated_variable_days]
Deputy Director - Program Design & Evaluation

Deputy Director - Program Design & Evaluation

Action for Boston Community DevelopmentBoston, MA, US
[job_card.full_time]
Deputy Director of Program Design and Evaluation.ABCD’s Head Start & Children’s Services program.This person is responsible for developing and monitoring the implementation of those...[show_more][last_updated.last_updated_30]
Program Manager

Program Manager

Best Buddies Int. IncCharlestown, MA, US
[job_card.full_time]
Best Buddies International is a nonprofit 501(c)(3) organization dedicated to establishing a global volunteer movement that creates opportunities for one-to-one friendships, integrated employment, ...[show_more][last_updated.last_updated_30]
  • [promoted]
Director of Clinical Evaluation and Excellence

Director of Clinical Evaluation and Excellence

Gardner Resources Consulting, LLCLexington, MA, US
[job_card.full_time]
Director of Clinical Evaluation and Excellence.Bachelor’s degree in Life Sciences or related field (advanced degree preferred). Minimum 10 years of experience in clinical research, regulatory ...[show_more][last_updated.last_updated_variable_days]
Learning and Evaluation Implementation Internship

Learning and Evaluation Implementation Internship

Boston Public Health CommissionBoston, MA
[job_card.internship]
The mission of the Boston Public Health Commission (BPHC) is to protect, preserve, and promote the health and well-being of all Boston residents, particularly the most vulnerable.The BPHC envisions...[show_more][last_updated.last_updated_30]
Program Manager - Student Fellowship Program

Program Manager - Student Fellowship Program

Lynn Community Health CenterLynn, MA, US
[job_card.full_time]
About Lynn Community Health Center (LCHC) : .Lynn Community Health Center (LCHC) is one of the largest community health centers in Massachusetts, providing comprehensive, high-quality, and affordable...[show_more][last_updated.last_updated_variable_days]
  • [promoted]
Joint Test & Evaluation Program Officer (TS / SCI Eligible)

Joint Test & Evaluation Program Officer (TS / SCI Eligible)

Contact Government Services, LLCBoston, MA, US
[job_card.full_time]
Group and Job Profile Guidance : .The Joint Test & Evaluation (JT&E) program considers emerging.United States’ operational effectiveness,. As a member of the Joint Test & Evaluation ...[show_more][last_updated.last_updated_30]
Senior Test and Evaluation Engineer

Senior Test and Evaluation Engineer

AndurilQuincy, Massachusetts, United States
[job_card.full_time]
Anduril Industries is a defense technology company with a mission to transform U.By bringing the expertise, technology, and business model of the 21st century’s most innovative companies to the def...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Coordinator

Program Coordinator

Northeastern UniversityBoston, MA, US
[job_card.temporary]
InnovateUS delivers training to public professionals in AI, data, and innovation skills.With partnerships in more than 30 states and cities and over 120,000 learners, InnovateUS is the nation's fas...[show_more][last_updated.last_updated_30]
Senior Test and Evaluation Engineer

Senior Test and Evaluation Engineer

Anduril IndustriesQuincy, Massachusetts, United States
[job_card.full_time]
We are seeking a highly motivated and experienced Test Engineer to join our maritime team.You will work closely with the program leadership and a wide spectrum of cross-departments to help build a ...[show_more][last_updated.last_updated_30]
Head of Nonclinical Safety Evaluation

Head of Nonclinical Safety Evaluation

Moderna, Inc.Cambridge, Massachusetts, United States
[job_card.permanent]
At Moderna, our mission is to deliver the greatest possible impact to people through mRNA medicines.We foster a dynamic, diverse, and innovative workplace where every individual’s contribution is v...[show_more][last_updated.last_updated_30]
  • [promoted]
Director Reimbursement Design & Market Evaluation

Director Reimbursement Design & Market Evaluation

Boston StaffingBoston, MA, US
[job_card.full_time]
Job Opportunity at Highmark Inc.Job Summary : This job supports the matrixed strategic design and analytical approach to reimbursement. To be successful, the incumbent will work closely with stakehol...[show_more][last_updated.last_updated_1_day]
Manager, Community Benefits / Community Relations Program Design and Evaluation Jo

Manager, Community Benefits / Community Relations Program Design and Evaluation Jo

Beth Israel Lahey HealthBoston, MA, United States
[job_card.full_time]
Manager, Community Benefits / Community Relations Program Design and Evaluation Join to apply for the Manager, Community Benefits / Community Relations Program Design and Evaluation role at Beth Is...[show_more][last_updated.last_updated_30]
Research Lead - AI Cyber Testing & Evaluation

Research Lead - AI Cyber Testing & Evaluation

RAND CorporationBoston, MA, United States
[job_card.temporary]
Global and Emerging Risks (GER) division.As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of ...[show_more][last_updated.last_updated_30]
Head of Nonclinical Safety Evaluation

Head of Nonclinical Safety Evaluation

ModernaCambridge, Massachusetts
[job_card.full_time]
At Moderna, our mission is to deliver the greatest possible impact to people through mRNA medicines.We foster a dynamic, diverse, and innovative workplace where every individual’s contribution is v...[show_more][last_updated.last_updated_30]
  • [promoted]
Program Manager

Program Manager

Clearance JobsBoston, MA, US
[job_card.full_time]
Autonodyne is a Boston-based software company working to provide human-machine interface command / control, and additive autonomy to unmanned vehicles in land, sea, and air domains.We are seeking an ...[show_more][last_updated.last_updated_30]
Principal Engineer, Behavior Understanding and Evaluation

Principal Engineer, Behavior Understanding and Evaluation

MotionalBoston, MA, US
[job_card.30_days_ago]
[job_preview.job_type]
  • [job_card.full_time]
[job_card.job_description]

Job Description

Job Description

Mission Summary :

The AV Behavior Design and Evaluation Team is responsible for owning the design and assessment of the AV behavior utilizing the concept of AV behavior competencies. The team relies on systematic decomposition of AV behavior along with data driven assessment utilizing data from on-road and simulation test modalities. We are responsible for building and operating robust, large-scale evaluation systems, alongside sophisticated simulation workflows and insightful diagnostic tools. By combining expert human judgment with advanced data driven techniques, we evaluate the system behavior performance.

As the team is looking to scale to support more and more behavioral competencies, we are looking for passionate Engineers to help build a robust framework to leverage the best of agile systems engineering and data driven performance assessment to achieve our ambitious goals in scaling our system design and evaluation processes. We are looking to work with people who are driven to design robust systems and transform complex data into measurable progress toward a safer, smarter transportation future.

This person will get to build relationships with the team as well cross-functional across organization to help build a cohesive understanding AV performance as applicable to the Behavioral Competencies.

What you'll do :

  • Decompose AV operational design domain (ODD) into AV capabilities
  • Define precise atomic system and subsystem behaviors and interfaces required to realize these capabilities.
  • Collaborate extensively with development teams (Autonomy, Infrastructure, Cloud Applications) to drive the design and implementation of new features that enable defined AV capabilities and enhance the overall product experience.
  • Strategically plan and execute system-level testing campaigns. This includes leveraging advanced simulation tools and coordinating tests on closed course tracks and proving grounds to ensure the system meets functional and performance requirements.
  • Effectively utilize existing metrics and propose new metrics to evaluate AV performance via simulation and on-road testing modalities.
  • Pioneer the definition and implementation of key evaluation metrics and reward functions, driving autonomy performance across safety, comfort, and assertiveness
  • Leverage a combination of learned methods and metrics along with classical metrics to stretch the horizon of performance evaluation
  • Characterize the performance target against parameters used to define AV capabilities to provide nuance in performance evaluation
  • Deliver strategic insights and recommendations based on AV capability testing by building meaningful visualizations
  • Develop and maintain comprehensive dashboards and reporting tools. Distill on-road performance data into actionable feedback for engineering teams and create high-level, insightful summaries for executive leadership.
  • Focus on automating simulation result analysis processes and gaps, removing manual processes where applicable
  • Partner cross-functionally with Behaviors, Actions, Simulation, System Engineering, Research, and other Onboard / Offboard Software Teams on evaluation strategies

What we're looking for :

  • Bachelor's degree and 7+ years of experience in one of Systems Eng, Data Science, Statistics or Computer Science with some form of experience in rest of the domains
  • At least 5 years of experience in leading and scaling data driven evaluation of autonomous driving behavior or similar safety critical emerging technology
  • Proven technical experience in establishing and executing evaluation strategies
  • A strong foundation in scientific and statistical methodologies
  • Fluency in SQL or similar query languages
  • Fluency in data visualization techniques
  • Fluency in Python
  • Proficiency in crafting data-driven reports and technical strategy documents for executive decision-making
  • Excellent interpersonal skills to build relationships with other teams
  • Excellent communication skills; effective in communicating complex concepts and driving resolutions
  • Self-starter who is motivated to set and achieve goals and takes initiative to drive ambiguous tasks / projects to completion
  • I deally, you also have :

  • Masters degree in Data Science or Computer Science
  • Experience in mentoring and leadership development
  • Experience collaborating in an agile development environment
  • A background in shaping product roadmaps
  • Familiarity with Reinforcement Learning (RL) with Human Feedback
  • Specialized expertise in creating expansive datasets
  • Experience collaborating in an agile development environment
  • Working with a global workforce that spans multiple timezones
  • We encourage a hybrid schedule with in-office time at one of our locations in Boston, Pittsburgh, or Las Vegas to support collaboration, or this role can be fully remote.

    The salary range for this role is an estimate based on a wide range of compensation factors including but not limited to specific skills, experience and expertise, role location, certifications, licenses, and business needs. The estimated compensation range listed in this job posting reflects base salary only. This role may include additional forms of compensation such as a bonus or company equity. The recruiter assigned to this role can share more information about the specific compensation and benefit details associated with this role during the hiring process.

    Candidates for certain positions are eligible to participate in Motional's benefits program. Motional's benefits include but are not limited to medical, dental, vision, 401k with a company match, health saving accounts, life insurance, pet insurance, and more.

    Salary Range

    $175,000—$234,250 USD

    Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. We're driven by something more.

    Our journey is always people first.

    We aren't just developing driverless cars; we're creating safer roadways, more equitable transportation options, and making our communities better places to live, work, and connect. Our team is made up of engineers, researchers, innovators, dreamers and doers, who are creating a technology with the potential to transform the way we move.

    Higher purpose, greater impact.

    We're creating first-of-its-kind technology that will transform transportation. To do so successfully, we must design for everyone in our cities and on our roads. We believe in building a great place to work through a progressive, global culture that is diverse, inclusive, and ensures people feel valued at every level of the organization. Diversity helps us to see the world differently; it's not only good for our business, it's the right thing to do.

    Scale up, not starting up.

    Our team is behind some of the industry's largest leaps forward, including the first fully-autonomous cross-country drive in the U.S, the launch of the world's first robotaxi pilot, and operation of the world's longest-standing public robotaxi fleet. We're driven to scale; we're moving towards commercialization of our technology, and we need team members who are ready to embrace change and challenges.

    Formed as a joint venture between Hyundai Motor Group and Aptiv, Motional is fundamentally changing how people move through their lives. Headquartered in Boston, Motional has operations in the U.S and Asia. For more information, visit www.Motional.com and follow us on Twitter, LinkedIn, Instagram and YouTube.

    Motional AD Inc. is an EOE. We celebrate diversity and are committed to creating an inclusive environment for all employees. To comply with Federal Law, we participate in E-Verify. All newly-hired employees are queried through this electronic system established by the DHS and the SSA to verify their identity and employment eligibility.