Program Evaluator - Proactive Support Team

The salary range is based on several factors, including, but not limited to, overall experience, relevant experience, education level, certifications, applicable skills, and expertise.

About Urban Pathways

Since 1975, Urban Pathways has engaged New York City’s most vulnerable residents, people on the streets or in areas unfit for human habitation, “lighting the path home, one person at a time.” Urban Pathways is a catalyst for transformative change in the lives of unhoused adults, empowering them to discover their inherent strengths and abilities. We provide essential support and foster an environment where individuals can redefine their narratives and become their best selves.

Job Summary

Reporting to the Medical Director, the Program Evaluator for the Proactive Support Team (PST) program will have a central role in documenting the impact of the PST model, supporting replication across sites, and producing evaluation reports that inform system-level improvements. The Program Evaluator will be responsible for leading data management, evaluation, and outcome measurements across the initiative. This role ensures that program fidelity, feasibility, scalability, and sustainability are rigorously assessed, and that data drives both daily practice and long-term strategy. The Program Evaluator will work closely with program leadership, frontline staff, and external evaluators to design, manage, and interpret qualitative and quantitative data systems, ensuring accurate reporting to funders and stakeholders. The Program Evaluator will be an active listener, provide high-quality customer service, and respond by exhibiting cross-cultural awareness with the ability to promote and contribute to an equitable and inclusive anti-racist organizational culture and environment.

Key Responsibilities & Essential FunctionsEvaluation & Data Systems

• Design and oversee data collection systems to track engagement, service utilization, housing stability, and health outcomes.
• Develop and manage program logic models, KPIs, and fidelity monitoring tools.
• Conduct internal program evaluation, including pre/post surveys, staff fidelity assessments, and resident outcome tracking.
• Collaborate with external evaluators to ensure independent validation of results.
• Prepare IRB protocols and ensure compliance with ethical research standards.
• Conduct both qualitative (e.g., interviews, focus groups) and quantitative (e.g., statistical analysis, dashboards) evaluations.
• Produce monthly dashboards, quarterly performance reports, and annual evaluation summaries for funders and leadership.
• Support continuous quality improvement by providing timely feedback loops to program staff.

Collaboration & Capacity Building

• Work with program staff to integrate evaluation findings into daily practice.
• Train staff in data literacy, documentation standards, and fidelity to the PST engagement model.
• Support program leadership in aligning evaluation findings with organizational strategic priorities.
• Disseminate findings to stakeholders, including through conference presentations, peer-reviewed publications, and policy briefs.

Administrative & Reporting

• Ensure timely submission of accurate evaluation reports to Helmsley Charitable Trust and other funders.
• Manage data entry and reporting platforms (e.g., AWARDS, Excel, statistical packages).
• Assist with grant applications by providing evaluation data, outcomes analysis, and projected impact metrics.
• Ensure compliance with all Urban Pathways, regulatory, and funding agency requirements regarding data management.

Communication

• Communicate effectively, both verbally and in writing, in a professional manner.
• Facilitate and attends meetings, training, and supervisory sessions.
• Respond promptly to communications, including phone calls, emails, and written inquiries.

Performs all other duties as assigned and as required.

Qualifications, Education and Experience

• Master’s degree in Public Health, Social Work, Psychology, Evaluation Science, Data Analytics, or a related field required.
• At least 3 years of experience in program evaluation, applied research, or data analytics in a human services or healthcare setting.
• Experience with Institutional Review Board (IRB) protocols and mixed-methods evaluation preferred.

Skills & Competencies

• Strong knowledge of evaluation frameworks (logic models, outcomes-based evaluation, CQI).
• Proficiency in both quantitative and qualitative methods.
• Skilled in data visualization and dashboard creation (Excel, Power BI, Tableau, or similar).
• Excellent communication skills, with ability to translate data into actionable insights for staff and leadership.
• Strong problem-solving and project management skills.
• Will be commitment to Urban Pathways’ mission of person-centered, strength-based care.

Licenses

• A valid driver's license is required, with an acceptable driving record that complies with our insurance policy standards.
• Valid professional licenses and certifications, if applicable.

Capabilities

• Ability to conduct fieldwork and interviews as needed.
• Fieldwork may include visiting program sites, conduct interviews, and observing engagement practices.
• May be required to work a flexible schedule including weekends, holidays, and evenings.
• Ability to sit, stand, walk, bend, stoop, push, pull, lift (up to 25 lbs.).
• Desire to perform the essential functions of this job.
• Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
• Comfortable with using public transportation to travel to and from various programs sites

Urban Pathways offers a comprehensive benefits package designed to support the well-being and professional growth of our employees.

These benefits include:

• Healthcare Coverage: Medical, dental, and vision insurance plans to keep you and your family in good health.
• Retirement Savings: A 403(b) plan and a 401(a) with employer annual contribution to help you plan for a secure financial future.
• Paid Time Off: Generous paid time off, including vacation, holidays, and personal days.
• Professional Development: Opportunities for continuous learning and professional development to enhance your skills and advance your career.
• Flexible Work Arrangements: Work-life balance is important to us, and we offer flexible work arrangements to accommodate your needs.
• Wellness Programs: Employee wellness programs, including fitness initiatives and mental health support.
• Employee Assistance Program (EAP): Confidential counseling and support services for personal or work-related issues.
• Employee Recognition: Recognition programs to celebrate and reward outstanding contributions.