All-Stars maintain a robust program evaluation system throughout the program year, supported by a comprehensive data management plan.  Both are reflective of the priorities of our program design and aim to measure the impact & quality of virtually every program component we offer.  Below is a summary of the various tools of this evaluation system and a listing of our data management assets.  On the following pages are the examples of each tool.

Evaluation Tools

Professional Development Review (PDR) – a semi-annual staff performance review of all full-time staff members, including a self-review and a manager review, covering job performance and organizational values, focusing on the development and professional growth of each staff member.

Site Design Review (SDR) – a regular general review of program sites, focusing on foundational components (operations, compliance, and environment) and program components (academics, enrichment, and sports & fitness), used to inform training needs & site supervisor development and insure program consistency throughout the organization. Results of this review are captured and analyzed in an internal, online database, which informs our training to address areas of organizational or school site-specific weakness.

Surveys – semi-annual and annual tools used to measure stakeholder opinion:

Parent Survey – annual collection of parent feedback
Principal Survey – semi-annual collection of administration feedback
Student Surveys – annual and collection of participant feedback:
Annual Program Survey – year end reflections
Entourage Survey – participant survey after each service project & final evaluation
Transition Survey – participant survey after each session & final evaluation

Student Data Collection - in coordination with the district, in order to measure program impact:

Daily school attendance – compare ASAS students with school average
API Scores – compare ASAS students with school average
ELL Conversion rates – compare ASAS students with school average
Fitness Tests – regularly administered health & fitness tests to measure internal fitness gains
Pre- & Post-basic skills tests – administered regularly throughout the school year to track progress on targeted skills in math, literacy, and ELD to measure internal student growth

Database Systems

Donor Database (Contact Beacon)
Purpose: To track donor solicitation, communication & gifts

Site Evaluation Database (Athena)
Purpose: Replaces QAS, tracks performance of all program elements, supports staff evaluation and training design, tracks student impact of ALL program components

Staff Database (Athena)
Purpose: Track all site staff, history, skills, notes, back-up of personnel file; track current applications for placement and follow-up purposes

Attendance Database (Cityspan)
Purpose: To track daily site attendance and site participant demographics

Please contact Kelly Kirk at kkirk@bayallstars.org with any questions.