Evaluation of Pennsylvania ’s Keystone STARS Quality Rating System

in Child Care Settings

December 2006

 

Executive Summary

Child care in Pennsylvania serves more than 300,000 children, and is the largest program helping to prepare Pennsylvania ’s young children for school. Recognizing the importance of quality early learning to a child’s future success in school and in life, Pennsylvania commissioned a study in 2002 to evaluate the quality of early care and education in Pennsylvania and create a baseline for upcoming quality improvement initiatives. Results showed that there was a steady decline in quality in early care settings since the mid-1990’s and that the quality in most child care settings was adequate at best. Also in 2002, Pennsylvania began a pilot of the Keystone STARS Quality Rating System to rate the quality of early care programs and to provide child care programs with targeted financial assistance, professional development, and other supports in order to improve quality. The primary purpose of this study is to determine if the Keystone STARS program is improving quality in participating child care programs and to determine if Keystone STARS is reversing the decline of quality in child care in Pennsylvania that was so evident in the late 1990’s.

 

Data were collected from 356 child care centers, 81 group child day care homes, and 135 family child day care homes, for a total of 572 sites. Programs were assessed using the Early Childhood Environment Rating Scale – Revised (ECERS-R) for center-based programs or the Family Day Care Rating Scale (FDCRS) for home-based programs. The scales score a variety of items on a 1-7 rating with: 1 = inadequate, 3 = minimal, 5 = good, and 7 = excellent. These instruments are widely used in the early childhood field to determine the quality of early learning programs for research and program improvement (www.fpg.unc.edu/~ecers/).

 

Results clearly indicate that Keystone STARS helps child care programs improve their overall quality. Further, Keystone STARS is reversing the negative trend in child care quality that was evident in the late 1990’s. Today, child care programs are operating at a much higher quality level because of the Keystone STARS program. Results also reinforced the findings of the 2002 study that use of a defined curriculum and teachers with college degrees positively affect quality in early care and education programs.

 

Major Findings:

·          There is sufficient evidence to support the Keystone STARS Quality Rating System as a reliable indicator of quality. Both centers and home-based child care practitioners with higher STAR ratings had consistently higher scores on the Environmental Rating Scales (ERS).  Progression through the STARS system appears to be a reliable predictor of attaining higher quality at the sites.

·          Child care quality is improving. Between 1996 (4.50) and 2002 (3.90), the average ERS scores dropped significantly, indicating a declining trend in quality. The average ERS scores for child care centers assessed in 2006 for sites not participating in STARS (3.94) indicate that the trend of declining quality in child care has been reversed.

·          Keystone STARS continues to improve quality in child care centers. Child care centers participating in Keystone STARS in 2006 have higher quality than the Pennsylvania average for child care centers and are showing higher quality now than at the inception of the STARS program. Overall ERS scores range from 4.11 for child care centers at Start with STARS to 5.42 for STAR 4 programs.

·          Child care centers at the STAR 3 and STAR 4 levels have significantly higher Overall ECERS scores than centers not enrolled in the Keystone STARS system or at the Start with STARS level.

·          Child care centers at the STAR 4 level have consistently higher scores on all subscales of the ECERS than all other child care centers.

·          Programs with a defined curriculum have higher quality. Child care centers with a defined curriculum scored significantly higher on the Overall ECERS score. Family child care practitioners with a defined curriculum also scored significantly higher on the Overall FDCRS score.

·          Teachers with college degrees provide higher quality early education and care. Both child care centers and family child care homes, regardless of STAR level, had significantly higher scores on the ERS when the teacher had at least an Associate’s Degree.

·          Teachers with at least five years of experience had significantly higher ERS scores than those with less experience.

·          Family child care practitioners with more than 20 years experience had higher scores on the FDCRS in all areas except Basic Care.

·          Family child care practitioners who met at least minimum professional development requirements had significantly higher Overall FDCRS scores.

 

Keystone STARS is increasing access to quality early learning experiences for young children in the Commonwealth. Findings from this evaluation suggest that the quality improvements in part may be attributed to Keystone STARS’ emphasis on staff education; staff participation in ongoing professional development; and use of a curriculum in addition to the program’s general focus on helping practitioners support children’s early learning and development. Keystone STARS is keeping Pennsylvania ’s Promise for Children by helping Pennsylvania ’s families and communities provide for, protect, nurture, and teach our young children.