Enhancing Outcomes Through Evaluation of Fidelity: A Case Study on a Statewide Implementation of Check & Connect

Abstract

This dissertation investigates the role of evaluation in supporting the fidelity of the Check & Connect (C&C) program implementation. Focusing on a statewide implementation of C&C, this study aims to understand how evaluation procedures are integrated and their benefits to program staff and students. Utilizing a case study design, this research explores how the National Implementation Research Network (NIRN) framework guides the implementation and evaluation process. Data collection methods included interviews with key stakeholders, focus groups with coordinators, and analysis of state-level documents and evaluation data.The findings highlight that fidelity of implementation was achieved through structured evaluation tools and continuous support mechanisms. These tools facilitated ongoing improvements and adaptations within the schools, revealing the critical role of program coordinators in ensuring fidelity and providing necessary mentor support. Challenges included variations in local contexts and the need for ongoing training and technical assistance. The study underscores the importance of understanding the purpose of evaluation tools at all levels and highlights the dual roles of coordinators as both evaluators and supporters, which presented unique challenges. Key results show that sustained use of fidelity tools led to improvements in mentor practices. The integration of evaluation data into professional development and coaching discussions was essential for identifying barriers and informing ongoing training needs. Additionally, the study found that achieving high fidelity requires time, consistent effort, and supportive infrastructure, with improvements observed over the five-year implementation period. This research contributes to the theoretical understanding of implementation science by validating the NIRN framework's applicability in educational settings. It provides practical recommendations for educators and policymakers on implementing evidence-based programs effectively. The study calls for further research on the long-term impacts and strategies to sustain high-fidelity implementation across diverse educational contexts. Ultimately, this dissertation underscores the critical role of structured evaluation in maintaining program fidelity and enhancing educational interventions' effectiveness.