Implementation Evaluation of Evidence-Based Substance Use Prevention Programs in Middle Schools

Presentation Abstract:

The success of an evidenced-based program is dependent on the implementation process; even an effective evidenced-based program cannot overcome a poor implementation. This mixed methods research study seeks to evaluate the influence of implementation on the effectiveness, fidelity, and community fit of two evidence-based prevention programs within the school setting. The individual paper presentation will include an overview of the EBPs examined, discussion of methodologies employed, evaluation of implementation techniques compared to individual program’s outcomes and a discussion of balancing evidenced-based program’s fit and fidelity.

Introduction:

Utilization of evidenced-based programs has become the industry standard, but the outcomes of evidenced-based programs within the community is lagging behind the success found in the research setting. To explain this research-to-practice gap, translational science and implementation evaluation of evidenced-based programs has emerged. Fixsen et al. developed a comprehensive framework to guide the successful implementation of evidenced-based programs. Based on this framework and the NIDA prevention principles for drug use among children and adolescents, this mixed methods study evaluated the implementation of two evidenced-based programs.

Methods:

This study utilized both qualitative and quantitative research methods to conduct a procedural evaluation of the implementation of two substance use school-based prevention programs in the Southern United States. This study conducted program observations, student program knowledge assessments, in-depth key stakeholder interviews, and parent surveys to evaluate the implementation, outcomes, fit, and fidelity of the evidenced-based programs. This research is theorized in the implementation framework and drivers established by Fixsen and colleagues and the NIDA prevention principles for drug use among children and adolescents.

Results:

This study will assess the influences of implementation on a program’s fidelity, outcomes, and effectiveness. The results will discuss the comparison of the evidenced-based program’s fit to the program’s fidelity and how this balance can be achieved while generating the greatest program outcomes.

Conclusions:

Based on the findings, we hope to provide recommendations for improvement of evidence-based program’s implementation. Results will contribute to the understanding of how a program’s implementation impacts the outcomes. The results will help to narrow the research-to-practice gap within the field of public health prevention research.