Abstract: Conducting Real-World Randomised Controlled Trials of Innovative Programs Designed to Prevent Children's Pathways into Crime: Challenges and Lessons (Society for Prevention Research 23rd Annual Meeting)

144 Conducting Real-World Randomised Controlled Trials of Innovative Programs Designed to Prevent Children's Pathways into Crime: Challenges and Lessons

Schedule:
Wednesday, May 27, 2015
Columbia A/B (Hyatt Regency Washington)
* noted as presenting author
Nick Axford, PhD, Senior Researcher, The Social Research Unit, Dartington, Dartington, United Kingdom
Tim Hobbs, PhD, Head of Analytics, Social Research Unit at Dartington, Dartington, United Kingdom
Sarah Heilmann, PhD, Postdoctoral Research Fellow, Socila Research Unit at Dartington, London, United Kingdom
Georgina Warner, PhD, Postdoctoral Research Fellow, Social Research Unit at Dartington, London, United Kingdom
Catherine Erskine, BSc (Hons), Researcher, Social Research Unit at Dartington, London, United Kingdom
Luke Timmons, BSc (Hons), Researcher, Social Research Unit at Dartington, Glasgow, United Kingdom
Laura Whybra, BSc (Hons), Researcher, Social Research Unit at Dartington, London, United Kingdom
Tom Wilkinson, BSc (Hons), Researcher, Social Research Unit at Dartington, Dartington, United Kingdom
Introduction

The BIG Lottery Fund’s Realising Ambition project in the UK seeks to build the evidence base for what works to prevent youth offending by replicating interventions with either proven or preliminary evidence of impact. It involves a £25m investment over five years in 25 interventions designed to divert 8-14 year olds away from pathways into crime.

Methods

As part of Realising Ambition, the Social Research Unit is supporting the programs through intervention refinement, advice regarding replication, and rigorous evaluation. Four interventions have been selected for evaluation. These include two mentoring programs (delivered by Chance UK and YMCA Scotland), a parenting program (delivered by Malachi Community Trust) and a school-based multi-media resource (designed by Ariel Trust).

Trial protocols have been established for two of the evaluations; both are two-arm, randomised controlled, parallel group, superiority trials. Intervention refinement and evaluation design are underway with the other two programs. This paper describes the work undertaken to date and critically reflects on the challenges encountered and lessons learnt about how they may be addressed.

Results

As well as contributing to the evidence base of early intervention programs in the UK, the project offers the opportunity to demonstrate that using RCTs to evaluate social interventions in the real world is both achievable and valid. However, there are many challenges. In this project these have included: securing buy-in to an RCT from relevant stakeholders; articulating the intervention logic model to ensure that appropriate outcome measures are selected; refining and testing the intervention to ensure it is feasible and has the potential to achieve desired outcomes; aligning the sample size needed to provide confidence in results with the organization’s operational capacity; fitting randomization into operational procedures of the organization; and managing the expectations of all involved.

Conclusions

Despite the challenges, the project demonstrates how voluntary organisations can be helped to improve the standard of evidence supporting the impact of their programs on child outcomes.