Developing a fidelity measure of early intervention programs for children with neuromotor disorders

Mihee An, Department of Physical Therapy, Kaya University, Gimhae, Republic of Korea.
Jayden Nord, Nebraska Center for Research on Children, Youth, Families and Schools, University of Nebraska, Lincoln, NE, USA.
Natalie A. Koziol, Nebraska Center for Research on Children, Youth, Families and Schools, University of Nebraska, Lincoln, NE, USA.
Stacey C. Dusing, Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, USA.
Audrey E. Kane, Department of Physical Therapy, Virginia Commonwealth University, Richmond, VA, USA.
Michele A. Lobo, Department of Physical Therapy, University of Delaware, Newark, DE, USA.
Sarah W. Mccoy, Department of Physical Therapy, University of Washington, Seattle, WA, USA.
Regina T. Harbourne, Department of Physical Therapy, Duquesne University, Pittsburgh, PA, USA.

Abstract

AIM: To describe the development of an intervention-specific fidelity measure and its utilization and to determine whether the newly developed Sitting Together and Reaching to Play (START-Play) intervention was implemented as intended. Also, to quantify differences between START-Play and usual early intervention (uEI) services. METHOD: A fidelity measure for the START-Play intervention was developed for children with neuromotor disorders by: (1) identifying key intervention components, (2) establishing a measurement coding system, and (3) testing the reliability of instrument scores. After establishing acceptable interrater reliability, 103 intervention videos from the START-Play randomized controlled trial were coded and compared between the START-Play and uEI groups to measure five dimensions of START-Play fidelity, including adherence, dosage, quality of intervention, participant responsiveness, and program differentiation. RESULTS: Fifteen fidelity variables out of 17 had good to excellent interrater reliability evidence with intraclass correlation coefficients (ICCs) ranging from 0.77 to 0.95. The START-Play therapists met the criteria for acceptable fidelity of the intervention (rates of START-Play key component use ≥0.8; quality ratings ≥3 [on a scale of 1-4]). The START-Play and uEI groups differed significantly in rates of START-Play key component use and quality ratings. INTERPRETATION: The START-Play fidelity measure successfully quantified key components of the START-Play intervention, serving to differentiate START-Play from uEI.