SYMPOSIUM 1

Addressing Implementation and Effectiveness in WSPA Research

11.30am - 11.40am


Highlighted Speaker: Jo Salmon and Natalie Lander

Chair: Anna Chalkley

Research on whole school physical activity encompasses studies that focus on both implementation strategies and effectiveness evaluations. The traditional research pipeline encourages a staged approach to moving an intervention from efficacy trials to the real world which can take a long time. This session will include examples from the blending of design components to simultaneously measure outcomes of implementation and effectiveness when conducting research relevant to school-based physical activity.  Insight will be shared to identify best practices and strategies that promote sustained implementation and physical activity engagement while maximizing positive outcomes across multiple domains within the school environment. 

Symposium Presentations

  • TransformUs was first developed in 2009 to address low levels of physical activity and high levels of sedentary behaviour among Australian primary school children, particularly during school hours. The program focuses on a whole-of-school approach and provides professional learning to classroom teachers to deliver their usual curriculum in active ways (eg, active breaks, active lessons, health lessons, active homework) as well providing a supportive school environment within and outside the classroom. Parents also received newsletters that aligned with the health lessons in the classroom. After a successful RCT which demonstrated reductions in children’s sedentary time, increases in physical activity and lower adiposity and other health markers compared to usual practice, TransformUs was adapted to be offered at-scale to all 1400+ primary schools across the state of Victoria. A hybrid effectiveness-implementation trial was funded to test the real-world effectiveness of the program when delivered in the ‘real world’ as well as determining the implementation of the program at scale. This presentation will focus on the rationale for the research design selected for demonstrating effectiveness and implementation at scale, and the measures used in both studies. Preliminary findings from both trials will also be presented.

  • Introduction: Physical activity has been highlighted as one of the main determinants of health in school-aged youth. It has been observed that youth spend most of their time in sedentary behaviours during the school day. Therefore, the educational environment is an interesting framework for increasing levels of physical activity (PA). This study reports on the methods and rationale of the MOVESCHOOL study, a whole-school approach to develop a multicomponent intervention programme based on the inclusion of PA during the school day, to evaluate the effects on PA, health, educational and cognitive markers. Methods: For this purpose, a controlled trial will be carried out. It is estimated that 10 schools and around 800 students of 7th, 8th and 9th grade from two Spanish provinces will participate. Five schools will be allocated to the control group and the remaining five to the experimental group. The intervention will last 26 weeks and will consist of three components: 1) inclusion of a methodology of physically active learning in one lesson per week; 2) development of two daily 4-minutes active breaks; and 3) implementation of daily active recess. Before and after the intervention, PA and sedentary time will be assessed through accelerometry, health-related fitness levels through field tests and anthropometry, academic performance through school grades, positive health via questionnaire and cognitive parameters through specific cognition tests. In parallel, a qualitative study will also be carried out, which aims to assess the acceptability and feasibility of the intervention, based on the teachers' perception of the intervention programme. Discussion: This study aims to become a whole-school PA approach of reference at national level with potential to increase levels of PA, reduce sedentary time and, therefore, improve academic performance and wellbeing for their students.

  • Project Description: This presentation will be an overview of my PhD - focusing on how we are evaluating the implementation and impact of the CAS programme in Bradford. This includes discussions on the research aims and questions, research design (mixed methods) and overall outcomes. Impact: Longitudinal impacts of CAS will be discussed; Organisational changes to physical activity provision at 9 months of implementation and 2 years, Ripple Effect Mapping of the intended and unintended impacts of implementing CAS, Physical activity change across two years. Learning: An overview of all findings will be shared. In addition, findings from the REM maps will be used to develop an implementation scale so that we can share how the level of implementation effects the effectiveness of CAS (organisational level change and physical activity).

  • Program Description: Our overarching project goals were to develop and test an implementation strategy to support physically active learning in US elementary schools. Because physically active learning is an evidence-based approach for improving student’s physical activity, our work used a Hybrid Type II approach, meaning we focused on both implementation and effectiveness outcomes. Our effectiveness outcomes included examining student physical activity levels, academics, and behavior. Our implementation outcomes focused on implementation fidelity of physically active learning approaches. In addition, we examined the whole-school approach of physical activity and determinants of teacher implementation behaviors. We used our formative work, implementation planning process, partner input, and the RE-AIM framework to guide evaluation outcomes. The purpose of this presentation is to share perspectives for identifying, prioritizing, and examining outcomes for evaluating school-based physical activity approaches. Impact and Learning From our formative work we learned about the importance of assessing effectiveness outcomes that extend beyond examining physical activity levels of students. These include: 1) academic- (e.g., learning readiness); 2) social emotional- (e.g., social skills); and 3) instruction-related outcomes (e.g., teacher-student relationships). We also learned about the importance of examining the whole-school approach for physical activity to gain a broader understanding about the opportunities provided in schools. To assess implementation, we created a comprehensive fidelity assessment, which included examining the dose, adherence, and quality of using physically active learning approaches. We also focused assessments on teacher-centered drivers of implementation behaviors (e.g., knowledge, attitudes, self-efficacy, and leadership support). Given the numerous outcomes, we organized them using RE-AIM, and leveraged partner input to help prioritize them. Gaining a better understanding of outcomes relevant to school partners, and implementation-related outcomes to help understand why opportunities are implemented (or not) can help advance efforts to expand the use of physical activity approaches provided in schools.