Introduction
Research Questions
- What are the most pressing facilitation needs and challenges for HMRE programs for youth?
- What aspects of the training content, format, and associated tools did facilitators and supervisors think worked well? What did they find challenging to use or implement?
- What improvements did facilitators and supervisors suggest for the training content, methods, and materials for future replication?
- Did the use of these facilitation strategies affect youth engagement?
- What lessons were learned from using the formative evaluation process for testing and improving facilitation training for HMRE programs?
âHigh quality facilitators are necessary for the success of group-based educational and prevention programs for youth. Facilitators affect how students engage with and absorb a program’s content, which in turn affects what students learn from the program. Research indicates that effective group facilitators understand the needs of participants, meet them where they are, and address their needs in the teaching environment, such as through participant-centered facilitation.
This study sought to identify strategies to support high quality facilitation in healthy marriage and relationship education (HMRE) programs for youth. To conduct the study, the Administration for Children and Families (ACF) in the U.S. Department of Health and Human Services funded Mathematica and its partner, Public Strategies, to develop and conduct a formative evaluation of a facilitation skills training curriculum for HMRE program staff. Working in collaboration with program staff from two community-based organizations—Catholic Charities of Wayne County in New York and Youth and Family Services in South Dakota—members of the study team sought to identify the facilitation needs and challenges of HMRE programs for youth and then iteratively develop and refine a facilitation skills training curriculum that addressed these needs and challenges.
The curriculum provides content on the following topics:
- Managing Energy: Facilitators are introduced to the energy cycle and how it directly affects youths’ abilities to engage and learn. Facilitators learn tips and techniques for managing and resetting energy in the classroom.
- Debriefing and Drawing Out Teachable Moments: Facilitators are trained to effectively use debriefing skills to guide group discussions and highlight the insights, connections, and interpretations that arise from these discussions. Using these strategies can help facilitators increases their ability to effectively debrief activities and to draw out insights and learning points form youth.
- Building Trust and Challenging the Comfort Zone: Facilitators learn strategies for building and maintaining trust with and among youth in a group learning environment.
The curriculum and supporting resources can be accessed through the links below:â
Strengthening Facilitation Skills Curriculum Overview (PDF)
This two-page document provides a general overview of the content of the curriculum and an outline of the accompanying materials.
ââ
Strengthening Facilitation Skills Training Slides (PDF)
The trainer can use these slides when delivering the curriculum content to program facilitators, who can also use them for note-taking.
â
Supplementary Materials: Tips and Tools for Using the Curriculum (PDF)
These materials include tip sheets, checklists, handouts, and observation protocols for use by supervisors and facilitators to accompany the trainer’s guides and slides.
Strengthening Facilitation Skills Trainer’s Guide (PDF)
This document serves as a detailed roadmap for the trainer to use when training facilitators to improve their facilitation quality and skills for engaging with youth in the classroom.
Tip Sheets
For those who cannot take the full training, or as a supplement for those who can, these three tip sheets provide key lessons from each module of the curriculum.
Purpose
This report describes the design of the formative evaluation, as well as the process the study team used for identifying the facilitation training needs and developing the training curriculum. The report also describes the process of implementing and refining each training topic, and key findings and lessons learned through the process of using a formative evaluation to improve programming. Mathematica and Public Strategies conducted the evaluation as part of the broader Strengthening Relationship Education and Marriage Services (STREAMS) evaluation for ACF.
Key Findings and Highlights
- Facilitation skills training is limited or nonexistent among most providers of HMRE programming for youth.
- Staff from the two programs in this study felt that facilitators could especially benefit from training in (1) how to manage and reset energy in the classroom, (2) how to deepen learning through debriefing, and (3) how to build trust and safety while challenging students’ comfort zones.
- Staff from both programs found value in the trainings delivered by the study team and provided useful feedback for improvements.
- Facilitators said that after completing the trainings, they felt better prepared to deepen connections with their students, manage and reset energy in the classroom, and work towards building an environment of trust for youth.
- Facilitators indicated that intentional planning and integrating concrete strategies and tools helped them feel more confident in the classroom and increased their engagement with youth.
Methods
The study team used a formative evaluation design guided by the Learn, Innovate, Improve (LI2) framework. The design involved identifying HMRE practitioners to participate in the evaluation, conducting an in-depth assessment of their programs, and collaborating with them to develop and test the new training curriculum. The team collected data through interviews with program facilitators and supervisors, observations of program facilitators, debriefing discussions with program staff, and surveys of youth program participants.
Recommendations
The study resulted in a new, research-based training curriculum on facilitation skills for organizations that provide HMRE and similar types of group-based educational and prevention programs for youth. The curriculum, including slides and supplemental tools, is designed for use by program staff such as supervisors and facilitators who are looking to enhance facilitation quality and improve engagement in youth programming. Future research could examine the impacts of the curriculum on facilitation quality, levels of engagement with programming, and youth outcomes.
The study also yielded important lessons for formatively testing, improving, and packaging a facilitation training curriculum for use by other youth-serving organizations, and identifying areas for further study. While this evaluation had the specific purpose of developing a facilitation training curriculum for HMRE program facilitators, the methods described in this report could apply equally well to a range of programs and in any number of settings. Key elements to the success of this formative evaluation were (1) a strong partnership with community-based organizations based on early trust-building and knowledge-sharing activities, (2) the research and substantive expertise that went into developing and implementing the facilitation training curriculum, (3) an expert trainer to guide and support the development process, and (4) an evidence-informed and well-defined yet flexible formative evaluation framework.
Citation
Asheer, S., Knab, J., Eddins, K., Welch, E., and Goesling, B. (2022). Co-Creating a Facilitation Training Curriculum: A Formative Evaluation. OPRE Report No. 2022-150. Washington, DC: Office of Planning, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
Related Documents
| File Type | File Name | File Size | Strengthening Facilitation Skills Training: Strengthening Facilitation Skills with Youth | 2,345.92 KB | Strengthening Facilitation Skills: Overview | 340.35 KB | Strengthening Facilitation Skills with Youth: Supplementary Materials | 1,478.51 KB | Strengthening Facilitation Skills with Youth: A Trainer’s Guide | 6,780.11 KB | Strategies for Debriefing in the Classroom: Tip Sheet | 165.37 KB | Strategies for Managing Energy in the Classroom: Tip Sheet | 165.14 KB | Strategies for Building Trust in the Classroom: Tip Sheet | 169.84 KB |
|---|