Article

Evaluation of the Implementation Fidelity of a Special Education Teacher’s Use of Modified Dialogic Reading: A Case Study

강정애1, 홍이레2,*
Jeongae Kang1, Ee Rea Hong2,*
Author Information & Copyright
1일리노이 주립 대학교 특수교육과
2백석대학교 특수교육과
1Illinois State University Special Education
2Baekseok University Special Education
*홍이레(교신저자) : Baekseok University Special Education(irehong86@bu.ac.kr)

ⓒ Copyright 2023, The Daesoon Academy of Sciences. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Mar 19, 2023; Revised: Apr 12, 2023; Accepted: Apr 18, 2023

Published Online: Apr 30, 2023

Abstract

The purpose of this study is to examine the effects of professional development (PD) on a special education teacher’s use of modified dialogic reading (MDR) in fidelity. In this study, we provided a two-hour PD and ongoing coaching to prepare a special education teacher’s use of MDR as intended. We measured the teacher’s fidelity of MDR implementation while teaching four students with autism spectrum disorder (ASD). A case study design was utilized, and it included baseline, intervention, and maintenance phases. The findings of this study showed that the PD package promoted the teacher’s use of MDR and maintained the skills with higher level of fidelity. However, the teacher’s implementation in fidelity for certain MDR components was variable across the students. By examining the effects of PD on the teacher’s use of MDR, The findings of this study advanced the field’s current knowledge of how to prepare teachers to use EBPs. More research is needed to generalize the findings of this study.

Abstract

본 연구의 목적은 코칭을 접목한 교사훈련이 특수교사가 자폐스펙트럼장애 학생에게 수정된 대화식 읽기 기법 훈련을 적용할 때 교사의 중재충실도에 미치는 영향을 알아보기 위해 실시되었다. 연구대상은 한 명의 특수교사와 네 명의 자폐스펙트럼장애 학생이다. 본 연구는 사례연구를 적용하였으며, 기초선, 중재, 유지의 순서로 진행되었다. 연구에 참여한 특수교사의 수정된 대화식 읽기 기법 훈련의 정확한 적용을 위해 2시간의 교사훈련과 지속적인 코칭 및 피드백을 제공하였다. 연구 결과 중재 중 그리고 중재가 종료된 이후에도 특수교사는 수정된 대화식 읽기 기법 훈련을 적용함에 있어서 지속적으로 높은 중재충실도를 보였다. 하지만 동시에 교사의 중재충실도가 학생 간 약간의 상이함이 있음을 관찰할 수 있었다. 이 연구를 통해 코칭이 접목된 교사훈련이 자폐스펙트럼장애 아동의 읽고 쓰는 기술을 가르치는 특수교사의 교수에 있어서 효과적인 방법임을 알 수 있었다.

Keywords: 중재충실도; 특수교사; 수정된 대화식 읽기 기법; 함께 읽기; 자폐스펙트럼장애
Keywords: implementation fidelity; special education teacher; modified dialogic reading; shared reading; autism spectrum disorder

I. Introduction

Autism spectrum disorders (ASD) refers to an umbrella neurodevelopmental disorder spectrum (American Psychiatric Association [APA], 2013). The most recent estimate shows that 1 in 54 children was diagnosed with ASD in 2016 (Maenner, 2023). This estimate is two times higher than the one in 2000, 1 in 150 children (CDC). Such increase in the prevalence of ASD has intensified the demands to support the needs of students with ASD.

Literacy plays a critical role in the life success of children with ASD. However, previous research consistently shows that students with ASD demonstrate difficulties in reading comprehension. Scholars in the field explain the difficulties are resulted from the lack of oral language skills and their unique cognitive profile. It is well documented that students with ASD are known as having relatively higher decoding abilities and lower level of reading comprehension (Chiang & Lin, 2007). Given that proficient readers require a higher level of decoding and language comprehension (Gough & Turner, 1986), it is not surprising why students with ASD hardly become proficient readers. In addition, students with ASD are described as having unique cognitive profiles, including the lack of joint attention and dysfunctioning theory of mind (ToM), which negatively impacts their reading comprehension (Williamson et al., 2012). Not being able to keep up with the attention of others hinders students with ASD from not only having enriched vocabulary but also transitioning from emergent readers to more interactive or independent readers (Kadervek & Rabidoux, 2004). Furthermore, impaired ToM hinders individuals with ASD from engaging in social activities or sharing experiences because they have challenges in understanding others’ perspectives and emotions (Baron-Cohen et al., 1985). Given the substantial negative effects of limited oral language skills and impairments of ToM of children with ASD, it is evident that special education teachers need to use effective strategies that address these two factors: joint attention and ToM.

Dialogic reading (DR) is an instructional technique that helps young children to become an active storyteller while interacting with teachers during the reading (Whitehurst & Lonigan, 1998). DR starts with the teacher’s questions that facilitate the child’s thinking process about the text and come to their own interpretation. Then, the teacher evaluates the student response, expands on the student’s understanding, and repeats the reading process as necessary. DR encourages the student to engage and actively participate in the reading process. To guide student responses, DR uses a specific type of questions (i.e., CROWD: completion, recall, open-ended, wh-questions, and distancing) within the instructional procedure (PEER: Prompt, Evaluate, Expand, and Repeat) (Whitehurst & Lonigan, 1998). DR demonstrates substantial and significant effects in improving young children’s oral language skills, vocabulary, print knowledge listening comprehension and supporting children with language impairments become active storytellers (Dickinson & Smith, 1994; National Early Literacy Panel [NELP], 2008; Whitehurst & Lonigan, 1998). While DR is recognized as an effective strategy to improve students’ oral language development, it did not provide specific tools for securing students’ joint attention, which is critical for young readers to transit to more independent readers. In the interactive to independent literacy model, Kadervek and Rabidoux(2004) posit that without securing the joint attention, young readers cannot engage in literacy activities. In addition to joint attention, for students with ASD, incorporating strategies that facilitate functioning ToM is needed.

The purpose of modified dialogic reading (MDR) is to maximize academic and communicative needs of students with ASD. MDR integrates three different Evidence-based Practices (EBPs): DR, visual support, and systematic prompt (see Figure 1) (Whalon et al., 2015). To acknowledge and motivate student participation, in MDR, adult readers prompt CROWD plus wh-inference or emotion questions within PEEP instructional sequence (Prompt, Evaluate, Expand, Praise [PEEP]). While DR is an EBP that shows effects on oral language skills of students with language impairments and (What Works Clearinghouse [WWC], 2015), visual supports and prompts are the ones that demonstrate strong effects on changing behaviors of students with ASD (Wong et al., 2014). These three strategies are EBPs that special education teachers feel comfortable using in their classrooms (Accardo & Finnegan, 2019). Three existing studies show positive effects of MDR on students with ASD (e.g., Fleury et al. 2016; Whalon, 2015, 2016). Whalon et al. (2015, 2016) have researchers or caregivers implement MDR and showed significant effects on the listening comprehension of students with ASD. Fluery et al. (2016) had paraeducators implement MDR to students with ASD and showed its large effects on listening comprehension. Despite its positive effects on students with ASD, none of these studies were not implemented by teachers. Given that teachers are critical indicators for student outcomes (National Institute of Child Health and Human Development [NICHD], 2000), we need to know more about how accurately teachers can implement MDR with students with ASD.

jbas-10-1-23-g1
Figure 1. MDR Components & Question Cards
Download Original Figure

Implementation fidelity is the extend to using EBPs as intended. Given its critical role to maximize the effects of EBPs (Cook & Cook, 2013), it is logical to provide supports for teachers to improve the correct use of EBPs. Furthermore, the lack of knowledge of how to maintain and generalize skills is known as one of the reasons why teachers do not use EBPs (Cho & Oh, 2016; Scheeler et al., 2016). Professional development (PD) plays a decisive role in supporting teachers’ use of EBPs in fidelity (National Reading Council [NRC], 2001). However, one-time PD showed limited effects on supporting teachers using EBPs (e.g., Hall et al., 2010) because of the lack of reinforcement available to the teachers. In response, multiple scholars (e.g., Fixsen et al., 2005; Kretlow & Bartholomew, 2010; Shin, Park, & Lee, 2021) highlighted providing ongoing support in addition to the one-time PD as a package for teachers to not only transfer their course knowledge into practice but also sustain their skills. To facilitate this process, teachers need at least 20 hours of contact time through a variety of PD formats, including workshops, lectures, and ongoing coaching (Desmione, 2009; Joyce & Showers, 1982; Leko & Brownell, 2009).

Although we know PD and coaching are essential in guiding teachers to use of EBPs, little information is available on teachers using MDR and related support for them. To fill the gap in the literature, the purpose of this study is to examine the effects of PD and ongoing coaching on a special education teacher’s use of MDR in fidelity. The following research questions used to guide this study: How did a MDR PD package impact the special teacher’s correct use of MDR with students with ASD?

II. Methods

1. Settings

This study took place in a self-contained classroom of a private school in the Southeastern metropolitan of the United States. The classroom targets PK to 1st grade students with ASD. Students came to this classroom for their daily reading instructions for 15 to 20 minutes. The classroom had a carpet area for small group readings, including MDR sessions.

2. Participants

This current study includes one special education teacher as a participant. The special education teacher, Melinda(pseudonym), was a Hispanic/Latino female and in her early 40s. Melinda earned a Bachelor of Science in Elementary Education from abroad and a Master of Science in speech therapy. Melinda was certified as a cross-categorical special education teacher and had more than ten years of teaching experience as a special education teacher. She decided to participate in this study since her students were struggling with reading comprehension and communications. She reported that she did not have any previous training related to MDR.

Four students participated in this study as a student participant, and all of them were diagnosed with ASD. Tom was 6.2 years old African-American boy and received speech therapy. He engaged in impulsive behaviors, so Melinda developed a behavioral intervention plan for Tom at the time of his participation in this study. Grace was 4.0 years old Hispanic girl and received speech therapy. She showed difficulty in expressive communication, interpersonal skills, and turn taking. Kevis was 7.4 years old Caucasian boy and received speech therapy. He had limited attentive skills, and this lack of skills led him to difficulty in following teacher’s instructions. Leo was 7.0 years old Caucasian boy and received speech therapy. He showed limited attention and lack of comprehension skills in abstract concepts.

3. Research Design

The current study is a sub-project of a large intervention study that focuses on the effects of MDR on student outcomes. In the intervention study (Kang et al., under review), students moved across three experimental phrases: baseline, intervention, and maintenance based on the changing criterion with five consecutive student reading comprehension data.

The purpose of this current study is to examine the effects of the PD package on the teacher’s use of MDR in fidelity while working with students with ASD. Different from the main intervention study (Kang et al., under review) is that this study only focuses on teacher’s fidelity of implementation. Fidelity plays a critical role in maximizing the intended student outcomes while using EBPs (Cook & Cook, 2013). To examine the effects of the PD package on the teacher’s implementation fidelity, we used a case study design by using multiple data sources. For example, we collected data on the teacher’s correct use of the MDR procedures while she was teaching students with ASD. Second, we conducted informal observations to gather contextual information. Case study design is appropriate to this study since it intends to “investigate a contemporary phenomenon in depth and within its real-content, especially when the boundaries between phenomenon and context are not clearly evident” (Yin, 2009, p. 18). It is challenging with one teacher participant to set up methodological rigor when using a multiple baseline design across multiple participants, which also demonstrates higher level of internal validity (WWC, 2015). There are some previous studies that took this stance as well (e.g., Cheek et al., 2002; Whalon et al., 2016).

4. Procedure

In the larger project, student participants received MDR with the focus of reading comprehension and initiation skills (Kang et al., under review). As its sub-project, the data collection of this study was conducted within three experimental phases, including baseline, intervention, and maintenance. Between baseline and intervention phases, the teacher received an initial PD training.

1) Baseline

During baseline, Melinda continued her typical reading lessons. Once any student participant demonstrated a stable therapeutic direction over five data points (Horner et al., 2005; Krotchwill et al., 2012), the student became the first student participant who needed to receive the MDR from the teacher. In this study, Tom entered the intervention phase at first.

2) Initial Training

Right before starting the MDR intervention with Tom, Melinda had a two-hour PD session (see Figure 2).

jbas-10-1-23-g2
Figure 2. Study Procedure
Download Original Figure
3) Intervention

Melinda started using MDR to student participants in the intervention phase. After Tom showed stable five consecutive data points in terms of level, variability, and trend, Melinda chose Grace to enter the intervention next. The same procedures were repeated for the rest of the students. During the intervention, Melinda received informal coaching as necessary from the primary researcher.

4) Maintenance

All of the student participants entered the maintenance at the same time when six data points were collected on Leo in the intervention phase. During the maintenance, the PD package was not available to Melinda. The effects of MDR training on teacher’s implementation fidelity was documented as present or not in the fidelity checklist and calculated as a percentage of accuracy (see Figure 2).

5. Materials

During intervention and maintenance phases, Melinda used 13 popular children’s trade books and matching question card sets to implement MDR.

1) Children Books

Before the intervention, Melinda and the primary researcher selected thirteen books using the following criteria: (a) age-appropriate topics, (b) appropriate for developing emergent literacy skills, (c) story content with colored illustrations, and (d) inclusion of new vocabulary (Hargrave & Sénéchal, 2000). The lengths of all selected books were about 15 pages.

2) Question Card Sets

Melinda used a total of thirty-four question sets, twenty-three question sets from Whalon et al. (2015), and 11 question sets developed by the primary researcher of this study. Each question set was expected to be used per session. Each question set included wh-inference and emotion questions and CROWD questions to support students’ ToM (e.g., making inferences, understanding feelings). Each question page had three possible answers with representative pictures made using Boardmaker software (see Figure 1). Some of the question pages included colored dots to prompt the teacher to facilitate students’ participation. For example, red dots marked with I prompted the teacher to use an intentional pause of three to five seconds before turning the page. Blue dots marked with J indicated the time for teachers to remind children to use their joint attention (e.g., [pointing out the picture] look!), while yellow dots marked with Q prompted the teacher’s use of question prompts (Whalon et al., 2015)(see Figure 1).

6. Dependent and Independent Variables
1) Dependent Variables
(1) Percentage of Teacher’s Fidelity of Implementation

To evaluate the effects of the PD package on the teacher’s use of MDR in fidelity, the primary researcher collected data on the implementation fidelity during the training and teaching students with ASD as well. Based on MDR elements (Whalon et al., 2015), the primary researcher created the fidelity checklist (Figure 3). The researcher used the fidelity checklist in monitoring the teacher’s fidelity of implementation throughout the study. When the teacher used each element as intended, the researcher recognized the occurrence as fidelity.

jbas-10-1-23-g3
Figure 3. Teacher Fidelity Checklist
Download Original Figure
2) Independent Variables

The independent variable was a PD package, consisting of an initial two-hour training and informal coaching.

(1) Initial Training

The initial training was intended to improve Melinda’s knowledge about MDR (e.g., using CROWD prompts, PEEP, systematic instruction, attention prompts, and intentional pause). The primary researcher provided direct instruction on how to implement MDR, integrating each component by using power point presentation and visual resources, including a visual map (Figure 4). During the initial training, Melinda had an opportunity to practice how to implement MDR procedures. The primary researcher provided the correct procedure via verbal feedback when her implementation deviated. When she reached 100% correct implementation, the training was over.

jbas-10-1-23-g4
Figure 4. MDR Visual Map
Download Original Figure
(2) Coaching

During the intervention, Melinda received ongoing informal coaching as necessary when the teacher fidelity checklist indicated potential issues with teacher implementation. The imformal coaching as a format of quick conversation took about 10 to 15 minites in the classroom after school. Each coaching session started with positive statements about her performance. Melinda watched video clips of her MDR implementation, and received positive, specific, and corrective feedback about her implementation. There were several times the first primary researcher of this study reminded her of the content from the initial PD. Each session ends with encouragement to continuously use the strategy during the reading session.

7. Interobserver Agreement

In this study, Melinda led 78 reading sessions. All sessions were video recorded and uploaded on a secured online data cloud system because (a) the primary researcher needed to analyze dependent variables, and (b) the authors need to check interobserver agreement (IOA). In this study, IOA on teacher’s fidelity of implementation was measured across all sessions. The IOA check began by training a second coder. The primary researcher trained a second coder to code sample videos using the fidelity checklist. IOA was calculated by dividing the total number of agreements between first and second coders by the total number of agreements and disagreements, which was then multiplied by 100 (Cooper et al., 2007). The IOA between the first and second coders during the training session was 100% across all phases. This is much higher than 80%, the criteria of the field required for IOA Cooper et al., 2007). Out of a total of 78 videos in this study, we calculated IOA for 28% (n=22) of videos across phases (i.e., baseline, intervention, maintenance). The primary researcher completed fidelity checklists for every session. The IOA between the coders were 97.55%, which met the criteria of acceptable IOA in the field (Cooper et al., 2007).

8. Social Validity

To investigate Melinda’s perceived effectiveness of PD on MDR, she was asked to complete a 10 question, 5-point Likert-scale (1 = strongly disagree, 5=strongly agree) social validity survey upon the completion of this study. Before completing the survey, Melinda watched selected video clips of her implemented MDR sessions on all phases: baseline, beginning and final interventions, and maintenance. Melinda was asked to response to the questions about: (a) the usefulness of PD package, (b) the impact of PD on teacher knowledge and instructional skills (c) the impacts of MDR on student participants’ targeting skills, including listening comprehension and initiation skills, and (d) the usability of PD.

Melinda strongly agreed that the 2-hour training and on- going coaching was useful for her classroom practice. Regarding the statements asking about her knowledge and confidence for this specific strategy, the teacher strongly agreed that she knew the steps to implement the strategy and she felt confident in implementing the reading strategy with her students. In response to the statement claiming that she would use this strategy in the future, she responded strongly agree. She also strongly agreed that she learned how to implement MDR easily and she felt confident in using MDR with her students. The teacher strongly agreed that she would continue to use MDR in her class.

9. Data Analysis

To examine the effects of PD package on the fidelity of implementation, mean percentage of implementation fidelity was calculated and analyzed across baseline, intervention, and maintenance phases. To do this, the following steps were enacted. First, we calculated the total number of MDR cycles per session, consisting of PEEP. In other words, we considered each MDR cycle as the moment that the teacher asked questions to the point when the teacher praised student participation. The total number of MDR cycles was used as the total number of opportunities for the teacher to implement each MDR component. Second, we counted the frequency of the teacher’s use of MDR components: (a) expanding student responses, (b) praising student participation, (c) using systematic instruction, (d) using joint attention, and (e) using intentional pause. The data were considered as the actual frequency of teacher’s implementation regarding each component. Given each reading session had varied lengths, frequency of each component was converted into a percentage. To calculate the percentage of teacher’s use a specific MDR component, we divided the frequency of each instructional component by the total number of MDR cycles of the session. Then we multiplied it by 100. The same procedure repeated across all MDR components (e.g., expanded student response, praising students). We also conducted two levels of visual analysis (e.g., within-phases and between-phases) to investigate the effects of the PD package on the teacher’s intervention implementation.

III. Results

In this MDR study, Melinda led 78 MDR sessions, including 32 sessions for Tom, 28 sessions for Grace, 29 sessions for Kevin, and 23 sessions for Leo. Depending on student schedules, each student had different group members.

1. Teacher’s Fidelity of Implementation

During baseline, Melinda hardly used MDR components except expanding student responses (range = 55.5% - 63.8%). Melinda hardly used praise (range = 26.2% - 30.5%), systematic instruction (range = 5.6% - 10%), attention prompts (range = 10% - 22.3%), and intentional pause (range = 0% - 11.2%) across students. Right after the PD, Melinda showed the fidelity of implementation data indicated high fidelity of teacher implementation during the intervention (84.4% - 100%) and the maintenance (82.3%-100%) phases. Right after an initial 2-hour PD, Melinda showed an immediate increase in the mean percent of using all MDR components to Tom from baseline to intervention: expanding student responses from 55.5% to 83.4%, using praise from 26.2 in baseline to 87%, systematic instruction from 10% to 92.2%, attention prompts 20% and 98.2%, and using intentional pause from 0% to 95.1%. Her implementation fidelity for Tom was consistent across Grace, Kevin, and Leo (see Table 1). During the maintenance across the four students, Melinda maintained high fidelity implementation, 100%, in using multiple MDR components across students.

Table 1. Percentage of Teacher’s Fidelity of Implementation across Students with ASD
Participants Procedures Baseline Intervention Maintenance
Tom Scripted questions NA 99.7% 100%
Expanding student’s response 55.5% 84.4% 98.4%
Praise 26.2% 87% 83.2%
Systematic instruction 10% 92.2% 88.8%
Attention prompts 20% 98.2% 100%
Intentional pause 0% 95.1% 100%
Grace Scripted questions NA 100% 100%
Expanding student’s response 63.8% 94.9% 94.6%
Praise 17.8% 87.1% 89.1%
Systematic instruction 10% 91.2% 82.2%
Attention prompts 22.3% 100% 100%
Intentional pause 11.2% 96.3% 100%
Kevin Scripted questions NA 100% 100%
Expanding student’s response 57.5% 94.1% 96.7%
Praise 26% 86.1% 82.3%
Systematic instruction 8.4% 61.6% 79.2%
Attention prompts 10% 100% 100%
Intentional pause 0% 92.4% 100%
Leo Scripted questions NA 100% 100%
Expanding student’s response 57.5% 91.1% 92.8%
Praise 30.5% 77.6% 83.6%
Systematic instruction 5.6% 55.6% 91%
Attention prompts 11.1% 97.1% 100%
Intentional pause 0% 100% 100%
Download Excel Table

Our informal observation and visual analysis of her MDR implementation show some variability during her implementations of systematic instruction and praise across students. For example, Melinda was expected to provide least to most prompts when students did not correctly answer within five seconds. However, our informal observation data shows that Melinda asked clarification or repeated questions when the students did not answer correctly within five seconds, which increased variability in the fidelity of implementation. Melinda demonstrated a stable trend in providing systematic instruction to Tom while showing a relative decrease in using systematic instruction to Grace or a very sharp reduction to Kevin. On the other hand, Melinda showed the increase in using systematic instruction to Leo (see Figure 5).

jbas-10-1-23-g5
Figure 5. Fidelity of Teacher’s Implementation in Using Systematic Instruction
Download Original Figure

Melinda also demonstrated variability in praising students (Figure 6). The teacher demonstrated an overall decreasing trend of praising Tom during the intervention phase, but she had a big drop during session 28. This occurred after she gave Tell maximum praise (100%) after three consecutive data points (session 26, 27, 28). During the maintenance phase, data was stable. The teacher had a relatively increasing trend during the intervention phase for Grace, with three dips at sessions 17, 21, and 25. During the intervention phase, the teacher participant showed an increasing trend of praising Kevin until session 27, but her use of praise had a sharp drop by session 30. At the beginning of maintenance, the teacher showed an increase in praising Kevin, but there was a big drop at session 32. Finally, the teacher’s use of praise for Leo was stable during the intervention phase and showed a relative increase during the maintenance phase.

jbas-10-1-23-g6
Figure 6. Fidelity of Teacher’s Implementation in Praising the Student Participation
Download Original Figure

IV. Discussion

The purpose of this study was to determine (a) the effects of the PD package on the fidelity of the teacher’s implementation of MDR and (b) the teacher’s perceived effectiveness of PD on the use of MDR. Findings from this study showed that the PD package positively affected the teacher participant’s use of MDR as intended, and the teacher felt that the PD and coaching helped her gain related skills and knowledge in correctly using MDR to students with ASD.

The findings of this study provide evidence that the PD package positively affected the teacher’s use of MDR as intended. In this study, Melinda participated in a 2-hour PD and ongoing coaching sessions. Melinda showed immediate gains in implementing each MDR component (e.g., expanding student responses, praising students, using visual support, using attention prompts, using intentional pause) and maintained the higher level of fidelity of implementations. Our findings are consistent with previous studies that examined the effects of PD and coaching on teachers’ use of literacy strategies, in particular for fluency and word knowledge (Brownell et al., 2017), shared reading (Dennis & Horn, 2014; Kaderavek et al.., 2014), and DR (Rezzonico et al., 2015).

Data also showed that MDR is a user-friendly intervention. The teacher indicated that after the 2-hour MDR training and ongoing feedback, she was able to implement this specific strategy with high fidelity. In addition, Melinda became confident in implementing the MDR procedures with her students suggesting that this type of instructional method could be feasible and easily applicable when teaching reading skills to students with ASD. This contrasts with the findings from the previous studies (e.g., Desmione, 2009; Joyce & Showers, 1982; Leko & Brownell, 2009) that emphasized securing more than 20 hours of contact time via different formats of PD to help teachers’ transit of PD knowledge into practice.

Despite improved percentages of the fidelity of implementation after PD, we observed variability in her MDR implementation of systematic instruction and praise across students. Data in this current study show that Melinda sometimes did not follow the intervention protocol, but rather provided systematic instruction or praised students based on their characteristics (e.g., behavior needs) and classroom contexts (e.g., student group dynamics).

Our informal observation indicated that Melinda’s implementation was affected by group dynamics and student behaviors. While Tom, Kevin, and Leo often participated in the small groups together, Grace did not have chances to interact with the other three students. This could explain why the teacher’s behavior was differentiated between three students (Tom, Kevin, and Leo) and Grace from sessions 27 to 30. In short, the teacher was becoming more flexible in praising student participants and using systematic instruction based on her instructional decision of how to better meet their needs. Her efforts could be interpreted as providing support within the zone of proximal development (Vygotsky, 1978).

This study shares multiple implications to researchers and teacher preparation programs. First, researchers need to investigate teachers’ use of MDR more. Three existing studies show that MDR is effective in improving listening comprehension and initiation skills of young children with ASD (Fluery et al., 2016; Whalon et al., 2015, 2016); however, none of the MDR studies were implemented by teachers, but by researchers (Whalon et al., 2015), paraprofessionals (Fluery et al., 2016) or caregivers (Whalon et al., 2016). Given that teachers are a critical indicator for student outcomes (NICHD, 2000), more researchers need to pay attention more about the effects of PD on MDR for students with ASD. In addition, researchers should examine what the most effective PD in MDR in terms of formats, frequency, and length would be. Although existing literature (e.g., Desmione, 2009; Joyce & Showers, 1982; Leko & Brownell, 2014) indicates PD and coaching at least twenty hours of contact time as the effective PD components, studies regarding the MDR are missing from the literature. Third, school districts and teacher preparation programs need to provide more PD opportunities for teachers to get to know about EBPs. In addition, schools and teacher educators continue to encourage teachers to use EBPs and monitor them using those correctly.

We identified limitations of this study, and this offers insights on the future research direction. In fact, having one teacher participants caused multiple limitations. First, the findings of this study are hard to generalize. Therefore, future research needs to replicate this research with more teacher participants to see consistent findings across teachers who have students with ASD. Second, this study has limitation in terms of methodological rigor. In fact, having one teacher implement MDR while students are transiting through baseline, intervention, and maintenance threatened and violated the internal validity. The teacher’s implementation fidelity to Grace, Kevin, and Leo on the baseline might be affected by PD and coaching that she already received to use MDR to Tom. Future research should make careful considerations that minimize the potential threats for internal validity.

According to the recent studies, MDR must be an effective strategy to meet the reading and communicative needs of young children wish ASD. Providing PD and ongoing coaching resulted in the overall higher level of teacher implementation fidelity, which confirms findings of previous studies (Brownell et al., 2017; Dennis & Horn, 2014; Kaderavek et al., 2014; Rezzonico et al., 2015). Furthermore, the current study expanded the previous studies by providing a special education teacher PD package, which help to promote teachers’ use of MDR in their reading class. Given the needs of students with ASD and the increase in the prevalence of the population, more teachers need to use MDR needs to use more in the classroom. This suggests the need for additional studies to general support teachers’ use of MDR and to generalize the effects of support on teacher implemented MDR on student.

References

1.

Accardo, A. L., & Finnegan, E. G. (2019). Teaching reading comprehension to learners with autism spectrum disorder: Discrepancies between teacher and research-recommended practices. Autism, 23(1), 236-246.

2.

3.

Baron-Cohen, S., Leslie, A. M., & Frith, U. (1985). Does the autistic child have a “theory of mind”? Cognition, 21(1), 37-46.

4.

Brownell, M., Kiely, M. T., Haager, D., Boardman, A., Corbett, N., Algina, J., ... & Urbach, J. (2017). Literacy learning cohorts: Content-focused approach to improving special education teachers’ reading instruction. Exceptional Children, 83(2), 143-164.

5.

Cheek, A. E., Harris, B. A., Koppenhaver, D. A., Garwood, J. D., & Laws, B. R. (2022). Technology-supported shared storybook reading in a rural classroom serving students with severe intellectual disabilities and complex communication needs. Rural Special Education Quarterly, 41(3), 140-152.

6.

Chiang, H. M., & Lin, Y. H. (2007). Reading comprehension instruction for students with autism spectrum disorders: A review of the literature. Focus on Autism and Other Developmental Disabilities, 22(4), 259-267.

7.

Cho, S. I. & Oh, J. M. (2016). Meta-Analysis and Analysing Quality Indicators of Intervention on Problem Behaviors for Elementary Students with Autism Spectrum Disorders, Journal of Behavior Analysis and Support, 3(1), 1-24.

8.

Cook, B. G., & Cook, S. C. (2013). Unraveling evidence-based practices in special education. The Journal of Special Education, 47(2), 71-82.

9.

Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis. Columbus, OH: Merrill.

10.

Dennis, L., & Horn, E. (2014). The effects of professional development on preschool teachers’ instructional behaviours during storybook reading. Early Child Development and Care, 184(8), 1160-1177.

11.

Desimone, L. M. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Educational researcher, 38(3), 181-199.

12.

Dickinson, D. K., & Smith, M. W. (1994). Long-term effects of preschool teachers’ book readings on low-income vocabulary and story. Reading Research Quarterly , 29(2), 104.

13.

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication# 231).

14.

Fleury, V. P., & Schwartz, I. S. (2016). A Modified Dialogic Reading Intervention for Preschool Children With Autism Spectrum Disorder. Topics in Early Childhood Special Education, 0271121416637597.

15.

Gough, P. B., & Tunmer, W. E. (1986). Decoding, reading, and reading disability. Remedial and special education, 7(1), 6-10.

16.

Hargrave, A. C., & Sénéchal, M. (2000). A book reading intervention with preschool children who have limited vocabularies: The benefits of regular reading and dialogic reading. Early Childhood Research Quarterly, 15(1), 75-90.

17.

Hall, L. J., Grundon, G. S., Pope, C., & Romero, A. B. (2010). Training paraprofessionals to use behavioral strategies when educating learners with autism spectrum disorders across environments. Behavioral Interventions: Theory & Practice in Residential & Community Based Clinical Programs, 25(1), 37-51.

18.

Horner, R. H., Carr, E. G., Halle, J., McGee, G., Odom, S., & Wolery, M. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165-179.

19.

Joyce, B., & Showers, B. (1982). The coaching of teaching. Educational leadership, 40(1), 4-8.

20.

Kaderavek, J. N., & Rabidoux, P. (2004). Interactive to independent literacy: A model for designing literacy goals for children with atypical communication. Reading & Writing Quarterly, 20(3), 237-260.

21.

Kaderavek, J. N., Pentimonti, J. M., & Justice, L. M. (2014). Children with communication impairments: Caregivers’ and teachers’ shared book-reading quality and children’s level of engagement. Child Language Teaching and Therapy, 30(3), 289-302.

22.

Kang, J., Williamson, P., & Carnahan, C. (under review). Effects of modified dialogic reading on listening comprehension and initiation skills for students with ASD. Revised and resubmitted for publication.

23.

Kretlow, A. G., & Bartholomew, C. C. (2010). Using coaching to improve the fidelity of evidence-based practices: A review of studies. Teacher Education and Special Education, 33(4), 279-299.

24.

Kratochwill, T. R., Hitchcock, J. H., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., & Shadish, W. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34(1), 26-38.

25.

Leko, M. M., & Brownell, M. T. (2009). Crafting quality professional development for special educators: What school leaders should know. Teaching Exceptional Children, 42(1), 64-70.

26.

Maenner, M. J. (2023). Prevalence and characteristics of autism spectrum disorder among children aged 8 years-Autism and Developmental Disabilities Monitoring Network, 11 sites, United States, 2020. MMWR. Surveillance Summaries, 72.

27.

National Early Literacy Panel. (2008). Developing early literacy: Report of the National Early Literacy Panel. Washington, DC: National Institute for Literacy. Retrieved from http://lincs.ed.gov/publications/pdf/NELPReport09.pdf

28.

National Reading Panel (US), National Institute of Child Health, Human Development (US), National Reading Excellence Initiative, National Institute for Literacy (US), United States. Public Health Service, & United States Department of Health. (2000). Report of the National Reading Panel: Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction: Reports of the subgroups. National Institute of Child Health and Human Development, National Institutes of Health.

29.

National Research Council. (2001). Educating children with autism. National Academies Press.

30.

Rezzonico, S., Chen, X., Cleave, P. L., Greenberg, J., Hipfner Boucher, K., Johnson, C. J., ... & Girolametto, L. (2015). Oral narratives in monolingual and bilingual preschoolers with SLI. International Journal of Language & Communication Disorders, 50(6), 830-841.

31.

Scheeler, M. C., Budin, S., & Markelz, A. (2016). The role of teacher preparation in promoting evidence-based practice in schools. Learning Disabilities: A Contemporary Journal, 14(2), 171-187.

32.

Shin, J. W., Park, C. W., & Lee, H. S. (2021). The effects of behavioral skills training on the accuracy of discrete-trial teaching implementation for parents of children with developmental disabilities. Journal of Behavior Analysis and Support, 8(1), 23-42.

33.

Vygotsky, L. S. (1978). Socio-cultural theory. Mind in society, 6, 52-58.

34.

Whalon, K., Hanline, M. F., & Davis, J. (2016). Parent implementation of RECALL: A systematic case study. Education and Training in Autism and Developmental Disabilities, 51, 211-220.

35.

Whalon, K., Martinez, J. R., Shannon, D., Butcher, C., & Hanline, M. F. (2015). The impact of reading to engage children with autism in language and learning (RECALL). Topics in Early Childhood Special Education, 35(2), 102-115.

36.

What Works Clearinghouse. (2015). WWC intervention report: Shared book reading.

37.

Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ies.ed.gov/ncee/wwc/pdf/intervention_reports/wwc_sharedbook_041415.pdf

38.

Whitehurst, G. J., & Lonigan, C. J. (1998). Child development and emergent literacy. Child Development, 69, 848-872.

39.

Williamson, P., Caranhan, C., & Jacobs, J. (2012). Reading comprehension profiles of high-functioning students on the autism spectrum: A ground theory. Exceptional Children, 78(4), 449-469.

40.

Wong, C., Odom, S. L., Hume, K. Cox, A. W., Fettig, A., Kucharczyk, S., … Schultz, T. R. (2013). Evidence-based practices for children, youth, and young adults with Autism Spectrum Disorder. Chapel Hill: The University of North Carolina, Frank Porter Graham Child Development Institute, Autism Evidence-Based Practice Review Group.

41.

Yin, R. (2009). Case Study Research: Design and Methods, fourth edition, Thousand Oaks, CA: Sage Publications.