People with Autism Spectrum Disorder (ASD) have lower employment rates than their peers without disabilities or other disabilities. Clear evidence exists regarding video-based interventions (VBIs) for improving task performance and social communication skills for students with ASD. However, such interventions have rarely been applied in integrated employment settings.
This systematic literature review aims to examine the utilization and efficacy of video-based interventions in improving the skills required to secure and maintain a job for youth and adults with ASD.
A systematic literature review was conducted on peer-reviewed articles on VBIs and ASD from electronic databases (n.d. –2019), an ancestral search of retrieved studies, and a hand search of retrieved journals.
Effective approaches were identified from among 19 studies that met the inclusion criteria. Sixteen of the studies focused on teaching job performance skills associated with specific job duties. Only three studies targeted the utility of VBIs to improve job search skills.
The results indicated that VBIs produce positive results in improving job performance skills. These positive results suggest promising future studies using VBIs to help equip people with ASD with the skills necessary to find and obtain employment.
Employment is more than just a means to afford basic needs; and has been associated with better economic, social, psychological and emotional well-being (Hartung, 2011; Selenko et al., 2011; Uthayakumar et al., 2010). Unfortunately, employment rates for people with autism spectrum disorder (ASD) have been reported to be low compared to people without disabilities (Billstedt et al., 2005; Hendricks, 2010; Newman et al., 2011), and even compared to people with other disabilities (Shattuck et al., 2012). Studies of the general population have demonstrated that unemployment is associated with reduced mental (Booker & Sacker, 2012; Paul & Moser, 2009) and physical health (Catalano et al., 2011). Given the high risk of unemployment among people with ASD, studies addressing effective strategies leading to gainful employment are essential.
Securing and maintaining a job in competitive integrated employment is a process that requires diverse range of skills for different phases. During the pre-employment phase, when people with ASD learn job search skills (e.g., preparing resumes, developing interview skills, making contacts with companies), there is a likelihood of securing employment (Sung et al., 2015). Once employment is secured, new employees with ASD must learn the job performance skills necessary to satisfactorily complete all required job tasks. In addition, learning the best approaches to communicate with others at work such as co-workers, managers, and customers is essential. In fact, it is established that poor social communication behaviors at workplace may cause a worker with ASD to lose their job (Bolman, 2008; Hurlbutt & Chalmers, 2004; Müller et al., 2003).
Mastering job search and job performance skills are not the only factors that influence successful employment outcomes. The type of working experiences in which people develop these skills also matters. For example, having paid employment during high-school was found as a significant factor in post-school employment among youth with disabilities, however, pre-vocational and unpaid experiences were not (Carter et al., 2012). Therefore, investigating evidence-based practices that teach the skills necessary to find paid employment, perform specific job duties, and maintain employment is important.
1.1Video-based interventions and people with ASD
Given the limitations of the research associated with employment training for people with ASD (Hendricks, 2010), it would seem that tailored supports and interventions are needed to improve job search and job performance skills. Specifically, skills related to the ability to effectively communicate with current and future employers (Higgins et al., 2008; Strickland et al., 2013). Video-based interventions (VBIs) have been identified as an evidence-based practice addressing the unique learning characteristics of people with ASD and their use is on the rise (Wong et al., 2015). This approach integrates technology such as video-modeling, self-modeling, feedback, prompting and virtual reality programs as part of comprehensive training packages. For the purpose of this study, we define VBIs as strategies that incorporate visual and audio cues to teach or maintain skills through model behavior or feedback.
VBIs have been used to teach people with ASD daily living (Burckley et al., 2015; Mechling et al., 2013), academic (Burton et al., 2013), and social skills (Tetreault & Lerman, 2010). For the most part, VBI studies have been conducted in schools, day treatment centers, and community living settings. A few more recent studies have used VBIs in employment settings primarily to increase job-related performance skills (Burke et al., 2013; Kellems & Morningstar, 2012), and in one recent study, to increase customer service skills (Bross et al., 2018).
Generally speaking, video modeling involves presenting a video of a model (e.g., peers, adults, self) who is performing the target behavior (Bellini & Akullian, 2007). Elements of VBI methods fall into one of several categories: (a) self-modeling in which the participant is videotaped successfully performing the target behavior (Dowrick, 1999); (b) video feedback which allows participants to watch a recorded video of themselves and self-evaluate their performance; (c) video prompting in which tasks are analyzed into video segments demonstrating each step of a task (Burke et al., 2013); and (d) augmented and virtual reality that supports practice and rehearsal of responses through computer-generated environments (Strickland et al., 2013; Chen et al., 2015).
1.2Video-based interventions for job search skills
Specifically related to job search skills, certain VBI methods have been found to improve communication and conversational skills, social behavior, and social initiations for job interviewing. The use of VBIs for other job search skills (e.g., checking job ads, social networking skills) has not yet been established. Among studies focused on job interviewing, most VBIs interventions have targeted skills such as maintaining eye contact, using facial expressions, conversational turn-taking, and exhibiting empathetic statements and questioning (Mason et al., 2012; Koegel et al., 2016). In addition, a wide range of VBI studies have targeted other forms of social communication skills, but these studies have taken place outside of employment domains and are mostly associated with school and center-based interventions for younger children (Shukla-Mehta et al., 2013). Only recently have VBIs been used to address work-related social engagement. Most recently, emergent and preliminary studies have targeted interview skills for youth with ASD (Hayes et al., 2015; Munandar, 2016; Strickland et al., 2013; Smith et al., 2014).
While VBIs have been shown to be effective in improving social and communication skills for people with ASD, this method is emerging as an intervention for addressing critical skills necessary for competitive integrated employment. It is particularly true that VBIs have just begun to target specific skills associated with the three essential phases of employment: (a) obtaining employment (i.e., job search and interviews skills); (b) learning initial skills in integrated employment settings; and (c) maintaining and advancing within integrated employment. While VBIs have been found effective for improving the development of employment skills for people with ASD, the majority of these studies have taken place in segregated settings using simulations of potential jobs, with fewer studies conducted in competitive integrated employment (Gentry et al., 2015; Van Laarhoven et al., 2012). Furthermore, among those studies that do focus on employment for youth with ASD, most have targeted learning a specific job task, with fewer addressing social communication challenges needed to obtain integrated employment or maintain and expand job duties and roles (Strickland et al., 2013; Smith et al., 2014; Hayes et al., 2015).
1.3Purpose of the study
Given the fast pace with which technology has emerged and is utilized to support students with ASD, and the nascent use of VBIs related to competitive integrated employment, there is a need to better understand the current range of VBIs research associated with the three phases of finding, obtaining, and keeping integrated competitive employment for youth with ASD. The following research questions guided this systematic review:
(a) Which employment skills (i.e., job search, job performance) have been effectively taught to youth with ASD through video-based interventions?
(b) Do the studies of video-based interventions to support youth with ASD in integrated employment settings meet established methodological quality standards?
A multi-step procedure was used to identify and systematically review relevant studies. First, we completed a systematic search using relevant keywords across established databases. In addition, an ancestral search of current research from pertinent journals was completed. Next, inclusion and exclusion criteria were applied to each identified study to filter only applicable articles. Finally, multiple coding categories were implemented to map and synthesize articles meeting the inclusion criteria and to evaluate the quality of the methodology.
2.1Inclusion and exclusion criteria
Four inclusion criteria were used to screen studies containing relevant content related to the purpose of this systematic literature review: (a) at least one participant in the study had an ASD diagnosis, and aged 16 or older; (b) VBIs occurred in integrated employment settings; and (c) VBIs targeted job search, on the job training, or job maintenance. Only experimental research published in English, peer-reviewed journals prior to April 30th, 2019 were included. Because of the recent and emerging body of research associated with VBIs, the search did not set a start date, with the oldest study published in January 2009.
Publications were excluded if they were: (a) non-experimental (e.g., meta-analysis, systematic literature reviews); (b) included only audio or only visual cues; and (c) targeted domestic living skills considered to be “pre-vocational” that occurred in non-employment settings.
We implemented several steps to identify relevant peer-reviewed published studies that met inclusion criteria. First, we searched three electronic databases (i.e., ERIC, PsycINFO, JSTOR), using keywords in multiple combinations (autis*, video*, employ*, vocation*, job*, occupation*, interview*, model*). This resulted in a total of 1,426 articles. The first round of screening involved reading the titles and abstracts to exclude studies that were non-experimental, taught non-employment related skills, and involved children as participants. The first screening narrowed the number of publications to 36. The second round of screening involved reading the full text to identify studies meeting all inclusion criteria. Twenty articles were removed from the review, as there were no participants aged 16 or older involved, or the outcomes of the study did not lead to integrated competitive employment. The second screening narrowed the number of publications to 14.
An ancestral search was then conducted by examining references from the included articles as well as examining references from six meta-analyses examining VBIs more broadly across a range of skills. No additional articles were added to the total upon conclusion of this process. We then performed a hand search of journals that yielded articles that met the inclusion criteria (e.g., Journal of Vocational Rehabilitation, Journal of Autism and Developmental Disorders). Four articles were identified through the hand search, resulting in a total of publications of 18. Interrater agreement (IRA) during the screening was completed by having two of the researchers separately review the 18 articles, with both agreeing that the 18 articles met the inclusion criteria (100% IRR). The 18 published articles included 19 studies because one article (Burke, Andersen, Bowen, Howard, & Allen, 2010) reported two separate studies.
Participant demographic characteristics were coded for age, race, and gender. Employment history was coded as: (a) currently employed, (b) previously employed but currently unemployed, or (c) never employed. The number of participants with ASD per study was also recorded, but for the most part, the data from participants with ASD and those without ASD were not disaggregated. Socioeconomic status was not included because there was not sufficient information about these data within the 19 studies.
Second, the studies were coded based on: (a) type of VBI (e.g., video modeling, self-modeling, video prompting, video feedback, virtual reality); (b) setting (e.g., on-the-job, school, community-based setting); (c) who implemented the intervention (e.g., researcher, teacher); and (d) whether family members, teachers, or employers were involved. Family, teachers, and employers are considered involved if they implemented the intervention, completed a fidelity check, or participated in a social validity measurement.
The specific employment skills targeted by the intervention were categorized as skills associated with job search and job performance skills. Interventions were coded as job search when the VBIs were used to teach specific job search skills (e.g. resume writing, job interviewing). The job performance code was used when the VBIs taught skills required to perform employment tasks occurring in integrated employment settings. In addition, the maintenance and generalization of the VBIs were considered, with the maintenance code used for studies that included information regarding the participants’ ability to maintain the employment skills for a certain period of time post-intervention training; and generalization was used when the study included participants’ ability to generalize skills to new employment settings.
Finally, each study was examined for adherence to the Council for Exceptional Children (CEC) Standards for Evidence-Based Practices in Special Education (Cook et al., 2014). The standards consist of 24 quality indicators (QIs) for group design studies and 22 QIs for single-subject studies. The indicators address quality across eight areas of research: (a) context and setting, (b) participants, (c) intervention agent, (d) description of practice, (e) implementation fidelity, (f) internal validity, (g) outcome measures/dependent variables, and (h) data analysis. Each QI is scored 1 if the study met the methodological criteria or a 0 if it did not. The overall scores are divided by the total number of QIs and multiplied by 100%.
2.4Interrater agreement (IRA)
To ensure the reliability of the collected data, two authors separately conducted coding and QI evaluation for 14 of the 18 articles (77.8%), which included 15 studies because one article includes two studies (Burke et al., 2010). Upon completing coding and QI evaluation for the 15 studies, the two authors met and compared results. Agreement or disagreement was scored for each item on the coding sheet. IRA was calculated by dividing the sum agreements by the sum of the agreements plus disagreements, multiplied by 100. The IRA for coding ranged from 87.5% to 100%, with a mean of 92.7%. The IRA for QI evaluation ranged from 68.2% to 100%, with a mean of 84.2%. The disagreements were resolved through discussion between the two researchers.
Eighteen articles published between 2009 and 2018 met the inclusion criteria. However, one of the 18 articles reported two separate studies (Burke et al., 2010), therefore a total of 19 studies were examined. Fourteen studies used single-subject design to examine VBIs associated with the employment of youth with ASD, while five studies used a group design. Two studies combined VBIs with another intervention, such as a performance cue system (Burke et al., 2010), direct feedback from a job coach (Mackey & Nelson, 2015), literacy-based behavioral interventions (LBBI; Pistoro et al., 2018), and social skills curriculum (Walsh et al., 2018). Findings indicated that the majority of studies focused on teaching job performance skills associated with specific job duties, and only a few targeted the utility of VBIs to improve job search skills. All studies reported improvement in the overall dependent variables measured.
A total of 158 participants with ASD were identified out of 164 participants. Table 1 presents information on the participants’ demographic characteristics.
|Others (e.g., Biracial, Asian-American, Hispanic)||17||10.4|
|Currently unemployed with previous employment||8||4.9|
3.2Job performance skills taught using VBIs
Most studies reviewed (n = 17, 89.5%) focused on the acquisition of skills using VBIs. Among these, 14 (73.7%) measured the effectiveness of the intervention in maintaining skills. Four studies (21%) investigated whether participants generalized the skills to different settings. The length of the intervention varied considerably, with periods reported between three weeks and one year. Job performance skills were identified and categorized as either social communication skills or task performance. Twelve studies focused on task performance skills such as using equipment at the employment sites, cleaning, preparing food, shipping, and delivering fire safety education (see Table 2). One study focused on both skills (i.e., interacting with co-workers, and completing tasks with acceptable quality; Gentry et al., 2015). Social communication skills were targeted within three studies and included product promotions (n = 1), social interaction in employment sites (n = 1), and customer service (n = 1, see Table 1).
|Study||Participants||Type of intervention||Stages of learning||Type of skills||Skills taught||Settings|
|Video-modeling||Self-modeling||Video feedback||Video prompting||Virtual reality||Acquisition||Generalization||Maintenance||Job search||Job performance|
|Allen, Wallace, Greene, et al. (2010)||3 ASD||X||X||X||X||X||Promoting product in WalkAround costume||Retail store|
|Allen, Wallace, Renes, et al. (2010)||4 ASD||X||X||X||X||Entertaining customers in WalkAround costume||Retail warehouse|
|Babb et al. (2018)||1 ASD||X||X||X||X||X||Checking in and putting books away, dye cuts, shredding||School library|
|Bereznak et al. (2012)||3 ASD||X||X||X||X||Cooking, using washing machine and copy machine||Teacher workroom|
|Bross et al. (2018)||1 ASD||X||X||X||Greeting customers||Retail store|
|Burke et al. (2010) – Study 1||3 ASD||X||X||X||X||X||X||Delivering fire safety program in WalkAround costume||Factory|
|Burke et al. (2010) – Study 2||3 ASD||X||X||X||X||X||Delivering fire safety program in Walk Around costume||Factory|
|Burke et al. (2013)||4 ASD||X||X||X||X||Multistep shipping task||Shipping warehouse|
|Cihak &Schrader (2009)||4 ASD||X||X||X||X||X||Preparing first aid kits, making copies, sending fax||Teacher workroom|
|Gentry et al. (2015)||50 ASD||X||X||X||Interacting with co-workers, seeking information and assistance from employers.||Multiple participants’ worksites|
|Goh &Bambara (2013)||1 ASD, ID 2 ID||X||X||X||X||Preparing conference packet, using paper shredder and copy machine.||Unspecified participants’ worksites|
|Hayes et al. (2015)||15 ASD||X||X||X||X||Job interviewing||Academic facility|
|Kellems &Morningstar (2012)||4 ASD||X||X||X||X||Cleaning, taking inventory, recycling.||Unspecified participants’ worksites|
|Mackey &Nelson (2015)||2 ASD||X||X||X||X||Responding to others, hygiene.||Warehouse, non-profit organization|
|Pistoro et al. (2018)||3 ASD||X||X||X||X||Filing, copying, answering the phone||University job coaching office|
|Smith et al. (2014)||26 ASD||X||X||X||Job interviewing||University research facility|
|Strickland et al. (2013)||22 ASD||X||X||X||Job interviewing||University research facility|
|Van Laarhoven et al. (2012)||4 ASD 92 ID||X||X||X||Portioning, recycling, using washing machine||Fast food restaurant|
|Walsh et al. (2018)||7 ASD||X||X||X||X||Work-related social skills (e.g., greetings, offering assistance, responding to requests)||Vocational training center|
3.3Job search skills acquisition taught using VBIs
Only three articles addressed VBIs to improve job search skills among people with ASD. Results indicated that job search skills significantly improved using VBIs such as peer modeling, self-modeling, and virtual reality. All three studies demonstrated evidence of experimental control, and all participants in these three studies showed improvements in their job interviewing skills (see Table 2). Dependent variables measured in one study included physical appearance, facial expressions, body language, and spoken answers (Hayes et al., 2015). Smith and colleagues (2014) measured communication skills that contributed to successful job interviews (e.g., comfort levels, negotiation skills, sharing examples positively, establishing rapport). One study measured the content of participant responses as well as their response delivery (i.e., greetings, facial expressions, body positioning; Strickland et al., 2013).
3.4Types of VBIs
A wide range of technology was used among the 19 studies (e.g., videotape recorders, smartphones, computers, tablets, and DVDs). Software and computer applications were used in three studies: (a) “VideoTote” on computer tablets (Burke et al., 2013), (b) “VidCoach” on iOS devices (Hayes et al., 2015), and (c) Virtual Reality Job Interview Training (VR-JIT) on computers (Smith et al., 2014). A web-based interviewing skills program, “JobTIPS” was used in one study (Strickland et al., 2013).
While a range of VBIs were implemented across the 19 studies, the job performance video interventions focused on video modeling (n = 10), video self-modeling (n = 1), video feedback (n = 1), video prompting (n = 2). Two studies implemented more than one type of VBI (e.g., video modeling and video prompting; video modeling and video self-modeling). The job search VBIs tended to focus on virtual reality programs (n = 2), and one study combining video modeling and video self-modeling.
Nine studies implemented video modeling with different variations in how the video was produced and edited (e.g. scripted target behavior, natural target behavior, with or without narration, with or without written instructions). Virtual reality programs reported using online programs (e.g., JobTIPS) or computer software (e.g., VR-JIT).
Five studies had teachers or a job coach as the intervention agent (Cihak & Schrader, 2009; Gentry et al., 2015; Goh & Bambara, 2013; Mackey & Nelson, 2015; Walsh et al., 2018), while the rest were implemented by researchers. Five studies included family members (Burke et al., 2010, 2013; Van Laarhoven et al., 2012; Walsh et al., 2018) not to implement the VBI, but to complete social validity measurements or fidelity checks. Five studies involved employers who completed social validity measures (Allen, Wallace, Greene, et al., 2010; Burke et al., 2010; Kellems & Morningstar, 2012; Bross et al., 2018). Among the nine studies that included teachers, their roles include implementing VBIs included providing systematic prompts, instructions, and feedback (Bereznak et al., 2012; Van Laarhoven et al., 2012; Goh & Bambara, 2013); being a second observer (Mackey & Nelson, 2015); and participating in social validity measurement (Burke et al., 2010, Cihak & Schrader, 2009; Kellems & Morningstar, 2012, Walsh et al., 2018).
Among the 19 studies, five used a group design (e.g., randomized study with control and treatment groups, delayed randomized controlled trial, modified pre/post-test group design) and 14 reported single-subject design (e.g., multiple-probe or multiple-baseline across behavior or participants). Using the CEC Standards for Evidence-Based Practices in Special Education (Cook et al., 2014), among the five group designs, the percentage of QIs met averaged 80.9%, ranging from 78.3% to 82.6%. Whereas the single-subject design studies overall quality averaged 84.3%, with a much wider range from 54.5% to 100%.
Table 2 presents how the QIs were met across all single-subject studies. Table 3 presents how the QIs were met across all group design studies. Seven QIs were met by 100% of the studies: (a) context and setting, (b) participant demographics, (c) description of intervention procedure, (d) control and manipulation of independent variable, (e) social importance of outcome, (f) definition and measurement of dependent variable, and (g) evidence of internal reliability. For QIs that were only applicable for group designs, five additional QIs were met 100% of the time: (a) clear assignment of each group, (b) low attrition, (c) low differential attrition, (d) evidence of validity, and (e) appropriate data analysis technique. For QIs that were only applicable for single-subject studies, one QI that was met 100% of the time was a single-subject graph for visual analysis.
|Quality indicator||Allen et al. (2010a) Allen, Wallace, Greene, et al. (2010)||Allen, Wallace, Renes, et al. (2010)||Babb et al. (2018)||Bereznak et al. (2012)||Bross et al. (2018)||Burke et al. (2010) – Study 1||Burke et al. (2010) – Study 2||Burke et al. (2013)||Cihak &Schrader (2009)||Goh &Bambara (2013)||Kellems &Morningstar (2012)||Mackey &Nelson (2015)||Pistoro et al. (2018)||Walsh et al. (2018)|
|1.1||Context and setting||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|2.2||Participant disability or risk status||X||X||X||X||X||X||X||X||X||X||X||X|
|3.1||Intervention agent description||X||X||X||X||X||X||X||X|
|3.2||Intervention agent training/qualifications||X||X||X||X||X||X||X|
|4.1||Description of intervention materials||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|4.2||Description of intervention materials||X||X||X||X||X||X||X||X||X||X||X||X||X|
|5.3||Comprehensive assessment of fidelity*||X||X||X||X||X||NA||NA|
|6.1||Systematic manipulation of independent variable||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|6.3||Limited access to treatment in baseline||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|6.5||Three demonstrations of experimental effect||X||X||X||X||X||X||X||X||X||X||X|
|6.6||Sufficient baseline length and pattern||X||X||X||X||X||X||X||X||X||X||X|
|6.7||Control for common threats to internal validity||X||X||X||X||X||X||X||X||X||X|
|7.1||Socially important outcome variable||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|7.2||Dependent variable definition and measurement||X||X||X||X||X||X||X||X||X||X||X||X||X||X|
|7.3||Findings fully reported||X||X||X||X||X||X||X||X||X||X||X||X||X|
|7.4||Timing/frequency of outcome measures||X||X||X||X||X||X||X||X||X||X||X||X|
|Percentage of quality indicators met||86.4||81.8||95.5||90.9||95.5||72.7||72.7||54.5||90.9||100||81.8||85.7||95.5||76.2|
Note. This table does not include quality indicators (QIs) for group-design studies (items 6.4, 6.8, 6.9, 7.6, 8.1, and 8.3). *This QI is not applicable if neither adherence (item 5.1) nor dosage (item 5.2) was assessed and reported. X = QI met. NA = QI not applicable; excluded in the calculation of percentages.
The purpose of this systematic review was to map the quality of current research associated with using VBIs for employment skills for youth and adults with ASD. In the current review, we first examined what types of employment skills effectively taught through VBIs. Findings indicated that VBIs were effective in teaching a variety of job performance skills (e.g., cleaning, cooking) as well as some social communication skills (e.g., making requests, responding appropriately to greetings). Only three studies focused on job search skills. All three studies investigated the efficacy of VBIs in teaching job interviewing skills. Elements of job interviewing skills included quality of answers, verbal behavior (e.g., greetings, expression of appreciation at the end of interview), and non-verbal behavior (e.g., eye contact, body positioning, handshakes).
The second research question related to the quality of the studies across the eight areas of CEC Standards for Evidence-Based Practices in Special Education (Cook et al., 2014). The majority of the studies met the QIs for including written information about: (a) context and setting – providing information on the critical features of the context and setting; (b) participants – describing demographics and disability or risk status of participants; (c) description of practice – providing information on the critical features of the intervention; and (d) outcome measures – appropriately measuring the dependent variable to determine the efficacy of the intervention. For the most part, studies were least likely to have met some QIs in these areas: (a) intervention agent – providing the role of the intervention agent and training or qualifications required to implement the intervention, and (b) implementation fidelity – reporting how the practice was implemented with fidelity (see Table 3 and Table 4).
|Quality indicator||Gentry et al. (2015)||Hayes et al. (2015)||Smith et al. (2014)||Strickland et al. (2013)||Van Laarhoven et al. (2012)|
|1.1||Context and setting||X||X||X||X||X|
|2.2||Participant disability or risk status||X||X||X||X||X|
|3.1||Intervention agent description||X||X|
|3.2||Intervention agent training/qualifications|
|4.1||Description of intervention materials||X||X||X||X||X|
|4.2||Description of intervention materials||X||X||X||X||X|
|5.3||Comprehensive assessment of fidelity*||NA||NA||NA||NA||NA|
|6.1||Systematic manipulation of independent variable||X||X||X||X||X|
|6.3||Limited access to treatment in baseline||X||X||X||X||X|
|6.4||Description of assignment to groups||X||X||X||X||X|
|7.1||Socially important outcome variable||X||X||X||X||X|
|7.2||Dependent variable definition and measurement||X||X||X||X||X|
|7.3||Findings fully reported||X||X||X||X||X|
|7.4||Timing/frequency of outcome measures||X||X||X||X||X|
|7.6||Evidence of validity||X||X||X||X||X|
|8.1||Appropriate data analysis techniques||X||X||X||X||X|
|8.3||Appropriate effect size||X||X||X||X||X|
|Percentage of quality indicators met||82.6||82.6||78.3||78.3||82.6|
Note. This table does not include quality indicators (QIs) for single-subject studies (items 5.3, 6.5, 6.6, 6.7, and 8.2). *This QI is not applicable if neither adherence (item 5.1) nor dosage (item 5.2) was assessed and reported. X = QI met. NA = QI not applicable; excluded in the calculation of percentages.
Several limitations are associated with this review, including the inclusion and exclusion criteria. First, studies examining VBIs to improve certain pre-vocational, daily living and social skills that were not specifically employment-focused for people with ASD were excluded. Although job interviews and on-the-job social communication skills sought by employers were included in this study, most studies involving VBIs to teach communication behaviors took place with younger participants in school or community settings outside of work. Similarly, some studies that targeted daily living skills (e.g., setting a table, making a bed) were excluded. Some may argue these skills do occur in certain jobs, however, there are substantial distinctions made when teaching skills for home living as compared to those needed to perform specific employment skills. Given the very unique nature of job search and job performance skills, the scope of this review was determined to include only employment-related research.
Second, the review only included articles published in peer-reviewed journals, and this criterion may have narrowed the level of timeliness of the research, given how quickly new technologies develop. Expanding the search to recent dissertations and theses may have led to the establishment of a wider body of emergent research yet to be published. Furthermore, other related technological interventions (e.g., virtual reality, augmented reality, mobile device interfaces) may have been missed through the use of “video*” as the only technology-related search term used. Given the breadth and diversity of technology interventions emerging, the search term may have limited the number of potential VBI studies.
Third, data from the target population was not disaggregated in many of the reviewed studies. Therefore, the results do not reveal if the efficacy of VBIs toward improving employment skills vary by subpopulation (e.g., race, age, gender). However, this study still provides important information on how VBIs can be used for the population of youth and adults with ASD in integrated and competitive work settings in general. Finally, the IRR range for the QI evaluation was relatively low (68.2–100%) while the overall mean was 84.2%. However, the disagreements were resolved through a discussion between the two raters, and the final data reported reflect the consensus reached through the discussion.
4.2Implications for future research
Researchers and policymakers have indicated the struggle among young adults with disabilities to obtain integrated competitive employment (Workforce Innovation and Opportunity Act, 2018). However, the body of research examining the efficacy of VBIs in teaching job search skills remains scarce. Given such limited findings, it is clear that future research examining how VBIs can support people with ASD to develop employment skills is needed. Job seekers with ASD can benefit from evidence-based practices that improve other types of job search skills (e.g., writing resumes, using the network to find job opportunities) that have yet to be established within current published research. It was concerning that none of the studies included these types of job search skills. In addition, studies focusing on social communication skills required for obtaining and maintaining employment is an emergent area of research. Particularly, social communication skills to foster a positive work experience (Hendricks, 2010) and for customer service skills that are often thought to be a barrier for people with ASD (Bross et al., 2018). Clearly more substantive research in employment-related social communication skills is needed if youth and adults with ASD are to find and keep integrated competitive jobs.
Finally, we encourage future researchers to use the CEC Standards for Evidence-Based Practices in Special Education as a checklist when designing and reporting intervention research. Addressing all the QIs in the manual is essential for a study to be used in establishing an evidence-based practice (Cook et al., 2014). Based on the result of the QI measurement in this literature review, future studies need to explicitly report their implementation fidelity related to dosage or exposure and the training or qualification required for the intervention implementers. Meeting all these QIs is important to build empirical support for the use of VBIs to teach employment skills. Furthermore, addressing the QI criteria will benefit future researchers to understand the full context of the practice and to replicate the study.
4.3Implications for practice
Considering the positive results of VBIs, practitioners are expanding their use to support people with ASD across a range of academic, social and communication skills, including those to find and maintain employment. VBIs are generally reported as simple to implement, enjoyable to use, and effective in results (Burke et al., 2010, 2013; Cihak & Schrader, 2009). Practitioners can and do use VBIs with school and work-based learning experiences. Expanding their focus to specific and perhaps more advanced employment skill sets (e.g., customer service, quality control, problem-solving) may expand the array of occupations available to people with ASD.
The results show that VBIs were more effective when combined with another form of support, such as with in-person feedback (Goh & Bambara, 2013), written instructions (Kellems & Morningstar, 2012), and narration (Van Laarhoven & Winiarski, 2012). When compared, video modeling and self-modeling were reported to be equally effective in teaching the acquisition and maintenance of job performance skills (Cihak & Schrader, 2009). Practitioners should consider student level of comfort toward viewing themselves on video when determining which type of VBI to use. The results from the reviewed studies indicated some participants preferred having themselves as the models (Cihak & Schrader, 2009), whereas some participants reported feeling awkward watching themselves on the videos (Hayes et al., 2015). Given these results, practitioners can ask their students which mode they would prefer.
All VBIs in the studies reviewed were implemented by the researchers or teachers who took the role of job coach. The studies revealed that VBIs increased independent participation in integrated competitive work settings, which led to less supervision from job coaches (Gentry et al., 2015; Babb et al., 2018). Given that VBIs were reported as easy to implement and validated to have positive results by the employers (Bross et al., 2018; Kellems & Morningstar, 2012; Burke et al., 2010), practitioners can consider supporting co-workers and employers to implement VBIs as a form of support and accommodation to maintain and sustain high quality of job performance. Many employment settings already use videos to train new employees in certain job skills, and using a VBI as an accommodation for an employee with ASD is reasonable. Practitioners can support employers to understand the purpose and value of the VBI and support fidelity of us on the job. In addition, VBIs can be used to encourage employees with ASD to expand their social communication skills to maintain or even advance their employment status. This is especially critical given the unique contexts of most businesses to include critical social communication attributes.
This systematic review furthers our understanding of the current body of research associated with employment for people with ASD, specifically examining the use of VBIs. From this research, it would appear that VBIs produce positive results toward improving job performance skills; and such positive results suggest promising future studies using VBIs to support people with ASD to learn the skills necessary to find and obtain employment. It would be expected that increasing the scope of the research with anticipated positive findings will increase the employment rate for people with ASD.
Conflict of interest
The authors declare that they have no conflict of interest.
References marked with an asterisk indicate studies included in the literature review.
*Allen, K. D. , Wallace, D. P. , Greene, D. J. , Bowen, S. L. , & Burke, R. V. (2010). Community-based vocational instruction using videotaped modeling for young adults with autism spectrum disorders performing in air-inflated mascots. Focus on Autism and Other 25, 186–192. doi:10.1177/1088357610377318.
*Allen, K. D. , Wallace, D.P. , Renes, D. , Bowen, S. L. , & Burke, R. V. (2010). Use of video modeling to teach vocational skills to adolescents and young adults with autism spectrum disorders. Education and Treatment of Children 33, 339–349. doi:10.1353/etc.0.0101.
Bellini, S. , & Akullian, J. (2007). A meta-analysis of video modeling and video self-modeling interventions for children and adolescents with autism spectrum disorder. Excptional Children 73, 264–287. doi:10.1177/001440290707300301.
*Babb, S. , Gormley, J. , McNaughton, D. , & Light, J. (2018). Enhancing independent participation within vocational activities for an adolescent with ASD using AAC video visual scene displays. Journal of Special Education Technology 34(2), 120–132. doi:10.1177/0162643418795842.
*Bereznak, S. , Ayres, K. M. , Mechling, L.C. , & Alexander, J. L. (2012). Video self-prompting and mobile technology to increase daily living and vocational independence for students with autism spectrum disorders. Journal of Developmental and Physical Disabilities 24, 269–285. doi:10.1007/s10882-012-9270-8.
Billstedt, E. , Gillberg, C. , & Gillberg, C. (2005). Autism after adolesence: Population-based 13- to 22-year follow-up study of 120 individuals with autism diagnosed in childhood. Journal of Autism and Developmental Disorders 35, 351–360. doi:10.1007/s10803-005-3302-5.
Bolman, W. M. (2008). Brief report: 25-year follow-up of a high functioning autistic child. Journal of Autism and Developmental Disorders 38, 181–183. doi:10.1007/s10803-007-0362-8.
Booker, C. L. , & Sacker, A. (2011). Pyschological well-being and reactions to multiple unemployment events: Adaptation or Sensitisation?. Journal of Epidemiology and Community Health, 66, 832–838. doi:10.1136/jech.2010.126755.
*Bross, L. A. , Travers, J. C. , Munandar, V. D. , & Morningstar, M. (2018). Video modeling to improve customer service skills of an employed young adult with autism. Focus on Autism and Other Developmental Disabilities 34(4), 226–235. doi:10.1177/1088357618805990.
Burckley, E. , Tincani, M. , & Guld Fisher, A. (2015). An iPad™-based picture and video activity schedule increases community shopping skills of a young adult with autism spectrum disorder and intellectual disability. Developmental Neurorehabilitation, 18, 131–136. doi:10.3109/17518423.2014.9450459.
*Burke, R. V. , Allen, K. D. , Howard, M. R. , Doug, D. , Matz, M. G. , & Bowen, S. L. (2013). Tablet-based video modeling and prompting in the workplace for individuals with autism. Journal of Vocational Rehabilitation 38(1), 1–14. doi:10.3233/JVR-120616.
*Burke, R. V. , Andersen, M. N. , Bowen, S. L. , Howard, M. R. , & Allen, K. D. (2010). Evaluation of two instruction methods to increase employment options for young adults with autism spectrum disorders. Research in Developmental Disabilities 31, 1223–1233. doi:10.1016/j.ridd.2010.07.023.
Burton, C. E. , Aderson, D. H. , Prater, M. A. , & Dyches, T. T. (2013). Video self-modeling on an iPad to teach functional math skills to adolescents with autism and intellectual disability. Focus on Autism and Other Developmental Disabilities 28, 67–77. doi:10.1177/1088357613478829.
Carter, E. W. , Austin, D. , & Trainor, A. A. (2012). Predictors of postschool employment outcomes for young adults with severe disabilities. Journal of Disability Policy Studies 23, 50–63. doi:10.1177/1044207311414680.
Catalano, R. , Goldman-Mellor, S. , Saxton, K. , Margerison-Zilko, Subbaraman, M. , LeWinn, K. , & Anderson, E. (2011). The health effects on economic decline. Annual Review of Public Health 32, 431–450. doi:10.1146/annurev-publhealth-031210-101146.
Chen, C. , Lee, I. , & Lin, L. (2015). Augmented reality-based self-facial modeling to promote the emotional expression and social skills of adolescents with autism spectrum disorders. Research in Developmental Disabilities 36, 396–403. doi:10.1016/j.ridd.2014.10.015.
*Cihak, D. F. , & Schrader, L. (2009). Does the model matter? Comparing video self-modeling and video adult modeling for task acquisition and maintenance by adolescents with autism spectrum disorders. Journal of Special Education Technology 23, 9–20. doi:10.1177/016264340802300302.
Cook, B. , Buysse, V. , Klingner, J. , Landrum, T. , McWilliam, R. , Tankersley, M. , & Test, D. (2014). Council for exceptional children standards for evidence-based practices in special education. Council for Exceptional Children.
Dowrick, P. W. (1999). A review of self modeling and related interventions. Applied and Preventive Psychology 8, 23–29. doi:10.1016/S0962-1849(99)80009-2.
*Goh, A. , & Bambara, L. M. (2013). Video self-modeling: A job skills intervention with individuals with intellectual disability in employment settings. Education and Training in Autism and Developmental Disabilities 48(1), 103–119.
*Gentry, T. , Kriner, R. , Sima, A. , McDonough, J. , & Wehman, P. (2015). Reducing the need for personal supports among workers with autism using an iPod touch as an assistive technology: Delayed randomized control trial. Journal of Autism and Developmental Disorders 45, 669–684. doi:10.1007/s10803-014-2221-8.
Hartung, P. J. (2011). Barrier or benefit? Emotion in life-career design. Journal of Career Assessment 19, 296–305. doi:10.1177/1069072710395536.
*Hayes, G. R. , Custodio, V. E. , Haimson, O. L. , Nguyen, K. , Ringland, K. E. , Ulgado, R. R. , Waterhouse, A. , & Weiner, R. (2015). Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation 43(3), 275–287. doi:10.3233/JVR-150775.
Hendricks, D. (2010). Employment and adults with autism spectrum disorders: Challenges and strategies for success. Journal of Vocational Rehabilitation 32, 125–134. doi:10.3233/JVR-2010-0502.
Higgins, K. K. , Koch, L. C. , Boughfman, E. M. , & Vierstra, C. (2008). School-to-work transition and Asperger syndrome. Work 31, 291–298.
Hurlbutt, K. , & Chalmers, L. (2004). Employment and adults with Asperger syndrome. Focus on Autism and Other Developmental Disabilities 19, 215–222. doi:10.1177/10883576040190040301.
*Kellems, R. O. , & Morningstar, M. E. (2012). Using video modeling delivered through iPods to teach vocational tasks to young adults with autism spectrum disorders. Career Development and Transition for Exceptional Individuals 35, 155–167. doi:10.1177/0885728812443082.
Koegel, L. K. , Ashbaug, K. , Navab, A. N. , & Koegel, R. L. (2016). Improving empathic communication skills in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders 46, 921–933. doi:10.1007/s10803-015-2633-0.
*Mackey, M. , & Nelson, G. (2015). Twins with autism: Utilising video feedback to improve job-related behaviours. British Journal of Special Education 42, 390–410. doi:10.1111/1467-8578.12107.
Mason, R. A. , Rispoli, M. , Ganz, J. B. , Boles, M. B. , & Orr, K. (2012). Effects of video modeling on communicative social skills of college students with asperger syndrome. Developmental Neurorehabilitation 15, 425–434. doi:10.3109/17518423.2012.704530.
Mechling, L. C. , Ayres, K. M. , Foster, A. L. , & Bryant, K. J. (2013). Comparing the effects of commercially available and custom-made video prompting for teaching cooking skills to high school studens with autism. Remedial and Special Education 34, 371–383. doi:10.1177/0741932513494856.
Müller, E. , Schuler, A. , Burton, B. A. , & Yates, G. B. (2003). Meeting the vocational support needs of individuals with Asperger syndrome and other autism spectrum disabilities. Journal of Vocational Rehabilitation 18, 163–175.
Munandar, V. D. (2016). Efficacy of video modeling in improving job interviewing skills for two college students with autism [Unpublished master‘s project]. University of Kansas.
Newman, L. , Wagner, M. , Knokey, A. M. , Marder, C. , Nagle, K. , Shaver, D. , Wei, X. , Cameto, R. , Contreras, E. , Ferguson, K. , Greene, S. , & Schwarting, M. (2011). The post-high school outcomes of young adults with disabilities up to 8 years after high school. A report from the National Longitudinal Transition Study-2 (NLTS2). (NCSER 2011-3005). SRI International.
Paul, K. I. , & Moser, K. (2009). Unemployment impairs mental-health: Meta-analyses. Journal of Vocational Behavior, 264–282. doi:10.1016/j.jvb.2009.01.001.
*Pistoro, K. H. , Brady, M. P. , Kearney, K. , & Downey, A. (2018). Comparing different delivery models for literacy-based behavioral interventions during employment training for college students with developmental disabilities. Education and Training in Autism and Developmental Disabilities 53(3), 299–310.
Selenko, E. , Batinic, B. , & Paul, K. I. (2011). Does latent deprivation lead to psychological distress? Investigating Jahoda’s model in a four-wave study. Journal of Occupational and Organizational Psychology 84, 723–740. doi:10.1348/096317910X519360.
Shattuck, P. T. , Narendorf, S. C. , Cooper, B. , Sterzing, P. R. , Wagner, M. , & Taylor, J. L. (2012). Postsecondary education and employment among youth with an autism spectrum disorder. Pediatrics 129, 1042–1049. doi:10.1542/peds.2011-2864.
Shukla-Mehta, S. , Miller, T. , & Callahan, K. J. (2009). Evaluating the effectiveness of video instruction on social and communication skills training for children with autism spectrum disorders: A review of the literature. Focus on Autism and Other Developmental Disabilities 25, 23–36. doi:10.1177/1088357609352901.
Smith, M. J. , Ginger, E. J. , Wright, K. , Wright, M. A. , Taylor, J. L. , Humm, L. B. , Olsen, D. E. , Bell, M. D. , & Fleming, M. F. (2014). Virtual reality job interview training in adults with autism. Journal of Autism and Developmental Disorders 44, 2450–2463. doi:10.1007/s10803-014-2113-y.
*Strickland, D. C. , Coles, C. D. , & Southern, L. B. (2013). JobTIPS: A transition to employment program for individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders 43, 2472–2483. doi:10.1007/s10803-013-1800-4.
Sung, C. , Sánchez, J. , Kuo H-J. , Wang C-C. , & Leahy M. J. (2015). Gender differences in vocational rehabilitation services predictors of successful competitive employment for transition-aged individuals with autism. Journal of Autism and Developmental Disorders 45, 3204–3218. doi:10.1007/s10803-015-2480-z.
Tetreault, A. S. , & Lerman, D. C. (2010). Teaching social skills to children with autism using point-of-view video modeling. Education and Treatment of Children 33, 395–419. doi:10.1353/etc.0.0105.
Uthayakumar, R. , Schimmack, U. , Hartung, P. J. , & Rogers, J. R. (2010). Career decidedness as a predicator of subjective well-being. Journal of Vocational Behavior 77, 196–204. doi:10.1016/j.jvb.2010.07.002.
*Van Laarhoven, T. , Winiarski, L. , Blood, E. , & Chan, J. M. (2012). Maintaining vocational skills of individuals with autism and developmental disabilities through video modeling. Education and Training in Autism and Developmental Disabilities 47, 447–461.
*Walsh, E. , Holloway, J. , & Lydon, H. (2018). An evaluation of a social skills intervention for adults with autism spectrum disorder and intellectul disabilities preparing for employment in Ireland: A pilot study. Journal of Autism and Developmental Disorders 48, 1727–1741. doi:10.1007/s10803-017-3441-5.
Wilson, K. P. (2013). Teaching social-communication skills to preschoolers with autism: Efficacy of video versus in vivo modeling in the classroom. Journal of Autism and Developmental Disorders 43, 1819–1831. doi:10.1007%2Fs10803-012-1731-5.
Wong, C. , Odom, S. L. , Hume, K. A. , Cox, A. W. , Fettig, A. , Kucharczyk, S. , Brock, M. E. , Plavnick, J. B. , Fleury, V. P. , & Schultz, T. R. (2015). Evidence-based practice for children, youth, and young adults with autism spectrum disorder: A comprehensive review. Journal of Autism and Developmental Disorders 45, 1951–1966. doi:10.1007/s10803-014-2351-z.
Workforce Innovation and Opportunity Act. (2018). WIOA title I and III national performance summary program year 2016. https://www.doleta.gov/Performance/Results/AnnualReports/PY2016/WIOA_National_Summary/WIOA_PY_2016_Nationa_l_Summary_3-16-18.pdf.