This paper is in the following e-collection/theme issue:

Children and Youth with Disabilities (48) Occupational Therapy and Vocational Rehabilitation (36)

Published on in Vol 2, No 1 (2019): Jan-Jun

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/12088, first published .
A 12-Week Electronic Mentoring Employment Preparation Intervention for Youth With Physical Disabilities: Pilot Feasibility Randomized Controlled Trial

A 12-Week Electronic Mentoring Employment Preparation Intervention for Youth With Physical Disabilities: Pilot Feasibility Randomized Controlled Trial

A 12-Week Electronic Mentoring Employment Preparation Intervention for Youth With Physical Disabilities: Pilot Feasibility Randomized Controlled Trial

Authors of this article:

Sally Lindsay1 Author Orcid Image ;   Elaine Cagliostro2 Author Orcid Image ;   Joanne Leck3 Author Orcid Image ;   Jennifer Stinson4 Author Orcid Image
Article Authors Cited by (7) Tweetations (2) Metrics

    Original Paper

    1Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Department of Occupational Science & Occupational Therapy, University of Toronto, Toronto, ON, Canada

    2Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada

    3Telfer School of Management, University of Ottawa, Ottawa, ON, Canada

    4Hospital for Sick Children, Bloomberg Faculty of Nursing, University of Toronto, Toronto, ON, Canada

    Corresponding Author:

    Sally Lindsay, BA, MA, PhD

    Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital

    Department of Occupational Science & Occupational Therapy

    University of Toronto

    150 Kilgour Road

    Toronto, ON, M4G 1R8

    Canada

    Phone: 1 416 425 6220

    Email: slindsay@hollandbloorview.ca


    Background: Youth with disabilities are at high risk of unemployment compared with youth without disabilities. They often encounter challenges in accessing vocational programs that meet their needs. One promising approach that could help to address barriers that youth encounter while also enhancing social support is through electronic mentoring (e-mentoring). Although there is an increase in e-mentoring for youth with disabilities, little is known about its impact for youth with physical disabilities.

    Objective: This study aimed to assess the acceptability and initial impact of a Web-based peer electronic mentor employment intervention for youth with physical disabilities.

    Methods: The Empowering Youth Towards Employment intervention was evaluated using a pilot randomized controlled trial (RCT). Youth, aged 15-21 years, with physical disabilities were randomly assigned to an intervention (ie, mentored) or control (ie, not mentored) group. Trained mentors (ie, near peers) with a physical disability led the online discussion forums and provided peer support and resources for 12 modules (1 topic per week over 12 weeks). Primary outcomes focused on self-determination, career maturity, and social support. We also explored program adherence and dosage, participant satisfaction, and areas for improvement.

    Results: A total of 13 youth (mean age 17.3 years, SD 1.88; 54%, 7/13 female) completed the RCT. In the intervention group (n=9), 56% (5/9) of the youth were females, and in the control group (n=4), 50% (2/4) of the youth were female. Participants reported satisfaction with the program and that it was feasible and acceptable. Participants’ mean engagement level with the program was 5.22 (SD 2.48) for the intervention group and 5.40 (SD 4.56) for controls. Participants in the intervention group demonstrated significant improvements in self-determination (t12=2.49; P<.04) compared with the control group. No adverse events were reported.

    Conclusions: The Empowering Youth Towards Employment is a promising intervention that enhances self-determination among youth with physical disabilities.

    Trial Registration: ClinicalTrials.gov NCT02522507; https://clinicaltrials.gov/ct2/show/NCT02522507 (Archived by WebCite at http://www.webcitation.org/6uD58Pvjc)

    International Registered Report Identifier (IRRID): RR2-10.2196/resprot.8034

    JMIR Pediatr Parent 2019;2(1):e12088

    doi:10.2196/12088

    Keywords

    social support; mentor; employment; youth; disabled persons; rehabilitation; occupational therapy 


    Background

    Although many young people with disabilities are willing and capable of working, they encounter many personal, environmental, and socio-contextual challenges (eg, inaccessible jobs and discrimination) in finding and maintaining meaningful employment [1]. Their persistently low employment rates are about half or less compared with youth without disabilities [2-4]. Although youth with disabilities could benefit from employment training programs, they are often not tailored to meet the needs of youth with disabilities (eg, self-care at work, disclosing a disability, and requesting accommodations). Of the programs that are targeted toward people with disabilities, they often focus on youth with intellectual or developmental disabilities, whereas less attention has been paid to youth with physical disabilities [1,3,4]. There are limited evidence-based employment preparation programs for youth with disabilities in Canada [5,6]. For example, a systematic review by Hanif et al [5] focusing on employment preparation programs for youth with physical disabilities found only 8 empirical studies in this area. Although there is limited research on this particular population, the findings are promising and show potential to improve self-confidence, self-awareness, goal setting, and knowledge of career options [5]. Although some evidence suggests that vocational programs can influence employment outcomes for youth with disabilities, much further research is needed [5]. Focusing on youth with physical disabilities is important because they arguably have different needs regarding developmental tasks, social development, and role functioning [7,8]. Furthermore, this period of emerging adulthood is an optimal time to help youth develop critical job and independence skills [9].

    Mentoring involves developing a relationship between a more experienced individual who serves as a role model and shares knowledge with a less experienced individual [10,11] and can help provide youth with informational, practical, and emotional assistance to enhance coping skills as youth transition to adulthood [12-15]. Mentoring has beneficial impacts on job training, educational attainment, social skills, self-esteem, self-efficacy, work ethic, and employment outcomes [16-18]. Mentoring is particularly useful for groups that are considered to be disadvantaged, such as youth with disabilities [15,19]. Research on mentoring programs among youth without disabilities shows that they are a cost-effective way to augment vocational and educational services while also promoting positive behaviors (eg, self-efficacy, quality of life, and employment skills) [12,20-23]. A meta-analysis focusing on youth without disabilities showed that the key ingredients of peer mentor interventions involve trained mentors, monitored implementation, structured activities, and parental involvement [20]. Until recently, most mentoring programs (in general and those specific to employment) have not included nor specifically targeted youth with disabilities [15,18]. A common challenge with mentoring programs is that it is often difficult to meet face-to-face. Thus, having a Web-based format can help to overcome some of these challenges [24]. Peer electronic mentoring (e-mentoring) may be 1 way to help youth to gain valuable employment preparation skills in an accessible format. Research demonstrates that Web-based platforms can influence learning and behavior change [25-27]. Web-based formats are particularly relevant for youth, given that the majority of them seek information and communicate over the internet [28]. E-mentoring formats are also flexible in regard to matching participants to a mentor and asynchronous communication [29].

    Rationale

    This study addresses an important gap in the literature by offering a Web-based employment preparation intervention for youth with physical disabilities. Such youth often encounter different challenges compared with youth with invisible disabilities or chronic illnesses because their condition is often visible, and they also encounter difficulties in mobilities, speech, independence, coping, stigma, and social exclusion [30]. Our intervention aims to strengthen youth’s employment preparation skills including self-determination, career maturity, and social support, all of which can have beneficial effects for employment outcomes [15,19,31-34].


    Objective

    Our main objective was to assess the feasibility, acceptability, and initial efficacy (ie, pilot randomized controlled trial, RCT) of an electronic mentor (e-mentor) employment preparation intervention for youth with physical disabilities for improving self-determination, career maturity, and social support compared with controls. A secondary objective includes exploring program adherence and dosage, participant satisfaction, and areas for improvement.

    Design

    A pilot RCT, with an embedded qualitative design [35], was chosen to test the feasibility and initial efficacy of the Empowering Youth Towards Employment intervention for youth with physical disabilities. This intention to treat design involves an intervention group that received employment preparation Web-based modules and a peer e-mentor. Meanwhile, the control group received the Web-based modules only (no mentor) but could interact with other participants within their group. We administered pre- and postsurveys (immediately following the completion of the intervention) for both groups (intervention and control). We followed the Medical Research Council Framework for the development and evaluation of RCTs to guide our design [36]. We focused on the development and feasibility phases to establish the theoretical underpinnings and modeling to test the feasibility of key intervention components [36]. The qualitative data comprised open-ended survey questions and researcher’s observation field notes.

    The rationale, design, content, and length of our intervention was based on 2 systematic reviews focusing on employment preparation interventions for youth with physical disabilities [5] and best practices of peer mentorship for improving employment outcomes [15] and 2 scoping reviews on improving the inclusion of people with disabilities in the workforce [37] and mentoring practices for a diverse workforce [38]. We also conducted needs assessments regarding informational and social support for youth with disabilities [7,39].

    Procedures and Randomization

    We received institutional research ethics board approval (from a pediatric hospital and a university). Eligible participants were sent an information letter and phone call from the research team. The research assistant screened all participants and obtained informed written consent before enrolling them in the intervention. Once participants consented, they were randomized into an intervention or control group using a block size of 10 [40]. Participants were then emailed the presurvey (see measures below). Next, a research assistant contacted participants to inform them of their group assignment and instruct them on the procedures to be followed (see Figure 1 for trial schema).

    Intervention (Experimental Group)

    The purpose of the intervention was to provide meaningful support and access to evidence-based employment resources so that youth can begin thinking about preparing for employment. The content and length of our intervention were evidence-informed by 2 systematic reviews, a scoping review, and a needs assessment conducted by our team [5,15,37,39]. It was cocreated with a knowledge user advisory group and consists of 12 modules (1 per week over 12 weeks) that were delivered by youth peer mentors in a password-protected online discussion forum (see Multimedia Appendix 1 for topics). Each module contained informative resources and interactive materials (ie, articles and videos) that could be viewed at their own pace, homework, and discussions led by trained peer mentors. The group-based intervention involved up to 10 participants per group plus 2 mentors (ie, trained near-peers who have a physical disability). Youth were given access to a separate password-protected area of AbilityOnline website, a safe forum for youth with disabilities. It was important to note that we piloted the 12-week format before switching to a 4-week format (reported elsewhere) [6].

    ‎
    Figure 1. Search process flow diagram.

    Youth mentors presented each of the topics to mentored participants in the same order using a script. To ensure treatment fidelity, each mentor received the same training and regular check-ins with project staff. They provided their own personal experiences and examples related to each topic and were instructed to respond to all posts while offering informational, emotional, and social support, which they received training in. The asynchronous discussion forum was available to all participants in the group (eg, intervention or control). Participants were instructed to log in to the forum at least once a week, which they could do at a time that was convenient for them. Mentors posted their availability (ie, when they would be in the forum) if participants wanted to discuss something in real time. To be considered for the role of a peer mentor, eligible young adults had lived experience with a physical disability, some employment experience, and have completed the 3-day Youth Peer Mentor Training program that runs out of a pediatric rehabilitation hospital [41]. Mentors also completed project-specific training (ie, active listening, perspective taking, confidentiality, maintaining boundaries, positive role modeling, trust building through interactive training, and mentoring) before starting. Mentors included 2 youth (1 male and 1 female, mean age 21.5 years) who had a physical disability. Mentors introduced the topics in the same order and were trained to respond to participants’ comments in a similar supportive and positive-focused manner [6].

    Control Group

    The control group had access to a separate password-protected group within the Web-based forum that contained the modules only, and they did not receive peer mentorship [6]. Instead, a researcher posted the weekly discussion topics but was instructed to not reply to any participant posts. Youth participants within the control group could interact with other participants in their group, but such discussions were not facilitated by a mentor.

    Recruitment

    Participants were recruited from June to September 2016 through invitation letters sent from a pediatric hospital and disability organizations through referrals and advertisements. Potential participants also contacted us if they were interested in participating. Inclusion criteria involved the following: (1) able to read and write in English, (2) aged 15 to 25 years, (3) have access to a computing device with internet access, (4) currently enrolled in or recently completed a high school diploma in the applied or academic stream (to screen for cognitive impairment), (5) have no paid work experience, and (6) youth with a physical disability (eg, cerebral palsy, spina bifida, muscular dystrophy, and spinal cord injury) [6]. Here, we refer to disability as impairment, activity limitation, and participation restriction, whereby a disability and functioning are shaped by interactions between health conditions and contextual factors [42]. Our rationale for this age group and also choosing youth without employment experience was that youth with disabilities often start their first job later than youth without disabilities [39]. Exclusion criteria involve those who recently completed or who are currently participating in another employment preparation or peer support intervention [6].

    Information packages were mailed to 330 potential participants, and the research team followed up with potential participants via phone (n=298) or email (n=32) to assess interest and availability for the study. If youth were interested in participating in the study, they were then screened for eligibility by a researcher, and if eligible, they were required to sign a written consent or assent form before taking part in the study. We were able to reach and assess 193 participants for eligibility. A total of 173 participants were excluded (see Figure 1 for reasons). All the 13 participants who joined the study provided written consent, completed a presurvey, signed up for the intervention website, and completed the postsurvey after the completion of the intervention. A total of 20 participants expressed interest in the study, met the inclusion criteria, and provided written consent. Using a block size of 10, participants were randomly assigned into either the experimental (ie, mentored) or control group (see Figure 1 for trial schema).

    A total of 7 participants dropped out of the study. Of the participants, 1 dropped out of the intervention group because of medical complications, and 6 participants dropped out of the control group (see Figure 1 for reasons). A total of 13 participants completed the intervention and postsurveys (9 intervention and 4 controls).

    Outcome Measures

    In addition to basic demographic information (see Table 1), participants completed 3 standardized measures at baseline and at completion of the study to explore self-determination [43], career maturity inventory attitude scale [43], and multidimensional scale of perceived social support [44]. These standardized measures have good internal consistency, construct-related and criterion validity, and test-retest reliability and have been widely used for youth with disabilities [43-46]. Given that the focus of this study was feasibility, these outcome measures were exploratory to examine variances to help determine appropriate outcomes and sample size for future full-scale RCTs.

    The first outcome measure, Arc’s Self-Determination Scale [46], consists of a self-report measure that assesses self-determination for adolescents with disabilities, with subscales on autonomy, acting on the basis of preferences and abilities (postschool directions), goal setting, and task performance (eg, “I make my own my own meals or snacks” and “I make long-range career plans”). The scale includes I do not even if I have the chance (0), I do sometimes when I have a chance (1), I do most of the time when I have a chance, and I do every time I have the chance (3) [46].

    The second outcome measure, Career Maturity Inventory Attitude Scale [43,45], is a 25-item agree (1) or disagree (0) scale where responses form the bases for 5 subscales relating to career decision making including orientation, involvement, independence, compromise, and decisiveness (eg, “there is no point in deciding on a job when the future is so uncertain,” “I don’t know what courses I should take in school.” and “I keep changing my occupational choice”) [45,47].

    The third measure, Multidimensional Scale of Perceived Social Support, includes a 12-item questionnaire that captures perceived social support from various sources (ie, parents, siblings, friends, and peers). Example items include “there is a special person who is around when I am in need,” “my family really tries to help me,” and “I can count on my friends when things go wrong.” The scale involves the following: very strongly disagree (0), strongly disagree (1), mildly disagree (2), neutral (3), mildly agree (4), strongly agree (5), and very strongly agree (6). Scores are summed for a total score, with higher scores reflecting higher values of social support [47].

    Secondary measures include Web-based usage (ie, number of times logged in and length of time on the forum); how much they liked each topic, based on the Web-hosting Drupal platform analytics. We also describe adherence with the intervention, engagement (self-rated scale of 0-10, with higher scores reflecting higher engagement in the program), and satisfaction with the program as measured through open-ended questions in the postsurveys. Other parameters explored included recruitment accrual rates, program adherence, and satisfaction with the intervention, along with suggestions for improvement.

    Data Analysis

    Data were analyzed using IBM SPSS, version 25. Descriptive statistics were used to describe the sample characteristics at baseline using means and SD for continuous variables and frequencies and portions for categorical variables. t tests were conducted to compare baseline characteristics between the intervention and control groups. Separate analyses were conducted for each outcome. Holm’s sequential correction will be applied to control for type I error. Effect sizes were determined using Cohen d, with 0.2 as indicative of a small effect, 0.5 medium effect, and 0.8 large effect. A level of .05 was used as the criterion for statistical significance.

    Qualitative analysis of the open-ended survey questions and researcher’s field notes involved 2 team members reviewing all data independently, and then, they compared the findings and analyzed them thematically through an open-coding, constant comparison approach [48]. Any discrepancies were resolved through discussion of the themes and reevaluated until consensus was reached. We kept a log of the key decisions made throughout the analysis to help improve the credibility of our findings [48].


    Sample Characteristics

    A total of 13 adolescents (mean age 17.3, SD 1.88; 54% female; range 15-21 years) completed the study, which ran from July 2016 to December 2016. A total of 6 participants had cerebral palsy, 4 had muscular dystrophy, 2 had Charcot Marie tooth disease, and 1 had metabolic bone disease. A total of 6 participants in the intervention group and 4 in the control group used an assistive or mobility device. The majority of the participants (6 intervention, 4 control) were currently enrolled in school. The remainder completed high school or were unemployed. There were no significant differences between the groups on demographic variables at baseline (see Table 1).

    In regard to self-rated engagement in the intervention, there were no significant differences between the intervention (mean 5.22, SD 2.48) and control groups (mean 5.40, SD 4.56). Both groups spent a similar amount of time on the website (intervention: mean 1.1 hours, SD 1.3; control: mean 1.55 hours, SD 1.85).

    Table 1. Demographic characteristics of participants and mentors.
    Demographic characteristicsParticipantsMentors (n=2)

    		Intervention (n=9)Control (n=4)
    Age (years), mean (SD)17.8 (1.7)16.25 (1.89)21.5 (1.5)
    Sex (n)

    		Male421

    		Female521
    Disability type (n)

    		Cerebral palsy421

    		Muscular dystrophy310

    		Charcot Marie tooth disease200

    		Metabolic bone disease010

    		Other physical disability001
    Use an assistive or mobility device (n)642
    Currently enrolled in school (n)642
    Total time spent on the website (hours), mean (SD)1.1 (1.3)1.55 (1.85)6.38 (5.41)
    Number of posts and messages, mean (SD)6.77 (6.49)3.0 (4.69)35.5 (6.36)
    Number of logins, mean (SD)34.3 (59.0)7.25 (3.68)99.5 (85.55)
    Self-rated engagement, mean (SD)5.22 (2.48)5.40 (4.56)7 (0)

    Although the intervention group logged in more times (intervention: mean 34.3, SD 59.0; control: mean 7.24, SD 3.68) and posted more messages on average than controls (intervention: mean 6.77, SD 6.49; control: mean 3.0, SD 4.69), the differences between the groups were not significant.

    Primary Outcome Analysis

    Our primary outcome for this study focused on the feasibility of the Empowering Youth Towards Employment intervention. t tests (between time 1 and time 2) were computed to examine differences on each outcome including self-determination, career maturity, and social support. Separate analyses were conducted for each outcome. There were no significant differences on outcome measures at baseline. After controlling for baseline scores, participants in the intervention group had significantly improved self-determination scores after the intervention compared with those in the control group (t12=2.49; P<.03; d=.70; see Tables 2 and 3 for comparison of outcome measures between the 2 groups). There were no significant differences in career maturity or social support between the intervention and control groups following the intervention.

    Program Adherence and Dosage

    Mentors delivered the intervention as instructed in the protocol and posted a unique topic once a week. The researchers monitored this through the discussion boards. The mentor’s role was also to respond to participant comments, which was done majority (82%) of the time. A total of 18% of the messages posted by participants did not get a response from mentors. A total of 2 of these messages were follow-up responses from participants on a specific topic. In a few instances, mentors posted a longer, more generic statement that addressed several different comments rather than addressing each specific participant.

    The control group ran as planned, where a research assistant posted 1 topic per week, which included general information and discussion questions. The researcher who posted the topics in the control group did not respond to any of the participants’ posts in the forum, as directed in the protocol. All 12 topics were posted at the beginning of the week as prescribed, and the full extent of the intervention was delivered to participants.

    Participant Satisfaction With the Intervention

    A total of 8 out of 9 (89%) of intervention group participants and 4 out of 4 (100%) of the control group participants said they would recommend the intervention to others. In their open-ended survey responses, participants described their level of satisfaction with the intervention and whether they would recommend it to others. Specifically, youth in both the intervention and control groups reported satisfaction with receiving information and feedback. A total of 3 participants in the intervention and 3 in the control group reported enjoying the information provided in the intervention, especially the employment preparation content and disability specific resources. For example, a participant in the intervention group commented that the intervention “gives a lot of advice on how to get to work where you want to and how to overcome the disability, which is helpful” [#1-09]. Furthermore, giving and receiving feedback was another aspect that participants (5 intervention, 1 control) appreciated. Such advice included feedback from peer mentors related to career strategies, overcoming disability-related challenges, and sharing experiences related to the intervention topics. For example, 1 intervention group participant shared:

    I was able to suggest some things I did that helped me with some of my issues which I hope helped my colleagues.
    [#1-03]

    Participants also expressed contentment with the Web-based format of the intervention, stating it was “well-organized” [#1-02] and that the Web-based format “was the easiest one to learn from and get information from” [#1-05]. Furthermore, 7 participants in the intervention group had positive feedback regarding the social interaction and social support components provided through the intervention. For example, a participant shared that they “enjoyed connecting with...the mentors because it made the ideas of transition to postsecondary seem less daunting”[#1-05]. Another youth highlighted a benefit of the program:

    It is very important to hear the opinions of people with disabilities. So, if someone feels alone they know they’re not the only ones going through certain situations.
    [#1-02]
    Table 2. Descriptive statistics on participant outcomes (time 1) by group.
    VariableIntervention group (n=9), mean (SD)Control group (n=4), mean (SD)t (df)P valueEffect size (Cohen d)
    Self-determination22.3 (5.17)14.5 (3.69)3.35 (12).060.88
    Career maturity13.0 (3.27)13.0 (7.02)0 (12)>.990
    Social support49.5 (21.07)58.0 (17.7)−1.005 (12).330.21
    Table 3. Differences in outcomes between experimental and control groups (time 2).
    VariableIntervention group (n=9), mean (SD)Control group (n=4), mean (SD)t (df)P valueEffect size (Cohen d)
    Self-determination23.0 (5.78)13.5 (7.59)2.49 (12).030.7
    Career maturity13.75 (3.10)15.25 (4.11)−0.71 (12).490.71
    Social support49.5 (21.07)60.5 (13.27)−0.946 (12).360.32

    One of the main goals of the intervention was to provide employment resources and information to participants, which was deemed as helpful by most participants, such as participant #1-04, who stated:

    The study was very informative and helped a lot with my plans for my career.

    A participant in the control group also discussed that they enjoyed the program because “you get good information and tips“ [#2-03].

    Areas for Improvement

    Some participants had suggestions about how the intervention could be improved. For example, some participants noted that it would be helpful to have more prompts to keep them engaged throughout the 12 weeks. Lack of engagement was often associated with personal reasons (ie, too busy or forgetting to log in, too shy to participate, etc). For instance, a participant in the intervention group explained:

    I enjoyed the program; however my summer became very busy and I regret not being able to engage in the program.
    [#1-02]

    Another participant suggested:

    Sometimes I forgot to check the website during the week so it would be helpful to receive an email reminding me to check any updates.
    [#1-03]

    One participant in the intervention group who had logged in few times but did not post describes:

    I needed greater clarity on time frame and expectations. I’m sorry I was a passive participant and did not engage in the discussions more.
    [#1-01]

    A total of 3 intervention participants and 1 control group participant mentioned that they found it difficult to remember to log in to the website or had limited access to a computer, which made it difficult to participate on a regular basis.

    Other participants wanted improvements to the website. For instance, a participant in the control group explained that they found the “layout of the website was confusing...and hard to navigate” [#2-05]. Meanwhile, a participant in the intervention group suggested:

    The website could have a better UI (User Interface) so it has a better feel.
    [#1-09]

    Principal Findings

    Our findings show that the Empowering Youth Towards Employment intervention demonstrated acceptability and preliminary evidence of impact in 1 of the outcome measures within a sample of youth with physical disabilities. Youth with disabilities are considered a vulnerable population that has unique vocational needs [15]. Helping them to gain employment skills is important because they often encounter significantly higher unemployment rates compared with youth without disabilities [6,49]. Therefore, providing mentoring and resources within a Web-based forum is 1 potential way that can help to engage youth with disabilities within an accessible format [50]. Peer mentors can act as role models who help to normalize the experience of transitioning to work for those who have a disability. Knowing that others have gone through a similar experience may help to increase their motivation for pursuing vocational interests [51,52]. Youth may be more receptive to receiving information from a peer who is closer in age [52]. Previous research shows that mentoring is a promising mechanism that can help to enhance youth’s inclusion while also offering support and coping strategies [53]. Web-based platforms can also influence learning and behavior change [26]. Our study is novel in that it offers an employment preparation program through an e-mentor platform. Most previous studies focus on self-management and health-related outcomes.

    Our results indicated significant improvements in self-determination (large effect) among the youth in the intervention (ie, mentored) group. Previous research shows that there is a strong link between mentoring and improvements in self-efficacy [54], self-determination [55,56], and self-confidence [57]. For example, Gregg et al’s [55] study explored the effectiveness of virtual mentoring to enhance the persistence of secondary and postsecondary students with learning disabilities in science, technology, engineering, and mathematics and found improved self-determination [55]. Indeed, helping youth to develop their self-determination and self-advocacy skills is important because it is critical for optimizing their participation and inclusion in society [58-60].

    A total of 2 of the measures within our study, career maturity and social support, showed no significant improvement following the intervention. These findings are somewhat surprising and contrast other e-mentor interventions focusing on youth with visual impairments and blindness (using a mixed format including face-to-face and group-based activities, email, and phone calls) that found significant improvement in career decision making [61]. Another study involving 8 e-mentoring sessions to enhance the transition to college for youth with disabilities [62] found significant improvements in career decision self-efficacy. This discrepancy could be partly a result of the small sample size, differences in the disability types explored, the length of the mentoring interventions, differences in the measures used, and lack of control groups in these studies.

    Research shows that early vocational experiences are associated with the development of career maturity and vocational identity, contributing to a positive career trajectory [33,34]. Vocational maturity is characterized by the extent to which one is concerned with seeking out a career choice; investigating and planning for an occupation; stable occupational preference over time; realistic attitudes toward work; and habits, interests, and abilities that match one’s occupational preference [33,63]. Most studies exploring career maturity among youth with disabilities focus on the college age [31]. Given that the average age of our sample was younger, it could be that youth are still very early on in their development and need more time and experience to further develop their career maturity.

    Our results also showed no significant improvements in social support within the time frame of this study. This finding could be a result of the social support provided by peer mentors (eg, encouragement and sharing experiences), perhaps acting as a mediating factor affecting self-determination [32]. For example, research shows that employment success can be achieved through social relationships [64] or perhaps, the participants in our study already had good support systems in place from family and friends. Some research suggests that the e-mentoring process lacks verbal communication cues, which result in more impersonal or superficial relationships between mentor and mentee, and therefore, more informal or conversational language should be used to encourage closeness [53,65]. Interestingly, participants expressed satisfaction in social interactions and support from the intervention in the open-ended survey responses.

    Our findings highlighted participants’ satisfaction with the intervention, and the majority would recommend it to other youth. Somewhat surprising, however, is that their self-reported levels of engagement were somewhat lower than expected. This could have been because of the 12-week length of the program and many youth were busy with school and often found it difficult to participate as often as they would have hoped to. We observed that engagement levels, based on the number of posts per topic, decreased over the course of the 12-week intervention. We recommend that the research team and youth mentors check in more regularly with the participants to help keep them engaged throughout the intervention. Other studies on mentoring among youth with disabilities show that having small group activities [66] and family support [21,67] can help keep participants engaged, along with timely responses from mentors [65].

    Our results showed lower than expected engagement levels, which suggest that the intervention may not be appropriate in its current form for youth with physical disabilities. The intervention could benefit from flexibility in the length of the program to increase acceptability to a larger group of youth. Some youth may have found it difficult to remain engaged for 12 weeks, especially with ongoing school commitments. Our findings are consistent with past research focusing on youth without disabilities, showing that maintaining engagement of participants within an e-mentor format can be challenging, and engagement may decrease as the intervention progresses [68,69]. One topic per week may also not be enough interaction to keep youth engaged, as research shows that frequent and consistent contact is useful for a successful mentoring relationship [65,70,71]. Therefore, we recommend that a shorter, more condensed format, perhaps over the summer months when youth are not as busy with school, may be more suitable.

    Limitations and Future Directions

    It is important to consider the limitations of this study, which focused on the feasibility and initial impact of the intervention. First, we were underpowered in some of the analyses. Our sample size was small, and we recruited from only 1 site, which limits the generalizability of the findings. Second, some youth who completed a presurvey and participated in the discussion forum did not complete a postsurvey, which excluded them from the analysis. This was particularly the case for the control group. Therefore, it is important to note that more of the participants in the intervention group stayed in the study. The design of future interventions should consider how to maintain engagement of participants who are in the control group. Third, we included various types of physical disabilities, and each have different needs and concerns regarding preparing for employment and could have affected the results. Fourth, we were unable to determine the number of participants who looked at the resources and modules and the amount of time that they spent looking at them, which is an important factor that could influence the outcomes that we explored. Finally, the host website that we used for this intervention went through several upgrades during the course of the intervention that caused some technical difficulties that some participants experienced. This could have affected their participation and engagement in the study.

    Future studies should be directed in several areas. First, given the relatively low self-rated engagement levels, future research should have specific engagement strategies to keep participants engaged (in both the intervention and the control groups). This could involve regular check-ins to see if participants need any help with posting, reminders to contribute to the discussion, or involving a variety of different components such as face-to-face or in-person components [19]. Further support may be needed for participants who are shy or reluctant to post. Finally, further research should explore whether any potential gains from this or other similar interventions last over the long term.

    Conclusions and Implications

    The Empowering Youth Towards Employment intervention is promising in that it enhances self-determination among youth with physical disabilities. There is a growing emphasis on the importance of including a process evaluation as part of an RCT [72]. This study shows that a process evaluation can provide valuable information about an intervention, which is critical if it going to be fully implemented into practice. Furthermore, findings from the process evaluation will help interpret the outcomes of the intervention. Our results show that the length of the intervention seemed too long for both the mentors and the participants. We recommend condensing the length of the intervention into a 1-month format that would also fit into the youth’s schedule. It is important to balance addr essing the primary mentoring goal of helping youth to develop employment-related skills with fostering a meaningful mentoring relationship with participants. We recommend that further mentor training and ongoing support is needed to help facilitate this. Furthermore, our results suggest that there is value in having peer mentors who have a disability. Most previous peer mentoring studies have a mentor that does not have a disability.

    Acknowledgments

    This study was funded by a Social Sciences and Humanities Research Council (grant #435-2015-0568). The first author holds a career award from the Ontario Ministry of Research and Innovation in addition to Kimmel Matching Fund through the Bloorview Research Institute. The authors would like to thank AbilityOnline and the staff, students, and volunteers in the Transitions and Inclusive Environments lab for their support in this project.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Overview of weekly topics.

    PDF File (Adobe PDF File), 43KB
    Multimedia Appendix 2

    CONSORT‐EHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 3MB
    1. Lindsay S. Discrimination and other barriers to employment for teens and young adults with disabilities. Disabil Rehabil. 2011;33(15-16):1340-1350. [CrossRef] [Medline]
    2. Till M. Canadian Survey on Disability. 2012. URL: https://www150.statcan.gc.ca/n1/en/pub/89-654-x/89-654-x2015005-eng.pdf?st=1lfIY639 [WebCite Cache]
    3. Carter EW, Trainor AA, Ditchman N, Swedeen B, Owens L. Community-based summer work experiences of adolescents with high-incidence disabilities. J Spec Educ. Nov 13, 2009;45(2):89-103. [CrossRef]
    4. Trainor AA, Lindstrom L, Simon-Burroughs M, Martin JE, Sorrells AM. From marginalized to maximized opportunities for diverse youths with disabilities: a position paper of the Division on Career Development and Transition. Career Dev Transition Except Individ. Apr 22, 2008;31(1):56-64. [CrossRef]
    5. Hanif S, Peters H, McDougall C, Lindsay S. A systematic review of vocational interventions for youth with disabilities. In: Altman BM, editor. Factors in Studying Employment for Persons with Disability. Bingley, West Yorkshire, England. Emerald Publishing Limited; 2017:181-202.
    6. Lindsay S, Stinson J, Stergiou-Kita M, Leck J. Improving transition to employment for youth with physical disabilities: protocol for a peer electronic mentoring intervention. JMIR Res Protoc. Nov 16, 2017;6(11):e215. [FREE Full text] [CrossRef] [Medline]
    7. Lindsay S, Adams T, McDougall C, Sanford R. Skill development in an employment-training program for adolescents with disabilities. Disabil Rehabil. 2012;34(3):228-237. [FREE Full text] [CrossRef] [Medline]
    8. Barnfather A, Stewart M, Magill-Evans J, Ray L, Letourneau N. Computer-mediated support for adolescents with cerebral palsy or spina bifida. Comput Inform Nurs. 2011;29(1):24-33; quiz 34. [FREE Full text] [CrossRef] [Medline]
    9. Arnett J. Emerging adulthood: what is it, and what is it good for? Child Dev Perspect. 2007;1(2):68-73. [CrossRef]
    10. Stumbo NJ. Evidence-based practices in mentoring students with disabilities: four case studies. JSESD. Nov 01, 2009;14(1):33-54. [CrossRef]
    11. Karcher MJ, Kuperminc GP, Portwood SG, Sipe CL, Taylor AS. Mentoring programs: a framework to inform program development, research, and evaluation. J Community Psychol. Nov 2006;34(6):709-725. [CrossRef]
    12. Stinson JN, McGrath PJ, Hodnett ED, Feldman BM, Duffy CM, Huber AM, et al. An internet-based self-management program with telephone support for adolescents with arthritis: a pilot randomized controlled trial. J Rheumatol. Sep 2010;37(9):1944-1952. [CrossRef] [Medline]
    13. Fraas M, Bellerose A. Mentoring programme for adolescent survivors of acquired brain injury. Brain Inj. Jan 2010;24(1):50-61. [CrossRef] [Medline]
    14. Funnell MM. Peer-based behavioural strategies to improve chronic disease self-management and clinical outcomes: evidence, logistics, evaluation considerations and needs for future research. Fam Pract. Jun 2010;27(Suppl 1):i17-i22. [FREE Full text] [CrossRef] [Medline]
    15. Lindsay S, Fellin M. A systematic review of mentorship programs to facilitate transition to post-secondary education and employment for youth and young adults with disabilities. Disabil Rehabil. Jul 2016;38(14):1329-1349. [FREE Full text] [CrossRef] [Medline]
    16. Campbell-Whatley GD. Mentoring students with mild disabilities: the "nuts and bolts" of program development. ISC. Mar 01, 2001;36(4):211-216. [CrossRef]
    17. Shem K, Medel R, Wright J, Kolakowsky-Hayner SA, Duong T. Return to work and school: a model mentoring program for youth and young adults with spinal cord injury. Spinal Cord. Apr 2011;49(4):544-548. [CrossRef] [Medline]
    18. Sword C, Hill K. National Center on Secondary Education and Transition. URL: http://ncset.org/publications/issue/NCSETIssueBrief_1.4.pdf [accessed 2019-02-22] [WebCite Cache]
    19. Lindsay S, Munson M. National Mentoring Resource Center. 2018. URL: http:/​/nationalmentoringresourcecenter.​org/​images/​PDF/​Mentoring_for_Youth_with_Disabilities_Population_Review.​pdf [WebCite Cache]
    20. DuBois DL, Holloway BE, Valentine JC, Cooper H. Effectiveness of mentoring programs for youth: a meta-analytic review. Am J Community Psychol. Apr 2002;30(2):157-197. [FREE Full text] [CrossRef] [Medline]
    21. Powers L, Sowers J, Stevens T. An exploratory randomized study of the impact of mentoring on the self-efficacy and community-based knowledge of adolescents with severe physical challenges. J Rehabil Med. 1995;61(1):33-41. [FREE Full text]
    22. Southwick SM, Morgan CA, Vythilingam M, Charney D. Mentors enhance resilience in at-risk children and adolescents. Psychoanal Inq. Apr 12, 2007;26(4):577-584. [CrossRef]
    23. Lindstrom L, Doren B, Post C, Lombardi A. Building career PATHS (postschool achievement through higher skills) for young women with disabilities. CDQ. Dec 09, 2013;61(4):330-338. [CrossRef]
    24. Elliott C, Leck J. Shattering glass: e-mentoring and the advancement of diversity. Int J Organiz Diverse. 2016;16(4):1-15. [CrossRef]
    25. Lindsay S, Smith S, Bell F, Bellaby P. Tackling the digital divide: exploring the impact of ICT on managing heart conditions in a deprived area. Inf Commun Soc. Feb 2007;10(1):95-114. [CrossRef]
    26. Nguyen HQ, Carrieri-Kohlman V, Rankin SH, Slaughter R, Stulbarg MS. Internet-based patient education and support interventions: a review of evaluation studies and directions for future research. Comput Biol Med. Mar 2004;34(2):95-112. [FREE Full text] [CrossRef] [Medline]
    27. Eysenbach G, Powell J, Englesakis M, Rizo C, Stern A. Health related virtual communities and electronic support groups: systematic review of the effects of online peer to peer interactions. Br Med J. May 15, 2004;328(7449):1166. [FREE Full text] [CrossRef] [Medline]
    28. Lenhart A. Pew Research Center. 2015. URL: http://www.pewresearch.org/wp-content/uploads/sites/9/2015/04/PI_TeensandTech_Update2015_0409151.pdf [accessed 2019-01-18] [WebCite Cache]
    29. Thompson L, Jeffries M, Topping K. E‐mentoring for e‐learning development. IETI. Aug 2010;47(3):305-315. [CrossRef]
    30. Lindsay S, McPherson AC. Experiences of social exclusion and bullying at school among children and youth with cerebral palsy. Disabil Rehabil. 2012;34(2):101-109. [FREE Full text] [CrossRef] [Medline]
    31. Ohler J, Levinson E, Barker W. Career maturity in college students with learning disabilities. CDQ. 1996;44(3). [CrossRef]
    32. Field S, Sarver MD, Shaw SF. Self-determination: a key to success in postsecondary education for students with learning disabilities. Remedial Spec Educ. Aug 18, 2016;24(6):339-349. [CrossRef]
    33. Super D, Savickas M, Super C. A life-span, life-space approach to career development. In: Brown D, Brooks L, editors. Career choice and development. San Francisco. Jossey-Bass; 1996.
    34. Fabian ES. Urban youth with disabilities: factors affecting transition employment. Rehabil Couns Bull. Aug 13, 2016;50(3):130-138. [CrossRef]
    35. Plano Clark VL, Schumacher K, West C, Edrington J, Dunn LB, Harzstark A, et al. Practices for embedding an interpretive qualitative approach within a randomized clinical trial. J Mix Methods Res. Jul 2013;7(3):219-242. [CrossRef]
    36. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Medical Research Council Guidance.. Developing and evaluating complex interventions: the new Medical Research Council guidance. Br Med J. 2008;337:a1655. [FREE Full text] [Medline]
    37. Lindsay S, Goodfellow A, Stergiou-Kita M, Kirsh B, Lero D. Inclusionary business practices for recruiting and retaining people with disabilities. In: Physical Disabilities: Perspectives, Risk Factors and Quality of Life. New York. Nova Science publishers; 2017.
    38. Leck J, Elliott C, Bourgeois E, Kemp K. Knowledge Synthesis Grant Final Report. 2014. URL: http:/​/www.​ruor.uottawa.ca/​bitstream/​10393/​30698/​1/​TelferSchool_WP-2014-01_Leck_Elliott_Bourgeois_Kemp.​pdf [accessed 2019-02-24] [WebCite Cache]
    39. Lindsay S, McDougall C, Menna-Dack D, Sanford R, Adams T. An ecological approach to understanding barriers to employment for youth with disabilities compared to their typically developing peers: views of youth, employers, and job counselors. Disabil Rehabil. 2015;37(8):701-711. [FREE Full text] [CrossRef] [Medline]
    40. Hsu L. Random assignment procedures. In: Nezu A, Nezu C, editors. Evidence-based outcome research: A practical guide to conducting randomized controlled trials for psychosocial interventions. New York. Oxford; 2008.
    41. Holland Bloorview Kids Rehabilitation Hospital. 2018. URL: https:/​/hollandbloorview.​ca/​programsandservices/​therapeuticrecreationandlifeskills/​youth/​youthmentorshipprogram [WebCite Cache]
    42. World Health Organization. Geneva, Switzerland. WHO; 2015. URL: https://www.who.int/topics/disabilities/en/ [accessed 2019-01-18] [WebCite Cache]
    43. Adelstein DM, Webster DW. Cross-sectional, longitudinal and composite longitudinal data on the Career Maturity Inventory Attitude Scale. J Vocat Behav. Feb 1979;14(1):102-111. [CrossRef]
    44. Zimet GD, Powell SS, Farley GK, Werkman S, Berkoff KA. Psychometric characteristics of the Multidimensional Scale of Perceived Social Support. J Pers Assess. 1990;55(3-4):610-617. [CrossRef] [Medline]
    45. Crites JO, Savickas ML. Revision of the career maturity inventory. J Career Assess. Jul 25, 2016;4(2):131-138. [CrossRef]
    46. Shogren KA, Wehmeyer ML, Palmer SB, Soukup JH, Little TD, Garner N, et al. Understanding the construct of self-determination: examining the relationship between the Arc's Self-Determination Scale and the American Institutes for Research Self-Determination Scale. Assess Eff Interv. Mar 2008;33(2):94-107. [CrossRef]
    47. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The multidimensional scale of perceived social support. J Pers Assess. Mar 1988;52(1):30-41. [CrossRef]
    48. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. [CrossRef]
    49. Lindsay S, McDougall C, Sanford R, Menna-Dack D, Kingsnorth S, Adams T. Exploring employment readiness through mock job interview and workplace role-play exercises: comparing youth with physical disabilities to their typically developing peers. Disabil Rehabil. 2015;37(18):1651-1663. [CrossRef] [Medline]
    50. Bierema L, Merriam S. E-mentoring: using computer mediated communication to enhance the mentoring process. Innovat High Educ. 2002;26(3):211-227. [CrossRef]
    51. Dennis C. Peer support within a health care context: a concept analysis. Int J Nurs Stud. Mar 2003;40(3):321-332. [Medline]
    52. Ahola KS, Stinson JN, Ruskin D, Forgeron P, Harris L, van Wyk M, et al. iPeer2Peer program: a pilot feasibility study in adolescents with chronic pain. Pain. May 2016;157(5):1146-1155. [CrossRef] [Medline]
    53. Shpigelman CN, Weiss PL, Reiter S. E-mentoring for all. Comput Human Behav. Jul 2009;25(4):919-928. [CrossRef]
    54. Ammerlaan J, van Os-Mendendorp H, de Boer-Nijhof N, Scholtus L, Kruize AA, van Pelt P, et al. Short term effectiveness and experiences of a peer guided web-based self-management intervention for young adults with juvenile idiopathic arthritis. Pediatr Rheumatol Online J. Oct 13, 2017;15(1):75. [FREE Full text] [CrossRef] [Medline]
    55. Gregg N, Galyardt A, Wolfe G, Moon N, Todd R. Virtual mentoring and persistence in STEM for students with disabilities. Career Dev Transit Except Individ. May 25, 2016;40(4):205-214. [CrossRef]
    56. Gregg N, Wolfe G, Jones S, Todd R, Moon N, Langston C. STEM e-mentoring and community college students with disabilities. JPED. 2016;29(1):47-63. [FREE Full text]
    57. Stewart M, Barnfather A, Magill-Evans J, Ray L, Letourneau N. Brief report: an online support intervention: perceptions of adolescents with physical disabilities. J Adolesc. Aug 2011;34(4):795-800. [CrossRef] [Medline]
    58. Deci EL, Ryan RM. Self-determination theory: a macrotheory of human motivation, development, and health. Can Psychol. 2008;49(3):182-185. [CrossRef]
    59. Eisenman LT. Self-determination interventions: building a foundation for school completion. Remedial Spec Educ. Aug 18, 2016;28(1):2-8. [CrossRef]
    60. Mumbardó-Adam C, Shogren KA, Guàrdia-olmos J, Giné C. Contextual predictors of self-determined actions in students with and without intellectual disability. Psychol Schs. Dec 27, 2016;54(2):183-195. [CrossRef]
    61. Bell EC. Mentoring transition-age youth with blindness. J Spec Educ. Jun 25, 2010;46(3):170-179. [CrossRef]
    62. Kim K, Choi H. The influence of e-mentoring with college students with disabilities on career decision self-efficacy and college preparation for high school students with disabilities. Korean J Special Edu. Sep 30, 2017;52(2):149-169. [CrossRef]
    63. Smedley M, Levinson E, Barker W, DeAngelis D. Differences in career maturity among adjudicated and non adjudicated male students with and without disabilities. J Employ Couns. 2003;40:108-122. [CrossRef]
    64. Rhodes JE, Grossman JB, Resch NL. Agents of change: pathways through which mentoring relationships influence adolescents' academic adjustment. Child Dev. 2000;71(6):1662-1671. [Medline]
    65. Shpigelman C, Gill CJ. The characteristics of unsuccessful e-mentoring relationships for youth with disabilities. Qual Health Res. Apr 2013;23(4):463-475. [CrossRef] [Medline]
    66. Francis G, Gross J, Turnbull A, Turnbull R. The family employment awareness training (FEAT): a mixed-method follow-up. J Vocat Rehabil. 2013;39(3):167-181. [CrossRef]
    67. Luecking R, Wittenburg D. Providing supports to youth with disabilities transitioning to adulthood: case descriptions from the Youth Transition Demonstration. J Vocat Rehabil. 2009;30(3):241-251. [CrossRef]
    68. Kasprisin CA, Single PB, Single RM, Muller CB. Building a better bridge: testing e-training to improve e-mentoring programmes in higher education. Mentor Tutor Partner Learn. Apr 2003;11(1):67-78. [CrossRef]
    69. Kramer JM, Ryan CT, Moore R, Schwartz A. Feasibility of electronic peer mentoring for transition-age youth and young adults with intellectual and developmental disabilities: project teens making environment and activity modifications. J Appl Res Intellect Disabil. Jan 2018;31(1):e118-e129. [CrossRef] [Medline]
    70. DiRenzo MS, Linnehan F, Shao P, Rosenberg WL. A moderated mediation model of e-mentoring. J Vocat Behav. Apr 2010;76(2):292-305. [CrossRef]
    71. Deutsch NL, Spencer R. Capturing the magic: assessing the quality of youth mentoring relationships. New Dir Youth Dev. 2009;2009(121):47-70. [CrossRef] [Medline]
    72. Wierenga D, Engbers LH, Van Empelen P, Duijts S, Hildebrandt VH, Van Mechelen W. What is actually measured in process evaluations for worksite health promotion programs: a systematic review. BMC Public Health. 2013;13:1190. [FREE Full text] [CrossRef] [Medline]

    ‎
    e-mentor: electronic mentor
    e-mentoring: electronic mentoring
    RCT: randomized controlled trial

    Edited by G Eysenbach; submitted 07.09.18; peer-reviewed by A Alriksson-Schmidt, S Lin; comments to author 07.01.19; revised version received 18.01.19; accepted 10.02.19; published 29.03.19.

    Copyright

    ©Sally Lindsay, Elaine Cagliostro, Joanne Leck, Jennifer Stinson. Originally published in JMIR Pediatrics and Parenting (http://pediatrics.jmir.org), 29.03.2019.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on http://pediatrics.jmir.org, as well as this copyright and license information must be included.