Original Paper
Abstract
Background: Youth suicide is a pressing public health concern, and transitions in care after a suicidal crisis represent a period of elevated risk. Disruptions in continuity of care and emotional support occur frequently. “Caring contacts” validating messages post discharge have the potential to enhance connections with patients and have been shown to improve outcomes. More recently, positive outcomes have been noted using caring contact text messages (SMS and MMS), which hold promise for engaging patients in a pediatric setting, but there are few studies describing the large-scale implementation of such an approach.
Objective: This study aims to describe the process of developing and implementing automated caring contacts within a quality improvement framework, using a standardized series of supportive texts and images, for adolescents discharged from high-acuity programs at a large midwestern pediatric hospital. We describe lessons learned, including challenges and factors contributing to success.
Methods: We implemented the caring contacts intervention in 3 phases. Phase 1 entailed developing supportive statements and images designed to promote hope, inclusivity, and connection in order to create 2 sets of 8 text messages and corresponding images. Phase 2 included piloting caring contacts manually in the hospital’s Psychiatric Crisis Department and Inpatient Psychiatry Unit and assessing the feasibility of implementation in other services, as well as developing workflows and addressing legal considerations. Phase 3 consisted of implementing an automated process to scale within 4 participating hospital services and integrating enrollment into the hospital’s electronic medical records. Process outcome measures included staff compliance with approaching and enrolling eligible patients and results from an optional posttext survey completed by participants.
Results: Compliance data are presented for 4062 adolescent patients eligible for caring contacts. Overall, 88.65% (3601/4062) of eligible patients were approached, of whom 52.43% (1888/3601) were enrolled. In total, 94.92% (1792/1888) of enrolled participants completed the program. Comparisons of the patients eligible, approached, enrolled, and completed are presented. Primary reasons for eligible patients declining include not having access to a mobile phone (686/1705, 40.23%) and caregivers preferring to discuss the intervention at a later time (754/1705, 44.22%). The majority of patients responding to the optional posttext survey reported that the texts made them feel moderately to very hopeful (219/264, 83%), supported (232/264, 87.9%), that peers would be helped by these texts (243/264, 92%), and that they would like to keep receiving texts given the option (227/264, 86%).
Conclusions: This study describes the successful implementation of automated postdischarge caring contacts texts to scale with an innovative use of images and demonstrates how a quality improvement methodology resulted in a more effective and efficient process. This paper also highlights the potential for technology to enhance care for at-risk youth and create more accessible, inclusive, and sustainable prevention strategies.
doi:10.2196/51570
Keywords
Introduction
Context
Youth suicide is a pressing public health concern and the third leading cause of death for individuals aged 10 to 19 years in the United States [
]. Suicide deaths among US youth increased during the COVID-19 emergency, with significantly more suicides than expected among male participants, non-Hispanic American Indian or Alaskan Native, and Black youth [ ]. Regarding nonfatal suicidal behaviors, the percentage of youth presenting to pediatric hospitals for suicidal thoughts and attempts more than doubled between 2008 and 2015 [ ]. A recent national study of emergency department (ED) visits in adolescents aged between 12 and 17 years reported significant increases in suicide attempts beginning in May 2020 and extending through March 2021, compared to corresponding periods in 2019 [ ], with increases particularly elevated in females.To address the needs of pediatric patients at risk of suicide more effectively, the behavioral health (BH) service line at our large Midwestern pediatric hospital adopted the Zero Suicide model, a comprehensive framework using a quality improvement (QI) approach to combine best practice tools and strategies to improve suicide care across health care systems with demonstrated reductions in patient suicides and suicidal behaviors [
- ]. Although identification and treatment of high-risk youth are core to Zero Suicide, transitions in care are also prioritized as vital points for system improvement. One potential means of improving outcomes for adolescents during care transitions is the use of caring contacts, now considered a best practice for transitions in care [ ].In this paper, we describe our hospital’s process of developing and implementing an automated and scalable universal caring contacts texting system for adolescents being discharged from the Psychiatric Crisis Department (PCD), Youth Crisis Stabilization Unit (YCSU), Inpatient Psychiatry Unit (IP), and Consult Liaison Service (CL) using an iterative QI approach to improve efficiency and enrollment of eligible patients and enhance health care equity with respect to age, sex, gender identity, race, and ethnicity.
Problem Statement
While hospitalization or crisis care is often accessible for youth at imminent risk for suicide, the days and months after hospital discharge remain a high-risk period [
]. However, many youths receive limited (or no) follow-up mental health care [ , - ], which is particularly concerning as follow-up care within 7 days of discharge is associated with a decreased risk for suicide [ ]. Indeed, studies suggest that 42% of adolescents who attempt suicide do not attend their first scheduled appointment posthospitalization, and 25% do not attend even one follow-up session [ ]. These concerning statistics underscore the need to maintain connections with high-risk patients as they transition levels of care, often across multiple, fragmented health care systems.Similar Interventions
Conceptualized by Motto [
] as validating, nondemand communications following a suicidal crisis, caring contacts are intended to enhance a patient’s inherent sense of self-worth and connectedness to ongoing supports [ ]. Caring contacts originally took the form of personalized letters expressing concern without placing demands on the recipients (eg, no requests to engage in services or self-care). Working with a high-risk population of adult patients who refused, or did not follow through with, ongoing treatment upon discharge from a psychiatric facility, Motto and Bostrom [ ] found significant reductions in suicide for those receiving caring contacts during the first 2 years post discharge. Of note, this reduction was no longer significant after 5 years, and the suicide rates for the intervention and control groups converged by year 14. The first year post discharge is the highest risk period for suicide and also saw the highest frequency of caring contact letters. Although effects may be time-limited, implementation of caring contacts has since been shown to reduce suicidal behaviors and readmissions across communication modalities (eg, letters, postcards, and phone calls), clinical populations, and cultures [ - ]. A recent meta-analysis [ ] found that caring contacts reduced self-reported suicide attempts at 1 year but did not find significantly reduced suicide rates or ED visits and hospitalizations. However, the number of studies included in the analysis was small due to the limited number of available randomized controlled trials.More recently, the feasibility and acceptability of texting as a means of communicating with caring contacts have been demonstrated in adults [
, , ] and adolescents [ , ]. Furthermore, a randomized controlled trial demonstrated that a brief contact intervention delivered through text messages significantly reduced hospital-related self-harm visits over a 24-month period [ ]. Using text messages has significant benefits: texts are nonintrusive, easily accessible, can be stored for later viewing, and the receiver has control over whether to remain involved. However, the existing literature exclusively features text-based caring contacts without the use of images. In considering the pediatric population served by our hospital, we decided to implement caring contact text messages paired with hopeful images to support adolescents during transitions of care as most youth have a high comfort level with receiving text messages [ ]. The nearly ubiquitous use of smartphones by adolescents, even in households earning less than US $30,000 a year [ ], and the high overall retention rate for youth involved in digital health interventions [ ] presented an opportunity to text hopeful and engaging images along with supportive language in a confidential, nonstigmatizing format to all eligible patients without significant concern that access to a smartphone might be a barrier to equitable care.Methods
Aims and Objectives
The main goal of this paper is to describe the development and implementation of a scalable automated text-based caring contacts intervention using a QI methodology to support eligible youth aged 13 to 18 years being discharged from acute services at our hospital following acute BH interventions related to a suicidal crisis. As a secondary objective, this implementation included a posttext survey to evaluate the extent to which patients found the texts hopeful and supportive.
Blueprint Summary
Overview
In this study, caring contacts texts are supportive messages paired with hopeful images that include local and national youth crisis resources. Messages are unidirectional and do not serve as a text or chat service, although links are provided to youth who would like to access crisis support at any time.
There were three phases for this initiative: (1) phase 1: development and refinement of text messages (November 2018 to January 2019); (2) phase 2: piloting text messages and creating local workflows (February 2019 to February 2020); and (3) phase 3: full implementation with data collection across all 4 service areas (March 2020 to September 2021).
Phase 1: Development (November 2018 to January 2019)
The development of caring contacts message content began with the creation of validating, supportive statements and images aimed at promoting hope and a sense of inclusivity and connection to others while avoiding demanding or potentially emotionally intense or triggering content (
). An initial set of 16 images with supportive statements and information about crisis resources was developed by the hospital content experts in consultation with an adult former patient and member of the Zero Suicide implementation team, representing lived experience as a suicide attempt survivor. Messages were then reviewed by patient focus groups, representing diversity across race and gender, whose presenting concerns included suicidal ideation or behavior across inpatient and outpatient programs. Feedback from the focus groups indicated that the proposed texts were overwhelmingly viewed as positive and encouraging, were not emotionally triggering, and contained appropriate content. Feedback obtained from parent advocates, therapists, and suicide prevention experts also informed the development of 2 series of 8 caring contacts texts. Each text series was designed to be sent to individual patients over a 4-month period, starting the day after discharge, then weekly for 4 weeks, and monthly for the remaining 3 months. The second set of 8 texts was used for patients readmitted to the hospital.Phase 2: Pilots (February 2019 to February 2020)
As part of our continuous QI efforts, each of the participating services collaboratively developed workflows to identify, consent or assent to receive texts, obtain contact information, and enroll eligible participants. Staff were then trained in these processes, and the first pilots were held, which consisted of multiple plan-do-study-act cycles [
] initially focusing on a small number of clinicians (between 1 and 5) enrolling between 1 and 4 patients each. Barriers to enrollment proved to be using a paper workflow rather than electronic medical records (EMRs), clinicians inconsistently approaching families for consent, failing to provide resources and enrollment forms, and forgetting eligibility criteria.In response to these barriers, changes were made to the patient enrollment process, which was built directly into the EMR (completed in March 2020). We consulted with hospital legal services, and, given that caring contacts was now the standard care for youth with suicidal thoughts and behaviors, the hospital amended the general consent to allow for texting directly to adolescents aged 13 years and older, consistent with the Children’s Online Privacy Act.
Early in phase 2, we hypothesized that the PCD would be the most effective site to enroll patients, as it serves as the point of entry for most hospital inpatient admissions to our system of care. However, low compliance rates and concerns that the discussion of care transition and caring contacts would fit better into the safety planning and discharge process led to the decision that each of the participating services would be responsible for enrollment at the time of a patient’s discharge. Toward the end of phase 2, all participating services were retrained in the new enrollment workflows.
illustrates the final workflow.![](https://asset.jmir.pub/assets/9fbfb04bca3ec7871225a5e9aa82e951.png)
Phase 3: Full-Scale Implementation With Data Collection (March 2020 to September 2021)
In March 2020, the responsibility for enrollment at the time of discharge was expanded to all participating services. A digital caring contacts enrollment form was implemented in the EMR, and we initiated automatic texting of the caring contacts through a web app. New participants were entered into the site as they were discharged from participating services, and their text sequence was initiated and scheduled automatically. In July 2020, the addition of a flag in the EMR reminding clinicians to enroll patients further increased the percentage of eligible patients approached.
Process Measures
A QI approach for implementation places significant focus on compliance with established protocol to iteratively drive system changes to achieve its aims. One of the goals of this initiative was to maximize the enrollment of youth being discharged from the 4 participating services, making it imperative to identify and approach all eligible patients. Initially, eligible participants were identified through a visit diagnosis, billing diagnosis, or discharge diagnosis. However, in July 2019 during phase 2, BH implemented the Zero Suicide framework, including the use of a well-validated suicide screener at first contact for all patients with the Asking Suicide-Screening Questions [
] and, where appropriate, further risk assessment with the Columbia Suicide Severity Rating Scale [ ]. Eligible participants were then identified based on a positive suicide risk endorsement on either measure.A monthly compliance report was generated to assess adherence to the process, with two metrics, that were (1) percentage of eligible patients approached by staff to enroll and (2) percentage of eligible patients enrolled. Eligible participants were identified based on a positive suicide risk endorsement on the Ask Suicide-Screening Questions [
] and Columbia Suicide Severity Rating Scale [ ] tools. For patients declining, 1 of 4 reasons was indicated by the clinician: no mobile phone, patient or family preferring to discuss enrollment at a later time, parent declined, and patient is developmentally inappropriate to enroll (comprehension challenges, autism spectrum, or nonverbal). The compliance data reported in this study were collected in phase 3, for which all participating services enrolled participants. In phase 3, due to the automation of the entire identification, approach, and enrollment process, accurate data could be obtained to determine compliance (compliance data are not reported for phase 2 due to the challenges in accurately determining the number of eligible patients for each plan-do-study-act, but actual numbers of the first texts sent in phase 2 are displayed in ). Summary compliance data were sent to the clinical leaders of the participating services to review and resolve program barriers to enrollment.Posttext Survey
Although focus groups suggested that automated texts and images were acceptable and affirming to patients, it was important to establish that this format was not problematic for participants and that they experienced a level of support and hopefulness by receiving them. A 4-question survey was sent to participants through a URL link in the final text. The survey used a Likert scale for the first two questions and yes or no for the last two questions: (1) On a scale of 1-5, how hopeful did these text messages make you feel? (2) On a scale of 1-5, how supported did these text messages make you feel? (3) Do you think other kids like you would be helped by these text messages? (4) If given the option, would you like to keep receiving text messages in the future?
Data and Analysis
Data were extracted from 2 key sources—the EMR (ie, Epic) and the caring contacts web-based app database. Statistical process control methods were used to monitor compliance and analyze improvements over time. Specifically, c-charts allowed the study team to track the percentage of eligible patients approached and the percentage enrolled in caring contacts on a monthly basis for any special cause variation. Standard statistical process control rules were used to establish the control limits and identify special cause variation using the c-chart [
]. Tracking caring contacts enrollment compliance by unit was important as it allowed managers to provide feedback to individual clinicians and identify potential implementation barriers, which facilitated process improvement.Psychiatric service areas and demographic factors (race, ethnicity, gender, and age) were retrospectively retrieved for all eligible patients based on the daily discharge list. Descriptive statistics of the demographic data and service areas for patients eligible for the program, patients approached about the program, patients enrolled in the program, and patients who completed the program, were generated. The approach rate is defined as the proportion of eligible patients who the clinical team approached to introduce the program. Enrollment rate is defined as the proportion of patients enrolled among patients approached, while completion rate is defined as the proportion of enrolled patients who completed the caring contact program fully. Point estimates of these rates were calculated for each demographic factor value and psychiatric service area, together with their corresponding 95% CIs. These data were examined in a pairwise fashion within each demographic factor or service area to see whether there were statistically significant differences in introduction, enrollment, and program completion rates. When the CIs of rates are nonoverlapping for a pair of factor values within the same category, such as 2 age groups or 2 different race values, then we can conclude the 2 factor values have statistically significant differences.
Technical Design
In phase 2, all caring contacts texts were sent manually through a dedicated mobile phone. However, the large volume of texts per patient over time necessitated the development of an automated process through a web-based app. This required upfront investment but ensured scalability to additional hospital services, reduced the chances of human error, and reduced the administrative burden of a manual process, resulting in long-term savings.
The web-based app was developed to track patient enrollment, automatically send the programmed series of texts to participants, and update enrollees’ program progress and status. The app was built on an internal machine server behind the hospital firewall to maximize controls over security and privacy protection. Only patient phone numbers and nonpatient-specific message contents are passed to the messaging service provider, which stores the phone numbers for a limited time to ensure delivery. In turn, the hospital only receives the time of the message sent, the delivery status, and whether patients choose to opt out. Only hospital staff enroll patients to eliminate the inclusion of unnecessary details in the EMR. Youth attempting to reply to the text messages receive an auto-generated response validating their outreach and providing reminders of the different crisis options and links available around the clock.
Target
This QI initiative addressed the use of caring contacts with high-risk adolescents between the ages of 13 and 18 years discharged from our highest acuity BH services at Nationwide Children’s Hospital, which serves as a regional hub for pediatric services in Ohio.
Interoperability
The web-based app for caring contacts and the EMR system were designed to not communicate to protect patient health information and minimize risk.
Participating Entities
A brief description of participating services is provided as follows: (1) PCD: a walk-in psychiatric ED for youth and families that serves as an entry point to higher levels of hospital-based care. (2) YCSU: crisis stabilization unit for voluntary admissions with a strong emphasis on individual and family therapy. (3) IP: inpatient psychiatry service with psychiatric unit milieu. (4) CL: psychiatric consult-liaison services provided to youth admitted for medical reasons who present with BH challenges during their admission.
Budget Planning
Although grant-funded, startup costs for this initiative and resources were required to develop process flows and integrate these processes into the EMR. Some ongoing resources are also required to maintain the system. The overall budget for the development and maintenance of the caring contacts program was approximately US $102,560 across the 31-month study time frame. The research and development costs of US $27,720 included the technical design, creation of wireframes, application programming interface integration, testing, implementation, and maintenance to support the startup of automated caring contacts. Vendor fees were US $285 per month (US $3420 per year) throughout the study period. The cost of educational materials provided to families and staff was approximately US $300 per year. In addition, the management of caring contacts typically involves a percentage of the time of a bachelor’s-level staff member corresponding to program volume. Given the very high volume of acute care at this pediatric hospital, 50% of the effort was dedicated to personnel costs, equating to approximately US $25,250 per year and US $65,230 over the study period. Costs were covered by grant funding from the Ohio Suicide Prevention Foundation. In terms of replication, it is important to note that costs for new sites would be lower as startup and monthly fees are significantly lower due to a collaboration with a new vendor who offers startup to new sites using our design for US $2500 and a monthly text service fee of US $99 per month.
Sustainability
Nationwide Children’s Hospital has made a significant commitment to reducing the pediatric suicide rate in the region and has significant resources devoted to data management and QI. Once grant funding for this initiative ends, we will allocate resources to support and sustain it.
Ethical Considerations
The hospital’s Institutional Review Board (IRB) reviewed our proposal to implement caring contacts as a QI initiative and determined that this initiative did not constitute human subjects research under 45 Code of Federal Regulations part 46 or 21 Code of Federal Regulations part 50. Participants were not offered or provided with any form of compensation.
Results
Coverage
This initiative was implemented at Nationwide Children’s Hospital, the second-largest children’s hospital in the United States, which provides 38 licensed inpatient psychiatric beds and an additional 16 beds in the YCSU. Annually, it facilitates over 2000 discharges from these units. The PCD manages approximately 8000 visits each year. Furthermore, over 240,000 BH outpatient visits occur annually, underscoring its substantial regional role in pediatric mental health care.
Outcomes
From March 2019 to September 2021, a total of 4062 adolescent patients were eligible to receive caring contacts text messages. The total number of youths approached for the caring contact program (n=3601), total number enrolled (n=1888), and total number of youths having completed the program (n=1792) are listed in
, together with summary statistics breakdowns by demographic factors and psychiatric service areas for these patient cohorts.While compliance data for phase 2 could not be calculated,
displays the actual number of texts sent by month during the pilots before automation. Once phase 3 began in March 2020, it took 3 months to consistently achieve an approach rate of over 90% ( ). The enrollment rate by month is reflected in . The overall patient approach rate for the 19-month period was 89% (95% CI 88-90), with an enrollment rate of 53% (95% CI 51-54), and a completion rate of 95% (95% CI 94-96; ). The table on the left of each panel in shows the total number of patients eligible, approached, enrolled, and completed, stratified by demographic factors and psychiatry service areas. The point estimates of approach rates, enrollment rates, and completion rates are listed, along with the associated CIs. Point estimates and 95% CIs of these rates are also visually represented on the right of each panel in .We assessed differences in age, gender, and race or ethnicity in an initial effort to identify whether approach rates were conducted equitably. There were no significant differences in approach rates between male and female patients. However, the approach rate for the White patient group (513/1189, 89.67%) was significantly higher than for the Black patient group (647/756, 85.6%). The approach rate for the patient group with another or unknown ethnicity was significantly lower than the other patient groups. The approach rate for the 13-year-old patient group was significantly lower than all other age groups, while the approach rate for the 18-years-old patient group was significantly higher than the other age groups. The pairwise approach rates were all statistically different between any 2 service areas in CL, PCD, IP, and YCSU, ordering from the lowest to the highest. The program enrollment data show that females enrolled in the caring contact program at a significantly higher rate than males (54% vs 48%). There were no significant differences in enrollment by race or ethnicity. The 13-year-old patient group had a significantly lower enrollment rate than older groups. YCSU had a significantly higher enrollment rate than the other service areas.
The reasons for declining the caring contact program are summarized in
. The “no cell phone” option was chosen at a significantly higher rate for females (513/1189, 43.15%) than for males (173/516, 33.5%), while “inappropriate” was chosen at a significantly higher rate for males (55/516, 10.7%) than for females (65/1189, 5.5%). “No cell phone” was selected at a significantly higher rate for 13-year-olds (91/168, 54.2%) than for 16- (142/377, 37.7%), 17- (101/299, 33.8%), and 18-year-olds (71/210, 33.8%). “Inappropriate” was selected at the significantly highest rate for inpatient consultation or liaison, while “inappropriate” was selected at the significantly lowest rate for YCSU among all service areas. “Discuss at a later time” was selected at a significantly higher rate in the PCD (442/947, 46.7%) than the CL (30/93, 32%) and inpatient (79/217, 36.4%).Program completion data indicated that females also completed the caring contact program at a significantly higher rate than males (1360/1418, 95.9% vs 432/470, 91.9%). There were no significant differences in program completion by race, ethnicity, age group, or service area.
Values | Eligible, n (%) | Approached, n (%) | Enrolled, n (%) | Completed, n (%) | |
Sex | |||||
Female | 2925 (72) | 2607 (73) | 1418 (75) | 1360 (76) | |
Male | 1127 (28) | 987 (27) | 470 (25) | 432 (24) | |
Race | |||||
Black or African American | 756 (19) | 647 (18) | 325 (17) | 310 (17) | |
Other or unknown | 586 (14) | 516 (14) | 253 (13) | 238 (13) | |
White | 2710 (67) | 2430 (68) | 1310 (69) | 1244 (69) | |
Ethnicity | |||||
Hispano or Latino | 179 (4) | 160 (4) | 85 (5) | 79 (4) | |
Not Hispanic or Latino | 3805 (94) | 3384 (94) | 1774 (94) | 1687 (94) | |
Other or unknown | 68 (2) | 49 (1) | 28 (1) | 26 (1) | |
Age (years) | |||||
13 | 294 (7) | 212 (6) | 44 (2) | 44 (2) | |
14 | 721 (18) | 634 (18) | 338 (18) | 326 (18) | |
15 | 838 (21) | 732 (20) | 377 (20) | 359 (20) | |
16 | 896 (22) | 808 (22) | 431 (23) | 405 (23) | |
17 | 778 (19) | 692 (19) | 393 (21) | 371 (21) | |
18 | 525 (13) | 515 (14) | 305 (16) | 287 (16) | |
Service area | |||||
CLa | 281 (7) | 196 (5) | 103 (5) | 96 (5) | |
Inpatient | 486 (12) | 442 (12) | 225 (12) | 212 (12) | |
PCDb | 1983 (49) | 1715 (48) | 768 (41) | 722 (40) | |
YCSUc | 1302 (32) | 1240 (35) | 792 (42) | 762 (43) |
aCL: Consult Liaison Service.
bPCD: Psychiatric Crisis Department.
cYCSU: Youth Crisis Stabilization Unit.
![](https://asset.jmir.pub/assets/a4195e8af057b0d22378a0a2e64cb0d5.png)
Category | No cell phone | Inappropriate | Parent opt out | Discuss at a later time | ||||||
Total, N | n (%) | 95% CI | n (%) | 95% CI | n (%) | 95% CI | n (%) | 95% CI | ||
Sex | ||||||||||
Female | 1189 | 513 (43)a | 40-46a | 65 (5)a | 4-7a | 98 (8) | 7-10 | 513 (43) | 40-46 | |
Male | 516 | 173 (34)a | 29-38a | 55 (11)a | 8-14a | 47 (9) | 7-12 | 241 (47) | 42-51 | |
Race | ||||||||||
Black or African American | 322 | 140 (43) | 38-49 | 22 (7) | 4-10 | 25 (8) | 5-11 | 135 (42) | 36-47 | |
Other or unknown | 263 | 96 (37) | 31-43 | 20 (8) | 5-12 | 27 (10) | 7-15 | 120 (46) | 39-52 | |
White | 1120 | 450 (40) | 37-43 | 78 (7) | 6-9 | 93 (8) | 7-10 | 499 (44) | 41-47 | |
Ethnicity | ||||||||||
Hispanic or Latino | 74 | 25 (34) | 23-46 | —b | — | — | — | — | — | |
Not Hispanic or Latino | 1610 | 650 (40) | 38-43 | — | — | — | — | — | — | |
Other or unknown | 21 | 11 (52) | 30-74 | — | — | — | — | — | — | |
Age (years) | ||||||||||
13 | 168 | 91 (54)a | 46-62a | — | — | — | — | 58 (35) | 27-42 | |
14 | 296 | 128 (43) | 38-49 | 20 (7) | 4-10 | 18 (6) | 4-9 | 130 (44) | 38-50 | |
15 | 355 | 153 (43) | 38-48 | 26 (7) | 5-11 | 23 (6) | 4-10 | 153 (43) | 38-48 | |
16 | 377 | 142 (38)a | 33-43a | 23 (6) | 4-9 | 36 (9) | 7-13 | 176 (46) | 41-51 | |
17 | 299 | 101 (34)a | 28-39a | 22 (7) | 5-11 | 35 (12) | 8-16 | 141 (47) | 41-53 | |
18 | 210 | 71 (34)a | 27-41a | — | — | — | — | 96 (45) | 39-52 | |
Service area | ||||||||||
CLc | 93 | 32 (34) | 24-44 | — | — | — | — | 30 (32)a | 22-42a | |
Inpatient | 217 | 99 (46) | 39-53 | 21 (10) | 6-14 | 18 (8) | 5-13 | 79 (36)a | 30-43.2a | |
PCDd | 947 | 366 (39) | 35-42 | 69 (7) | 6-9 | 72 (8) | 6-9 | 442 (47)a | 43.3-50a | |
YCSUe | 448 | 195 (43) | 39-48 | — | — | — | — | 203 (45) | 40-50 | |
Total | 1705 | 686 (40) | 38-43 | 120 (7) | 6-8 | 145 (8) | 7-10 | 754 (44) | 42-46 |
aThe proportion is statistically significantly different than at least another value in the demographic category, for example, proportions of “no cell phone” among females and males are statistically significantly different.
bCell value of “—” is used to avoid the disclosure of cell counts less than 11.
cCL: Consult Liaison Service.
dPCD: Psychiatric Crisis Department.
eYCSU: Youth Crisis Stabilization Unit.
A total of 1961 optional posttext satisfaction surveys were sent, of which 264 (13.46%) were completed. A total of 219 (83%) respondents reported that the texts made them feel moderately to very hopeful, 232 (87.9%) respondents reported feeling moderately to very supported, 243 (92%) respondents reported that peers would be helped by these text messages, and 227 (86%) respondents reported they would like to keep receiving texts in the future if given the option.
Lessons Learned
Success Factors
As expected for any large-scale implementation initiative, engaging staff across disciplines and hierarchy was a critical factor in successful implementation. Service areas with actively engaged leaders and champions facilitated smooth integration of the initiative into existing workflows and demonstrated greater adaptability and flexibility throughout the process. Embedding these new procedures seamlessly into the EMR and daily workflows of clinicians also contributed significantly to successful implementation.
Challenges
High volume periods, especially when combined with low staffing levels, negatively impacted compliance and may have contributed to clinicians checking the “discuss later” reason for declining the intervention instead of taking the time to educate and enroll families. Staff turnover and program workflow changes led to a need for regular updated training. Furthermore, the data suggest implicit bias may have impacted approach rates.
Discussion
Overview
This paper describes the process of developing and implementing automated caring contacts, containing both text and images, for adolescents receiving acute services in a large BH service line using a QI methodology, with the ultimate goal of decreasing suicide risk during transitions in care. We were able to demonstrate that an automated system can be delivered at scale and that data obtained from the system can be leveraged to provide rapid improvement in adherence to established protocols. Moreover, the addition of images to the texts appears to be acceptable to an adolescent population. Consistent with the initial implementation of caring contacts letters by Dr Jerome Motto, these texts and hopeful images were expressions of care and validation. However, using a pre-established series of texts for all patients deviates from the original concept of sending personalized letters. The low dropout rate and posttext survey results suggest this was not a barrier to our patients. Youths receiving caring contacts reported that they felt supported and hopeful and that they thought this intervention would help others. Not personalizing the content of texts ensured that communication minimized the potential for exposure to protected health information and allowed us to significantly expand capacity. This has improved efficiency and, arguably, the cost-benefit ratio of this initiative. Further analyses will examine whether there has been a reduction in return visits to the PCD and psychiatric readmissions and whether this varies by participating service unit.
Our intent was to scale up this initiative through an iterative QI process. This approach enabled us to refine enrollment procedures, seamlessly integrate the initiative into the EMR, and enhance recruitment strategies. As a result, we relatively quickly achieved over 90% of eligible patients being approached monthly, with a consistent enrollment rate exceeding 50%. The potential benefits of implementing caring contacts to scale are significant—decreased loss to suicide, decreased suicide contagion, improved hospital readmission rates, decreased costs, and decreased pressure on an already overburdened mental health system.
Our process outcomes reflected some significant differences by age group in approach, enrollment, and completion rates. The 13-year-old patient group was less likely to be approached and had a lower enrollment rate than the other age groups, which may be due to a lower rate of mobile phone access. The lower approach rate is also potentially a reflection of lower perceived autonomy and clinician perceptions of lower risk in younger patients. In general, the enrollment rate increased with age, and the 18-year-old group had a significantly higher enrollment rate than the younger age groups. In addition, females were more likely than males to enroll in and complete this initiative, possibly reflecting an increased openness to accessing mental health support and to emotional information processing.
Approach rates differed by service type. Specifically, the approach rate was higher for the YCSU than for other service areas, and their patients were also more likely to enroll than patients in the other services. The YCSU was also less likely to endorse the “discuss at a later time” reason for declining the intervention. These differences may reflect the unit’s relatively high acuity, focus on intensive therapy, including family therapy, favorable clinician-to-patient staffing ratios, and patient population (older youth admitted voluntarily and without significant disruptive behaviors). The CL service had a significantly lower approach rate than the other participating services and also had the highest use of the “inappropriate” decline reason. This likely reflects the nature of the CL service, which is spread across medical units rather than being on a single unit, and possibly lower engagement with the CL clinicians. As might be expected with a real-world QI implementation, there were external pressures that impacted staff compliance over time, such as high-volume periods that decreased the likelihood eligible patients would be approached.
We posited that a large-scale suicide prevention intervention made available to a broad population would increase health care equity as all eligible participants would be identified and approached. However, Black youth were less likely to be approached to participate than their White peers (647/756, 85.6% vs 2430/2710, 89.67%), possibly reflecting implicit bias on the part of clinicians. To further examine this difference by race, we analyzed the approach rates by race for each service area separately but found no statistically significant differences, which could be due to smaller cell sizes. There were no differences in enrollment or completion by race or ethnicity. The percentage of patients without access to a smartphone was higher than expected, but there were no statistically significant differences by race.
A limitation of this study is that demographic data were not collected for the focus groups, and it is unclear whether feedback was obtained at similar rates from youth of color as from White youth. However, the data reflect no significant differences in completion rates based on race or ethnicity. There were also no follow-up data collected for families who declined because they preferred to discuss the initiative at a later time. Another limitation was the relatively low rate of response to the survey and the potential for selection bias; our results may not be representative of all youth enrolled. As this implementation was a QI initiative rather than a research study, all data were aggregated, and there was no control group.
Based on the literature suggesting the year after discharge is a high-risk period, we moved to sending a set of 19 texts over the course of a year, starting in September 2021. Future enhancements include implementing caring contacts in other languages (Spanish, Somali, Arabic, and Nepali) to ensure cultural inclusivity. In addition, as the hospital expands the larger Zero Suicide framework across departments beyond the BH service line, we have also expanded caring contacts, starting with primary care and several intensive outpatient programs. We have begun the dissemination of our caring contacts content and processes to other health care systems in Ohio as well. Through this effort, we have standardized our processes and workflows, which will ultimately make implementation easier and more cost-efficient for our health care partners. Notably, during the initial manual phase, caregivers frequently expressed interest in receiving caring contacts and additional resources. This highlights the potential value of additional support for those caring for at-risk youth. Therefore, we are developing a set of caring contacts specifically tailored to support caregivers.
Future research could focus on identifying an optimal number and duration of texts and whether the addition of images impacts outcomes. As we plan to expand the program to include multilingual support and adapt to broader health care contexts, subsequent research will be essential in evaluating these adaptations’ effectiveness, the stability of outcomes across diverse groups, and ensuring that the interventions remain culturally sensitive and equitable. There is preliminary support suggesting that cultural adaptations to caring contacts are acceptable across diverse populations [
]. Furthermore, this study lays the groundwork for future studies to explore the long-term impacts of automated messaging on suicide prevention outcomes for youth, the nuances of its acceptability across different demographic groups, and its integration into various health care settings.Conclusions
In summary, this study describes the implementation of a scalable, automated caring contacts intervention integrated into a larger suicide prevention QI framework, in our case the Zero Suicide model, within a large health care system that is sustainable over time. An innovative component of our implementation was the use of images to engage participants. Consistent with other studies, our data suggest that this is an acceptable approach to intervening with adolescents at risk for suicide. The scalability and acceptability emphasize the potential for implementing automated supportive interventions on a broader scale, offering a viable pathway to enhancing postdischarge care for at-risk youth. This study highlights the growing potential for leveraging technology in mental health interventions and shifting toward more accessible, inclusive, and sustainable suicide prevention strategies.
Acknowledgments
We would like to acknowledge Amber Moore for her support with QI processes, Lindsey Kegler for support with the electronic medical records (EMRs), and the clinical managers and clinicians of the Psychiatric Crisis Department (PCD), Youth Crisis Stabilization Unit (YCSU), Inpatient Psychiatric Unit (IP), and Consult or Liaison Services. Funding for this project was made possible (in part; SM062894) by the Substance Abuse & Mental Health Services Administration (SAMHSA) in partnership with the Ohio Suicide Prevention Foundation. The views expressed in written training materials or publications and by speakers and moderators do not necessarily reflect the views, opinions, or policies of Center for Mental Health Services, Substance Abuse & Mental Health Services Administration, or the United States Department of Health and Human Services, nor does mention of trade names, commercial practices, or organizations imply endorsement by the US Government.
Data Availability
The data sets generated and analyzed during this study are available from the corresponding author on reasonable request.
Authors' Contributions
GVT, EC, FAM, YH, and JPA made substantial contributions to conception and design, drafted the paper, and revised it critically. JAB and JV made substantial contributions to conception and design. All authors granted final approval of the version submitted.
Conflicts of Interest
JAB receives research grant support from the National Institute of Mental, the Centers for Disease Control and Prevention, and the Patient-Centered Outcomes Research Institute; he is also a member of the Scientific Council of the American Foundation for Suicide Prevention and a member of the Scientific Advisory Board of Clarigent Health.
Example of a Caring Contact text.
DOCX File , 1405 KBNumber of first texts sent in phase 2 before automation.
DOCX File , 57 KBPatients approached for caring contacts enrollment in phase 3.
DOCX File , 48 KBPatients enrolled in caring contacts in phase 3.
DOCX File , 52 KBReferences
- Leading causes of death. Centers for Disease Control and Prevention URL: https://www.cdc.gov/injury/wisqars/LeadingCauses.html [accessed 2024-06-18]
- Bridge JA, Ruch DA, Sheftall AH, Hahm HC, O'Keefe VM, Fontanella CA, et al. Youth suicide during the first year of the COVID-19 pandemic. Pediatrics. 2023;151(3):e2022058375. [FREE Full text] [CrossRef] [Medline]
- Plemmons G, Hall M, Doupnik S, Gay J, Brown C, Browning W, et al. Hospitalization for suicide ideation or attempt: 2008-2015. Pediatrics. 2018;141(6):e20172426. [CrossRef] [Medline]
- Yard E, Radhakrishnan L, Ballesteros MF, Sheppard M, Gates A, Stein Z, et al. Emergency department visits for suspected suicide attempts among persons aged 12-25 years before and during the COVID-19 pandemic - United States, January 2019-May 2021. MMWR Morb Mortal Wkly Rep. 2021;70(24):888-894. [FREE Full text] [CrossRef] [Medline]
- Layman DM, Kammer J, Leckman-Westin E, Hogan M, Goldstein Grumet J, Labouliere CD, et al. The relationship between suicidal behaviors and Zero Suicide organizational best practices in outpatient mental health clinics. Psychiatr Serv. 2021;72(10):1118-1125. [FREE Full text] [CrossRef] [Medline]
- Stapelberg NJC, Sveticic J, Hughes I, Almeida-Crasto A, Gaee-Atefi T, Gill N, et al. Efficacy of the Zero Suicide Framework in reducing recurrent suicide attempts: cross-sectional and time-to-recurrent-event analyses. Br J Psychiatry. 2021;219(2):427-436. [CrossRef] [Medline]
- Turner K, Sveticic J, Almeida-Crasto A, Gaee-Atefi T, Green V, Grice D, et al. Implementing a systems approach to suicide prevention in a mental health service using the Zero Suicide Framework. Aust N Z J Psychiatry. 2021;55(3):241-253. [CrossRef] [Medline]
- Best practices in care transitions for individuals with suicide risk: inpatient care to outpatient care. National Action Alliance for Suicide Prevention; 2019. URL: https://www.samhsa.gov/sites/default/files/suicide-risk-practices-in-care-transitions-11192019.pdf [accessed 2024-06-18]
- Chung D, Hadzi-Pavlovic D, Wang M, Swaraj S, Olfson M, Large M. Meta-analysis of suicide rates in the first week and the first month after psychiatric hospitalisation. BMJ Open. 2019;9(3):e023883. [FREE Full text] [CrossRef] [Medline]
- Burns CD, Cortell R, Wagner BM. Treatment compliance in adolescents after attempted suicide: a 2-year follow-up study. J Am Acad Child Adolesc Psychiatry. 2008;47(8):948-957. [FREE Full text] [CrossRef] [Medline]
- Doupnik SK, Rudd B, Schmutte T, Worsley D, Bowden CF, McCarthy E, et al. Association of suicide prevention interventions with subsequent suicide attempts, linkage to follow-up care, and depression symptoms for acute care settings: a systematic review and meta-analysis. JAMA Psychiatry. 2020;77(10):1021-1030. [FREE Full text] [CrossRef] [Medline]
- Spirito A, Simon V, Cancilliere MK, Stein R, Norcott C, Loranger K, et al. Outpatient psychotherapy practice with adolescents following psychiatric hospitalization for suicide ideation or a suicide attempt. Clin Child Psychol Psychiatry. 2011;16(1):53-64. [FREE Full text] [CrossRef] [Medline]
- Fontanella CA, Warner LA, Steelesmith DL, Brock G, Bridge JA, Campo JV. Association of timely outpatient mental health services for youths after psychiatric hospitalization with risk of death by suicide. JAMA Netw Open. 2020;3(8):e2012887. [FREE Full text] [CrossRef] [Medline]
- Motto JA. Suicide prevention for high-risk persons who refuse treatment. Suicide Life Threat Behav. 1976;6(4):223-230. [Medline]
- Motto JA, Bostrom AG. A randomized controlled trial of postcrisis suicide prevention. Psychiatr Serv. 2001;52(6):828-833. [CrossRef] [Medline]
- Berrouiguet S, Gravey M, Le Galudec M, Alavi Z, Walter M. Post-acute crisis text messaging outreach for suicide prevention: a pilot study. Psychiatry Res. 2014;217(3):154-157. [CrossRef] [Medline]
- Carter GL, Clover K, Whyte IM, Dawson AH, D'Este C. Postcards from the EDge: 24-month outcomes of a randomised controlled trial for hospital-treated self-poisoning. Br J Psychiatry. 2007;191(6):548-553. [CrossRef] [Medline]
- Carter GL, Clover K, Whyte IM, Dawson AH, D'Este C. Postcards from the EDge: 5-year outcomes of a randomised controlled trial for hospital-treated self-poisoning. Br J Psychiatry. 2013;202(5):372-380. [CrossRef] [Medline]
- Comtois KA, Kerbrat AH, DeCou CR, Atkins DC, Majeres JJ, Baker JC, et al. Effect of augmenting standard care for military personnel with brief caring text messages for suicide prevention: a randomized clinical trial. JAMA Psychiatry. 2019;76(5):474-483. [CrossRef] [Medline]
- Fleischmann A, Bertolote JM, Wasserman D, De Leo D, Bolhari J, Botega NJ, et al. Effectiveness of brief intervention and contact for suicide attempters: a randomized controlled trial in five countries. Bull World Health Organ. 2008;86(9):703-709. [FREE Full text] [CrossRef] [Medline]
- Hassanian-Moghaddam H, Sarjami S, Kolahi AA, Carter GL. Postcards in Persia: randomised controlled trial to reduce suicidal behaviours 12 months after hospital-treated self-poisoning. Br J Psychiatry. 2011;198(4):309-316. [CrossRef] [Medline]
- Landes SJ, Jegley SM, Kirchner JE, Areno JP, Pitcock JA, Abraham TH, et al. Adapting caring contacts for veterans in a department of veterans affairs emergency department: results from a type 2 hybrid effectiveness-implementation pilot study. Front Psychiatry. 2021;12:746805. [FREE Full text] [CrossRef] [Medline]
- Markowitz JT, Cousineau T, Franko DL, Schultz AT, Trant M, Rodgers R, et al. Text messaging intervention for teens and young adults with diabetes. J Diabetes Sci Technol. 2014;8(5):1029-1034. [FREE Full text] [CrossRef] [Medline]
- Milner AJ, Carter G, Pirkis J, Robinson J, Spittal MJ. Letters, green cards, telephone calls and postcards: systematic and meta-analytic review of brief contact interventions for reducing self-harm, suicide attempts and suicide. Br J Psychiatry. 2015;206(3):184-190. [CrossRef] [Medline]
- Vaiva G, Vaiva G, Ducrocq F, Meyer P, Mathieu D, Philippe A, et al. Effect of telephone contact on further suicide attempts in patients discharged from an emergency department: randomised controlled study. BMJ. 2006;332(7552):1241-1245. [FREE Full text] [CrossRef] [Medline]
- Skopp NA, Smolenski DJ, Bush NE, Beech EH, Workman DE, Edwards-Stewart A, et al. Caring contacts for suicide prevention: a systematic review and meta-analysis. Psychol Serv. 2023;20(1):74-83. [CrossRef] [Medline]
- Berrouiguet S, Baca-García E, Brandt S, Walter M, Courtet P. Fundamentals for future mobile-health (mHealth): a systematic review of mobile phone and web-based text messaging in mental health. J Med Internet Res. 2016;18(6):e135. [FREE Full text] [CrossRef] [Medline]
- Berrouiguet S, Alavi Z, Vaiva G, Courtet P, Baca-García E, Vidailhet P, et al. SIAM (Suicide intervention assisted by messages): the development of a post-acute crisis text messaging outreach for suicide prevention. BMC Psychiatry. 2014;14:294. [FREE Full text] [CrossRef] [Medline]
- Ryan TC, Chambers S, Gravey M, Jay SY, Wilcox HC, Cwik M. A brief text-messaging intervention for suicidal youths after emergency department discharge. Psychiatr Serv. 2022;73(8):954-957. [CrossRef] [Medline]
- Czyz EK, Arango A, Healy N, King CA, Walton M. Augmenting safety planning with text messaging support for adolescents at elevated suicide risk: development and acceptability study. JMIR Ment Health. 2020;7(5):e17345. [FREE Full text] [CrossRef] [Medline]
- Stevens GJ, Sperandei S, Carter GL, Munasinghe S, Hammond TE, Gunja N, et al. Efficacy of a short message service brief contact intervention (SMS-SOS) in reducing repetition of hospital-treated self-harm: randomised controlled trial. Br J Psychiatry. 2024;224(3):106-113. [FREE Full text] [CrossRef] [Medline]
- O'Dea S. Percentage of teenagers in the United States who have access to a smartphone at home as of April 2018, by household income of parents. Statista; 2020. URL: https://www.statista.com/statistics/256544/teen-cell-phone-and-smartphone-ownership-in-the-us-by-household-income/ [accessed 2024-06-18]
- Liverpool S, Mota CP, Sales CMD, Čuš A, Carletto S, Hancheva C, et al. Engaging children and young people in digital mental health interventions: systematic review of modes of delivery, facilitators, and barriers. J Med Internet Res. 2020;22(6):e16317. [FREE Full text] [CrossRef] [Medline]
- Valleru J, Krishna R, Fristad MA. Systemic approach to successful quality improvement in behavioral health. Evidence-Based Practice in Child and Adolescent Mental Health. 2019;4(4):344-356. [CrossRef]
- Horowitz LM, Bridge JA, Teach SJ, Ballard E, Klima J, Rosenstein DL, et al. Ask suicide-screening questions (ASQ): a brief instrument for the pediatric emergency department. Arch Pediatr Adolesc Med. 2012;166(12):1170-1176. [FREE Full text] [CrossRef] [Medline]
- Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry. 2011;168(12):1266-1277. [FREE Full text] [CrossRef] [Medline]
- Provost LP, Murray SK. The Health Care Data Guide: Learning from Data for Improvement. San Francisco. Jossey-Bass Inc; 2011.
- Bogic M, Hebert LE, Evanson A, Wright BD, Petras A, Jansen K, et al. "Keep up the messages, sometimes it was a lifesaver": effects of cultural adaptation on a suicide prevention clinical trial in American Indian/Alaska Native communities. Behav Res Ther. 2023;166:104333. [CrossRef] [Medline]
Abbreviations
BH: Behavioral Health |
CL: Consult Liaison Service |
ED: emergency department |
EMR: electronic medical records |
IP: Inpatient Psychiatry Unit |
PCD: Psychiatric Crisis Department |
QI: quality improvement |
YCSU: Youth Crisis Stabilization Unit |
Edited by S Badawy; submitted 03.08.23; peer-reviewed by M Valimaki, E Caine; comments to author 07.03.24; revised version received 23.05.24; accepted 11.06.24; published 13.08.24.
Copyright©Glenn V Thomas, Elena Camacho, Fatimah A Masood, Yungui Huang, Jahnavi Valleru, Jeffrey A Bridge, John Ackerman. Originally published in JMIR Pediatrics and Parenting (https://pediatrics.jmir.org), 13.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on https://pediatrics.jmir.org, as well as this copyright and license information must be included.