Background: Pregnancy is a complex period that implies many biopsychosocial changes, and the way women adapt to these changes impacts their well-being and the chances of developing mental health problems. During the perinatal period, women have expressed a preference for support delivered on the web. In this regard, interventions such as behavioral activation (BA), which are brief and structured psychosocial interventions, seem particularly suited to be delivered through digital solutions.
Objective: This study aimed to map the literature investigating digital BA interventions deployed during the perinatal period. We paid particular attention to the methodological underpinnings of the studies, the potential impact of BA interventions on symptoms other than depression, and the existence of differences occurring when these interventions were administered during pregnancy versus the postpartum period.
Methods: A systematic search compliant with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for Scoping Reviews) guidelines was conducted considering 5 bibliographic databases; reference lists and key journals were also screened by 2 independent authors following a double-blind approach.
Results: A total of 7 studies published between 2013 and 2022 were included. In total, 2 studies were protocols for randomized controlled trials, 5 were empirical studies, and 1 was a qualitative study. All studies focused on the postpartum period, except for 1 that focused on the broader perinatal period. Promising effects on depression symptoms were reported but not on other psychosocial symptoms. Low intervention adherence has emerged, whereas the usability associated with the digital means used to deploy interventions was scarcely addressed; moreover, information on the digital platforms used was poorly reported overall.
Conclusions: Our findings highlight the scarcity and preliminary nature of digital BA interventions deployed during the perinatal period, where the focus seems more on treatment rather than prevention. Moreover, future studies should also consider and address usability and user engagement, given their relevance to intervention efficacy.
The transition to motherhood is a life-changing experience entailing a series of social, psychological, and hormonal changes, which may be challenging to adapt to and often cause exhaustion, a sense of overwhelm, and fatigue [, ], thereby directly impacting pregnant and postpartum women’s quality of life and overall well-being. Taken together, these factors define the perinatal period as a high-risk period for women’s mental health [ , ]. The literature provides plenty of evidence on this matter, highlighting how pregnancy is often associated with mood instability [ ] and common mental disorders (1%-37%) [ ] as well as depression (approximately 25.3%) [ , ] and anxiety (1%-26%) [ ]. Depression symptoms during pregnancy, in particular, are among the main predictors of postpartum depression [ ]. From a clinical viewpoint, depression during the perinatal period is described as peripartum depression, which consists of an episode of major depression with peripartum onset, satisfying the criteria for either major depression or persistent depressive disorder [ ]. The direct association of peripartum depression with the peculiar challenges and bodily changes intrinsic to the perinatal period makes the condition peculiar, thereby determining the need to consider it as a stand-alone disorder [ ]. Accordingly, a recent review concluded that peripartum depression “may be distinct from major depressive disorder with respect to symptom severity, hormone contributions, heritability, epigenetic mechanisms, and response to standard and novel treatment interventions” [ ].
Considering the detrimental effects that depression symptoms, together with the often associated anxiety and stress symptoms, have on the physical and psychological well-being of both mothers and children , it is paramount to take prompt action and minimize the incidence of adverse effects. In this regard, it is important to emphasize that in the present age, beside the abovementioned challenges, the perinatal period can be experienced very differently by women. Physiological pregnancies and artificially induced ones, that is, pregnancies reached through assisted reproductive techniques (ARTs; eg, in vitro fertilization and intracellular sperm injection), can particularly be distinguished between in this regard. As a matter of fact, ARTs are infertility treatment that determine a series of specific challenges that differentiate them from physiological pregnancies, such as increased psychological distress, loss of self-esteem, relationship problems, disruption in personal life, and even economic problems linked to the substantial expenses they entail [ - ]; this determines a greater psychological toll compared with physiological pregnancies. Moreover, ART are associated with an increased risk of miscarriage [ , ], which could further hinder women’s adaptation capacities; although having reached pregnancy, many women might still be mourning their previous interrupted ones [ ]. For these reasons, physiological pregnancies, ART-induced pregnancies, and consequent postpartum periods must be deemed as very different experiences. Accordingly, it is paramount to account for their peculiarities in clinical practice by tailoring interventions specifically to their respective needs.
In this regard, contrary to women undergoing ART who are kept under greater clinical scrutiny by default, access to mental health care for women at large going through the perinatal period is severely limited by a series of logistic challenges; for instance, time constraints, lack of information about services, and social stigma are indicated by women themselves as the main obstacles hindering their ability and willingness to seek help [- ]. However, such barriers can be overcome through the implementation of digital interventions; the literature not only highlights a clear preference for support delivered through a web-based format expressed by women experiencing mental health issues during the postpartum period [ - ] but also underscores how such treatments are effective in decreasing the severity of mood disorders, both during pregnancy and the postpartum period [ - ].
In this regard, behavioral activation (BA) interventions, which in their modern protocols can be counted among the so-called “third wave” cognitive and behavioral therapies , seem particularly suited to be implemented digitally. BA is a brief, structured, and empirically supported psychotherapeutic approach developed as a stand-alone treatment for depression [ ]. Laying its foundation on the behavioral model, it is mainly aimed at increasing engagement in adaptive and pleasurable activities and decreasing engagement in maladaptive behaviors through the systematic targeting of patients’ escape and avoidance strategies [ , ]. The focus is exclusively on the promotion of behavioral change, stimulated by using a series of different strategies such as self-monitoring, activity scheduling, values and goals assessment, and skills training. The ultimate goal is to encourage patients to act in line with their values, allowing them to reconnect with sources of positive reinforcement and fostering a sense of well-being, agency, and mastery through the reconstruction of a routine [ ]. Both the efficacy and effectiveness of in-person BA as a treatment specific for depression have been widely proven [ ], and the literature also provides promising evidence regarding its efficacy in perinatal depression, both in terms of improved outcomes [ , ] and of engagement and satisfaction [ ]. The distinctive features of BA render it a parsimonious, transportable, simple to implement, and cost-effective treatment, suitable to be administered by both specialists and generic mental health professionals [ ] in a wide range of formats such as web-based interventions or self-guided smartphone apps [ ]. Encouraging findings already exist on the feasibility of internet-based BA interventions for adults with symptoms of depression [ ]; therefore, it seems appropriate to further investigate the topic within the context of perinatal care. Nonetheless, it is worth mentioning that evidence on the efficacy and specific features of BA interventions during the perinatal period is still scarce and inconspicuous. For instance, there is some initial evidence highlighting that the effect of in-person BA on depression symptoms might also generalize to other symptoms, thereby leading to the simultaneous reduction of the highly associated anxiety and stress [ , , ]. However, studies investigating the efficacy of BA interventions have classically focused on the mere reduction of depression symptoms; thus, further research is needed to deepen our knowledge and provide solid evidence on its effects on other concurrent mental health conditions. Similarly, although as previously mentioned, existing studies regarding digital interventions show promising results, and it must be noted that it is a fairly new field and is still under development; therefore, further studies are needed in this area as well [ , ]. Accordingly, this scoping review aimed to map the available literature on digital BA interventions administered specifically during the perinatal period. Scoping reviews serve to bring together “literature in disciplines with emerging evidence, as they are suited to addressing questions beyond those related to the effectiveness or experience of an intervention” [ ]. Indeed, this methodological approach to literature review allows us to map the range, nature, and extent of existing research evidence on a given topic regardless of the specific study design while also allowing the identification of gaps within the available literature [ ]. Accordingly, this scoping review intended to investigate how BA interventions have been deployed through digital solutions, paying particular attention to their methodological underpinnings; a further aim was to assess if studies have considered the potential of digital BA interventions to influence symptoms and conditions other than depression (eg, anxiety and stress symptoms, overall quality of life, and well-being). This was expected to provide insights useful for refining the existing digital BA interventions. Moreover, it was also expected to support the further development of effective prevention and intervention programs divulged through digital solutions for women in the perinatal period, thereby supporting both their own and their children’s well-being.
The specific research questions guiding this scoping review were as follows: (1) How have BA interventions been structured (eg, intervention length, number of modules, topics considered, and guided vs unguided interventions) to be administered through digital means? (2) Has a specific BA protocol been followed? If so, on what BA protocol were the interventions based?  (3) What were the main barriers, including both participants’ concerns and issues given by the digital tool itself, in implementing BA interventions through digital means? (4) Were digital BA interventions able to influence psychosocial symptoms other than depression? (5) Have they willingly been used to influence symptoms other than depression? and (6) Are there differences in the BA interventions administered during the antenatal period versus the postnatal period?
This scoping review was conducted in compliance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for Scoping Reviews) guidelines (refer to Table S1 in[ - ]).
The inclusion criteria for this study were as follows: (1) considering BA interventions administered through digital means (web-based, smartphone-based, telehealth, etc), (2) inclusion of women aged ≥18 years, (3) focusing on the peripartum period (both antenatal and post partum), (4) inclusion of women who were experiencing or had experienced a physiological pregnancy (up to 1 year post partum), and (5) being written in English.
The exclusion criteria were as follows: (1) being a review article, (2) focusing on or including women who were experiencing or had experienced artificially induced pregnancy, and (3) focusing on or including women with preexisting medical conditions.
In line with the intent of scoping reviews, that is, mapping the available literature regardless of its specific study design , no restrictions were imposed on the study design. Accordingly, any type of study satisfying the criteria mentioned above was included, as the intent was to provide an overview of existing literature that is informative of what has already been done (eg, already published studies), what is expected to be done in the near future (eg, study protocols), and what is still lacking entirely or needs further investigation (ie, literature gaps). For the same reason, studies relying on secondary data were also included if they provide information that adds up to the primary analysis, thereby allowing a more in-depth understanding of the intervention evaluated and, more broadly, of the state of the art.
A total of 5 electronic bibliographic databases, namely, Web of Science, PubMed, PsycINFO, Embase, and CINAHL, were screened in April 2022 to identify studies that met the eligibility criteria. No search restrictions were applied. Reference lists were also scanned, and a handsearching of key journals (ie, Journal of Medical Internet Research and Telemedicine and e-Health) was performed to ensure a comprehensive literature search. Studies were identified using the following search strings: (behavioral activation OR behavioral activation OR activity scheduling OR pleasant events OR pleasant event) AND (digital interventions OR telehealth OR telemedicine) AND (perinatal depression OR antenatal depression OR postpartum depression OR perinatal mental health); (behavioral activation) AND (web-based interventions OR e-health OR internet-based interventions) AND (perinatal OR postnatal OR prenatal OR antenatal OR postpartum OR maternal OR pregnant OR pregnancy).
Study Screening and Data Charting Process
A double-blind screening of titles and abstracts was performed using the ASReview Lab software  by 2 authors (EM and DP), who also manually inspected the software results and then performed the subsequent full-text screening in a double-blind fashion. Any doubts or disagreements were resolved by consulting a third author (SS). Similarly, 2 independent authors (EM and DP) performed the data extraction in a double-blind fashion. Any disagreement was resolved by consulting a third author (SG). The extracted data, collected in an Excel (Microsoft Corporation) sheet, were as follows: study characteristics (digital object identifier; first author’s name; publication year; country of origin; study design; study aim; time points for data collection; outcomes considered by the included study; measurement tools used to evaluate the outcomes; main results; reason for dropout, if applicable; participants’ feedback on the intervention, if present; and type of comparator, if present), sample characteristics (sample size, age, ethnicity, occupation, marital status, educational level, income, clinical characteristics, gestational week or postpartum period, and inclusion and exclusion criteria for the participants), and BA intervention characteristics (description of the BA protocol, original BA protocol from which the new one was derived, if and how the protocol was modified, intervention length and structure, digital means used to administer the BA, and intervention delivery format).
The database search yielded 194 studies (). Following duplicate removal, the titles and abstracts of 160 studies were screened; 141 studies were removed, resulting in 19 studies whose full text was screened in accordance with the inclusion and exclusion criteria. Of these 19 studies, 5 (26%) were eventually included. The database search was integrated with a manual search of key journals and the screening of reference lists, through which 7 more studies were identified for full-text screening; only 2 studies complied with the inclusion criteria. Taken together, 7 studies were ultimately included in this scoping review. Excluded studies with reasons for exclusion are reported in Tables S2, S3, and S4 in .
The aims and design of the studies are reported in, and the studies’ main outcomes are summarized in . The included studies were published between 2013 and 2022, of which 2 are randomized controlled trials (RCTs) [ , ] and 2 are protocols for RCTs [ , ]. Moreover, 2 studies are secondary analyses conducted on the RCT by O’Mahen et al [ ], 1 is a secondary analysis focused on a subsample of the original sample [ ], and 1 is a secondary analysis focused only on follow-up data of the total sample [ ]. Finally, 1 is a qualitative study, which included participant-level analyses as well as 2 case studies [ ]. Both the studies by Singla et al [ , ] relate to the same broad ongoing study. Only the 2 protocol studies [ , ] preregistered their clinical trials. All included studies were focused on evaluating the efficacy or effects of a digital BA intervention, except for 1 study [ ], which investigated the processes underlying digital BA’s efficacy. The outcomes considered by the included studies are summarized in . Although all interventions were developed to target depression symptoms, coherently with the intents of BA, studies have also marginally considered other maternal variables such as anxiety symptoms (n=3) [ , , ], parental stress (n=1), quality of life (n=1) [ ], social support (n=4) [ , , ], work and social functioning (n=3) [ , , ], and mother-child bonding (n=3) [ - ]. Moreover, only Obikane et al [ ] and Singla et al [ ] included child-related variables in their protocol study, such as maternal psychological and physical aggression toward the child (n=1) [ ], the child’s physiological (n=1) [ ] or mental development (n=1) [ ], and the level of health care services used for the child (n=2) [ , ] ( ; Table S5 in ). The included studies also marginally evaluated the intervention-related outcomes. Specifically, 1 study protocol [ ] reported that they will evaluate therapy quality as well as homework completion and the frequency with which the intervention sessions are followed. Instead, 3 studies [ - ] evaluated intervention adherence, operationalized as the number of intervention modules opened and completed [ , ]. Only 2 studies specifically considered interventions’ feasibility (ie, if the intervention is feasible for further testing) and acceptability (ie, how well the intervention meets the needs of the target population) [ , ]. Finally, only 1 study [ ], a study protocol, reported that the assessment of usability will be conducted through the System Usability Scale [ ].
|Study||Study type||Study aim|
|Bagnall , 2014||Long-term follow-up of RCTa (doctoral dissertation)|
|Obikane et al , 2021||Protocol for RCT|
|O’Mahen et al , 2014||RCT|
|O’Mahen et al , 2014||RCT|
|O’Mahen et al , 2017||Secondary analysis from the study by O’Mahen et al |
|Singla et al , 2021||Protocol for 4-arm RCT (noninferiority trial)|
|Singla et al , 2022||Qualitative study|
aRCT: randomized controlled trial.
bBA: behavioral activation.
The sample characteristics and studies’ sample-related inclusion criteria are summarized in. All participants were postpartum women, except for those in the study by Singla et al [ , ], which focused on both antenatal and postnatal women. All studies used the Edinburgh Postnatal Depression Scale to include women in their study, albeit relying on different cutoff values. Moreover, in their 2014 study, O’Mahen et al [ , , ] had supplemented the Edinburgh Postnatal Depression Scale with a telephone interview aimed at ensuring that women satisfied the criteria for major depressive disorder according to the International Classification of Diseases, Tenth Revision. With regard to demographic information (Table S6 in ), information on the sample’s age was reported by only 2 studies [ , ], the sample’s ethnicity by 3 studies [ , , ], occupation by 4 studies [ , , , ], educational level by 3 studies [ , , ], income by 2 studies [ , ], marital status by 4 studies [ , , , ], and the total number of children by 3 studies [ , , ]. Finally, with regard to the studies’ sample sizes, the 2 protocol studies included [ , ] stated that they will include samples whose numerosity will be based on preliminary power analyses, and all the other included studies reported small sample sizes. Only 1 study [ ] reported a larger sample size (<150); nonetheless, changes in the sample’s numerosity from baseline to intervention end point and follow-up are unclear.
|Study||Sample, N||Perinatal period||Inclusion criteria||Exclusion criteria|
|Obikane et al , 2021||Over 75 per group (4 groups: estimated)||Post partum|
|O’Mahen et al , 2013||EGa: 164; CGb: 134||Post partum|
|O’Mahen et al , 2014; Bagnall [ ], 2014||EG: 41; CG: 42||Post partum|
|O’Mahen et al , 2017||32 (subsample of the study by O’Mahen et al )||Post partum|
|Singla et al , 2021||342 per group (4 groups; estimated)||Perinatal|
|Singla et al , 2022||23||Perinatal|
aEG: experimental group.
bCG: control group.
cEPDS: Edinburgh Postnatal Depression Scale.
dMDD: major depression disorder.
Digital Interventions’ Characteristics
The characteristics of the different interventions are reported inand Table S7 in . All interventions were based on validated BA protocols (ie, validated and manualized intervention protocols); however, none extensively explained the changes made to adapt the intervention to either the population or the digital setting. Studies’ intervention content structuring is quite consistent, with differences given mainly by the inclusion of optional modules [ , ] or the possibility to customize sessions [ ]. Furthermore, in the qualitative study by Singla et al [ ], the intervention protocol deployed during the COVID-19 lockdown was adapted to account for pandemic-related stressors and participants’ perceived racial injustice in a subsample of ethnic minority participants.
All interventions were guided, except for an unguided one  that, nonetheless, included a sort of “technical” support, whereby psychologists or specialized health visitors gave advice for homework completion and answered participants’ questions on the program material; no further information was reported. With regard to guided interventions, only O’Mahen et al [ ] and Singla et al [ , ] reported information on how supporters guiding them had been trained and monitored through supervision by expert clinicians. Moreover, in the studies by Singla et al [ , ] and O’Mahen et al [ ], authors monitored and evaluated supporters through independent fidelity raters who listened to recordings of the sessions. All 3 studies by O’Mahen et al [ , , ] and the related secondary analysis by Bagnall [ ] considered the web-based Netmums BA program; both the studies by Singla et al [ , ] relied on telemedicine, whereas only Obikane et al [ ] reported the development of a web-based BA intervention that can be deployed through smartphones. Obikane et al [ ] further reported that they will ensure data confidentiality by temporarily storing data in the Amazon Elastic Compute Cloud system and will only later move them in a password-protected computer. No other study reported information referred to data privacy and storage.
|Study||Intervention name||Length (weeks), total number of sessions||Guided versus unguided||Guided—description||Digital means||Intervention delivery format|
|Obikane et al , 2021||SmartMama||12, 12||Guided (psychotherapists)||Web-based app for smartphones|
|O’Mahen et al , 2013||Postnatal iBAa||15, 11||Unguided||Web based (Netmums site)|
|O’Mahen et al , 2013; O’Mahen et al [ ], 2014; Bagnall [ ], 2014||NetmumsHWD||17, 12||Guided (mental health workers)||Web based (Netmums site)|
|Singla et al , 2021||Behavioral activation||6-8, 6-8||Guided (nonspecialists and specialists)||Telemedicine|
|Singla et al , 2022||Behavioral activation||Not reported, 8||Guided (trained psychologists)||Telemedicine|
aiBA: internet-based Behavioral Activation.
bN/A: not applicable.
Results of Individual Evidence and Overall Synthesis
The main results of the studies, referring to both clinical outcomes and intervention-related outcomes, are summarized in. Overall, these studies consistently showed a significant intervention effect on depression symptoms. However, following multiple imputation analyses, the results of the study by O’Mahen et al [ ] showed that such differences were not significant between the intervention and control groups. The same authors reported a trend for reduced anxiety symptoms and improved work and social functioning compared with the control condition at the intervention end point; however, this trend was not statistically significant. Accordingly, in the secondary follow-up analysis by Bagnall [ ], the intervention effect was not significantly different between groups at any time point. Notwithstanding, the 2 case studies reported by Singla et al [ ] were useful in highlighting the subjective experience of participants and their perceived benefits of the interventions. In both case studies, participants reported an improvement in communication skills that favored the support between them and their husbands by sharing child-related responsibilities. Moreover, at the end of the intervention, participants reported better associating their mood with what was happening in their lives, thereby voluntarily redirecting their attention toward value-based activities that would improve their mood. At the intervention end point, one of the women self-reported remission in both depression and anxiety symptoms, whereas the other reported that she was then able to embrace her past traumas, triggered by postpartum-related stressors, and thereby requested a referral to a clinical professional. The secondary analysis performed by O’Mahen et al [ ] was also useful in highlighting the relevant processes underlying the intervention that were associated with its efficacy. Specifically, the authors observed that slightly more than half of the sample (18/32, 51%) showed at least one sudden improvement or gain in depression symptoms, even though these were often followed by a depression spike; however, participants showing these sudden improvements reported much reduced depression symptoms at intervention end point and also reported having followed more web-based intervention modules compared with those who had not reported such improvements. The same participants had also talked about more specific and concrete topics during the telephone sessions preceding the sudden gains [ ].
Regarding the interventions’ feasibility, acceptability, and overall intervention adherence, the available information is limited. However, although studies explicitly evaluated these factors, their results on dropout rates and adherence seemingly suggest reduced acceptability. The studies by O’Mahen et al [, ] provided information in this regard, reporting that dropouts were quite high and that there was limited participation in the real-time “online clinics” as well as in the chat rooms made available for mums to talk with each other. Moreover, limited intervention adherence was highlighted by the modest median completion rate of the intervention sessions. In this regard, it is noteworthy that reduced adherence was associated with women’s lower socioeconomic level, reduced social support as well as reduced work and social functioning, and with attending school or working [ ]. Nonetheless, based on participants’ feedback, what had favored acceptability and adherence was the convenient delivery of the intervention’s content and the ease experienced in following the program; however, the latter is hindered when interventions include large number of sessions and activities that women are requested to follow [ ]. Accordingly, O’Mahen et al [ , ] had simplified their intervention from their 2013 versus 2014 study. Moreover, contrary to what was reported by O’Mahen et al [ ] regarding the predictors of intervention adherence, the study by Bagnall [ ] did not identify any significant predictors (ie, depression symptoms level, level of BA, social support, and household income) of intervention adherence or the predictive role of assessments’ adherence to the intervention outcomes (eg, depression symptoms). The latter study was primarily focused on investigating participants’ adherence to follow-up assessments (which might thus better fit within the broader construct of “intervention feasibility” more than within that of “adherence”). In this regard, they reported that outreach helped improve participation in the follow-up assessments. No study investigated the programs’ usability; however, 1 of the included study protocols [ ], as previously reported, is expected to provide further information in this regard.
|Study||Assessment time points||Clinical outputs||Intervention-related outputs|
|Bagnall , 2014|
|Obikane et al , 2021|
|O’Mahen et al , 2013|
|O’Mahen et al , 2014|
|O’Mahen et al , 2017|
|Singla et al , 2021|
|Singla et al , 2022|
aT0: Time 0.
bT1: Time 1.
cT2: Time 2.
dT3: Time 3.
eBA: behavioral activation.
fN/A: not applicable.
gT4: Time 4.
This scoping review aimed to map the available literature on digital BA interventions administered during the perinatal period. The research questions guiding this work have focused on the interventions’ methodological underpinnings as well as on the interventions’ targets, referring to the specificities of the population considered as well as to the symptoms experienced by the latter.
Regarding research questions (4) Were digital BA interventions able to influence psychosocial symptoms other than depression? and (5) Have they willingly been used to influence symptoms other than depression? in line with expectations, they seem to be overall promising in reducing depression symptoms among postpartum women; however, owing to the limited literature available, it is not possible to draw definitive conclusions in this regard. Moreover, although an in-person BA intervention administered to pregnant women was effective in reducing anxiety symptoms , the sole concluded trial included in this review that had evaluated anxiety symptoms [ , ] reported no significant intervention effect. Accordingly, to date, it is not possible to draw complete conclusions on the generalizability of the efficacy of digital BA interventions on psychosocial variables (eg, anxiety and stress symptoms and quality of life) other than depression symptoms. This is mostly owing to the above-mentioned marginal investigation of these symptoms.
Referring, instead, to research question (6) Are there differences in the BA interventions administered during the antenatal period versus the postnatal period? it is noteworthy that of all the included studies, most [- , , ] focused solely on the postnatal period by considering women who had recently given birth, whereas none specifically focused on pregnant women and, therefore, on the antenatal period. However, one of the included protocol studies [ ] reported that it foresees the future inclusion of both antenatal and postnatal women to compare intervention efficacy as a function of the perinatal period during which it is deployed. Thus, overall, it is not possible to answer the research question focused on the efficacy of digital BA interventions deployed during the antenatal period versus the postnatal period. The lack of digital interventions administered during the antenatal period represents a limitation of the available literature in terms of both evidence-based treatments and prevention programs. This is relevant, especially considering the high prevalence of depressive symptoms during pregnancy (between 15% and 65% [ ]) and of the interrelated [ , ] anxiety (between 18% and 24% [ ]) and stress symptoms (low-moderate symptoms level 78% [ ]). Altogether, these hinder women’s quality of life [ ], with repercussions on the child’s development and well-being [ - ], while further significantly increasing the risk of postpartum depression [ , ]. These results might be particularly insightful if read through the lens of the Stepped Care model [ ]. This specific approach to health care advocates for a highly collaborative approach among primary and secondary mental health services to choose and deliver the most appropriate treatment, ranging from primary low-burden care to more intensive and specialized care on the basis of patients’ specific level of need and distress, which should ultimately improve access to health care for patients on one hand and, on the other hand, the efficiency and cost-effectiveness of treatments themselves [ ]. Within this theoretical framework, prevention programs can be regarded as primary health services; therefore, research on the feasibility and effectiveness of digital interventions within the perinatal period should be encouraged; such treatments are expected to be of great benefit for both women in the perinatal period and the health care system on the whole, as they should foster scalability and thereby reduce health care costs [ , ].
Similarly, with regard to overcoming the broader barriers already reported in the literature, limiting access to mental health care programs (eg, time constraints, lack of information about services, and social stigma [- ]), the creation and implementation of acceptable and effective digital interventions would also be advantageous in terms of both time and expenses for both the patients and the health care specialists. Moreover, through the advent of social media platforms and the possibility to create ad hoc websites, digital interventions can be made known and spread with greater ease, thereby allowing the extension of care to patients living in hard-to-reach areas. These same premises might also be associated with a reduction in the social stigma surrounding health care seeking by, on the one hand, normalizing the reliance on psychological programs and, on the other hand, allowing the maintenance of privacy within one’s social environment. This review also attempted to identify the logistic, social, and pragmatic barriers specifically associated with digital BA interventions. Focusing, instead, on research question (3) What were the main barriers, including both participants’ concerns and issues given by the digital tool itself, in implementing BA interventions through digital means? the data reported here do not allow to gather insights or formulate suggestions regarding the existence and potential overcoming of barriers within the context of digital BA interventions during the perinatal period. In fact, only 1 study [ ] specifically addressed the intervention’s barriers, raising some concerns about the maintenance of privacy during the intervention; however, this might be strictly linked to the use of telemedicine in general rather than on digital BA interventions specifically.
Regarding the remaining research questions, namely, (2) Has a specific BA protocol been followed? if so, on what BA protocol were the interventions based?  and (1) How have BA interventions been structured (eg, intervention length, number of modules, topics considered, and guided versus unguided interventions) to be administered through digital means? it is worth highlighting that all interventions were based on validated BA protocols [ ], but no extensive explanation of the changes made to the original protocols were reported. Similarly, scarce information was reported on the role of the guidance in the guided interventions as well as on the specificities of the digital means used to administer the interventions. This limits the reproducibility of studies as well as the advancement of the matter, as it restricts the possibility of identifying the benefits and limitations of the different digital BA interventions. Likewise, all the included studies reported limited information on how the interventions’ content and home assignments were implemented and deployed. However, a thorough reporting of the choices made on the intervention content and structuring, of the specificities of the technological components used to implement the intervention, and of the potential drawbacks that might have emerged from the trials is needed to foster information exchange within the scientific community. This is particularly relevant, considering their value for the feasibility and efficacy of the intervention as well as for overall usability. Including such information in trial reports would ultimately contribute to the broader research field. In line with this thought, the work by O’Mahen et al [ , ] is noteworthy with regard to the investigation of the feasibility of interventions, as they reported refining their intervention structuring in line with participants’ feedback and then retesting its efficacy. In this regard, although none of the studies provided reasons for choosing a certain number of sessions composing the interventions, O’Mahen et al [ , ] reported reducing the number of core sessions while including some optional modules [ ]—a decision based on participants’ feedback stating that they could not “keep up” with the intervention [ ]. This particular mode of action is what seems to be lacking and should instead be promoted, as it provides information on the interventions’ specific structures, thereby favoring scientific exchange and, ultimately, the advancement of the matter. Future studies might benefit from including qualitative evaluations of the interventions’ experience and overall usability, for instance, by foreseeing the use of semistructured interviews at the end of the intervention [ ]. In this regard, it should be stressed that usability was not evaluated by any of the concluded research studies included in this review, although the criticality of adherence to interventions was highlighted as it emerged in previous studies [ , ]. Usability is conceptualized as the output of the interaction between the user and the tools (eg, website) used [ ] and includes 5 main concepts [ ]: ease of use, intended as learnability, experienced by users learning how to use a digital tool; the efficiency with which users interact with the digital tool; the memorability of how to use a digital tool to which the user has been already exposed; the errors users make, intended as the number of trials needed to make a certain action correctly; and the perceived users’ satisfaction with the user experience. The latter further includes aspects relevant to user engagement, including the affective, cognitive, and behavioral response of the user to the digital tool [ ]. In this regard, Bagnall [ ], referring to the nonpredictive effect of intervention adherence on the intervention outcomes, discussed that beyond adherence, it might indeed be the level of engagement with the intervention, intended as behavioral participation, to be particularly relevant in influencing intervention efficacy. In line with this, O’Mahen et al [ ] highlighted that intervention acceptability as well as adherence, as reported by women, was favored by the convenient delivery of the intervention’s content and the ease felt in following the program, which are all aspects relevant to usability. This further highlights the importance of accounting for usability facets when investigating the efficacy of digital interventions, which emerged in this review as a strong limitation of the literature on digital BA interventions deployed during the perinatal period. Future studies should, therefore, more carefully and consistently account for and thoroughly explain the results of the user experience while also accounting for user engagement [ ].
Overall, the information retrieved through this scoping review does not allow to provide specific suggestions for the implementation of interventions. However, the gaps identified in the available literature can be useful for refining existing protocols and supporting the design of future interventions. Specifically, there has emerged a need to substantially investigate both the usability and user engagement associated with these digital interventions to better understand and refine them. The human-computer interaction aspects of these interventions, as of today, seem only marginally considered but should instead be central in future research, as they define the “setting” in which interventions take place. It should be noted that the existing literature does provide guidelines  or models [ ] that should be followed in future trials to support adherence and engagement, as they are pivotal for the efficacy of interventions. Moreover, greater flexibility in the structuring of interventions (ie, the number of sessions and time required to complete each session) is recommended, as it would support acceptability. These aspects might be particularly valuable, considering the high attrition rate of these interventions, which had already been pointed out by existing literature and was coherently reported by the included studies as well [ ].
Taken together, the available literature examined was useful in highlighting the potential, and also the immaturity, of the research field on digital BA interventions, while promptly stressing the need to develop interventions specifically targeting pregnant women. To address this gap, future research should focus on addressing such limitations, paying particular attention to the investigation of the feasibility, acceptability, and usability of interventions. Moreover, future studies should invest in the development and evaluation of digital prevention programs deployed during pregnancy.
Conflicts of Interest
Supplementary materials.DOCX File , 286 KB
- Cheng CY, Chou YH, Wang P, Tsai JM, Liou SR. Survey of trend and factors in perinatal maternal fatigue. Nurs Health Sci 2015 Mar;17(1):64-70 [FREE Full text] [CrossRef] [Medline]
- Nelson AM. Transition to motherhood. J Obstet Gynecol Neonatal Nurs 2003 Jul;32(4):465-477 [FREE Full text] [CrossRef] [Medline]
- Fisher J, Cabral de Mello M, Patel V, Rahman A, Tran T, Holton S, et al. Prevalence and determinants of common perinatal mental disorders in women in low- and lower-middle-income countries: a systematic review. Bull World Health Organ 2012 Feb 01;90(2):139G-149G [FREE Full text] [CrossRef] [Medline]
- Howard LM, Khalifeh H. Perinatal mental health: a review of progress and challenges. World Psychiatry 2020 Oct;19(3):313-327 [FREE Full text] [CrossRef] [Medline]
- Li H, Bowen A, Bowen R, Balbuena L, Feng C, Bally J, et al. Mood instability during pregnancy and postpartum: a systematic review. Arch Womens Ment Health 2020 Feb;23(1):29-41 [FREE Full text] [CrossRef] [Medline]
- Jha S, Salve HR, Goswami K, Sagar R, Kant S. Burden of common mental disorders among pregnant women: a systematic review. Asian J Psychiatr 2018 Aug;36:46-53 [FREE Full text] [CrossRef] [Medline]
- Gelaye B, Rondon MB, Araya R, Williams MA. Epidemiology of maternal depression, risk factors, and child outcomes in low-income and middle-income countries. Lancet Psychiatry 2016 Oct;3(10):973-982 [FREE Full text] [CrossRef] [Medline]
- Hutchens BF, Kearney J. Risk factors for postpartum depression: an umbrella review. J Midwifery Womens Health 2020 Jan;65(1):96-108 [FREE Full text] [CrossRef] [Medline]
- American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). 5th edition. Washington, DC, USA: American Psychiatric Association; 2013.
- Batt MM, Duffy KA, Novick AM, Metcalf CA, Epperson CN. Is postpartum depression different from depression occurring outside of the perinatal period? A review of the evidence. Focus (Am Psychiatr Publ) 2020 Apr;18(2):106-119 [FREE Full text] [CrossRef] [Medline]
- Valoriani V, Lotti F, Lari D, Miccinesi G, Vaiani S, Vanni C, et al. Differences in psychophysical well-being and signs of depression in couples undergoing their first consultation for assisted reproduction technology (ART): an Italian pilot study. Eur J Obstet Gynecol Reprod Biol 2016 Feb;197:179-185 [FREE Full text] [CrossRef] [Medline]
- Monga M, Alexandrescu B, Katz SE, Stein M, Ganiats T. Impact of infertility on quality of life, marital adjustment, and sexual function. Urology 2004 Jan;63(1):126-130 [FREE Full text] [CrossRef] [Medline]
- Peterson BD, Pirritano M, Christensen U, Schmidt L. The impact of partner coping in couples experiencing infertility. Hum Reprod 2008 May;23(5):1128-1137 [FREE Full text] [CrossRef] [Medline]
- Schmidt L. Psychosocial burden of infertility and assisted reproduction. Lancet 2006 Feb 04;367(9508):379-380 [FREE Full text] [CrossRef] [Medline]
- Wang L, Wang L, Yang X, Jin P, Zhang R, Jiang Y, et al. Risk factors related to early pregnancy loss in fresh IVF/ICSI: an analysis of 954 embryo transfer cycles. Medicine (Baltimore) 2022 Aug 26;101(34):e30166. [CrossRef] [Medline]
- Bu Z, Hu L, Su Y, Guo Y, Zhai J, Sun YP. Factors related to early spontaneous miscarriage during IVF/ICSI treatment: an analysis of 21,485 clinical pregnancies. Reprod Biomed Online 2020 Feb;40(2):201-206 [FREE Full text] [CrossRef] [Medline]
- Malham S. The mental health effects of assisted reproductive technology. East Carolina University. 2022. URL: https://thescholarship.ecu.edu/handle/10342/10829 [accessed 2022-10-31]
- Hadfield H, Wittkowski A. Women's experiences of seeking and receiving psychological and psychosocial interventions for postpartum depression: a systematic review and thematic synthesis of the qualitative literature. J Midwifery Womens Health 2017 Nov;62(6):723-736 [FREE Full text] [CrossRef] [Medline]
- Jones A. Help seeking in the perinatal period: a review of barriers and facilitators. Soc Work Public Health 2019;34(7):596-605 [FREE Full text] [CrossRef] [Medline]
- Megnin-Viggars O, Symington I, Howard LM, Pilling S. Experience of care for mental health problems in the antenatal or postnatal period for women in the UK: a systematic review and meta-synthesis of qualitative research. Arch Womens Ment Health 2015 Dec;18(6):745-759 [FREE Full text] [CrossRef] [Medline]
- Ashford MT, Ayers S, Olander EK. Interest in web-based treatments for postpartum anxiety: an exploratory survey. J Reprod Infant Psychol 2017 Sep;35(4):394-409 [FREE Full text] [CrossRef] [Medline]
- Lackie ME, Parrilla JS, Lavery BM, Kennedy AL, Ryan D, Shulman B, et al. Digital health needs of women with postpartum depression: focus group study. J Med Internet Res 2021 Jan 06;23(1):e18934 [FREE Full text] [CrossRef] [Medline]
- Wenze SJ, Miers QA, Battle CL. Postpartum mental health care for mothers of multiples: a qualitative study of new mothers' treatment preferences. J Psychiatr Pract 2020 May;26(3):201-214 [FREE Full text] [CrossRef] [Medline]
- Chae J, Kim HK. Internet-based prenatal interventions for maternal health among pregnant women: a systematic review and meta-analysis. Child Youth Serv Rev 2021 Aug 01;127:106079 [FREE Full text] [CrossRef]
- Dol J, Richardson B, Murphy GT, Aston M, McMillan D, Campbell-Yeo M. Impact of mobile health interventions during the perinatal period on maternal psychosocial outcomes: a systematic review. JBI Evid Synth 2020 Jan;18(1):30-55 [FREE Full text] [CrossRef] [Medline]
- Lee EW, Denison FC, Hor K, Reynolds RM. Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review. BMC Pregnancy Childbirth 2016 Feb 29;16:38 [FREE Full text] [CrossRef] [Medline]
- Hayes SC, Hofmann SG. "Third-wave" cognitive and behavioral therapies and the emergence of a process-based approach to intervention in psychiatry. World Psychiatry 2021 Oct;20(3):363-375 [FREE Full text] [CrossRef] [Medline]
- Jacobson NS, Martell CR, Dimidjian S. Behavioral activation treatment for depression: returning to contextual roots. Clin Psychol (New York) 2001;8(3):255-270 [FREE Full text] [CrossRef]
- Dimidjian S, Barrera Jr M, Martell C, Muñoz RF, Lewinsohn PM. The origins and current status of behavioral activation treatments for depression. Annu Rev Clin Psychol 2011;7:1-38 [FREE Full text] [CrossRef] [Medline]
- Kanter JW, Manos RC, Bowe WM, Baruch DE, Busch AM, Rusch LC. What is behavioral activation? A review of the empirical literature. Clin Psychol Rev 2010 Aug;30(6):608-620 [FREE Full text] [CrossRef] [Medline]
- Soucy Chartier I, Provencher MD. Behavioural activation for depression: efficacy, effectiveness and dissemination. J Affect Disord 2013 Mar 05;145(3):292-299 [FREE Full text] [CrossRef] [Medline]
- Dimidjian S, Goodman SH, Sherwood NE, Simon GE, Ludman E, Gallop R, et al. A pragmatic randomized clinical trial of behavioral activation for depressed pregnant women. J Consult Clin Psychol 2017 Jan;85(1):26-36 [FREE Full text] [CrossRef] [Medline]
- O'Mahen HA, Grieve H, Jones J, McGinley J, Woodford J, Wilkinson EL. Women's experiences of factors affecting treatment engagement and adherence in internet delivered behavioural activation for postnatal depression. Internet Interv 2015 Mar;2(1):84-90 [FREE Full text] [CrossRef]
- Ekers D, Richards D, McMillan D, Bland JM, Gilbody S. Behavioural activation delivered by the non-specialist: phase II randomised controlled trial. Br J Psychiatry 2011 Jan;198(1):66-72 [FREE Full text] [CrossRef] [Medline]
- Huguet A, Miller A, Kisely S, Rao S, Saadat N, McGrath PJ. A systematic review and meta-analysis on the efficacy of internet-delivered behavioral activation. J Affect Disord 2018 Aug 01;235:27-38 [FREE Full text] [CrossRef] [Medline]
- Spates CR, Padalino R, Hale AC, Germain CS, Nimmo K, Kohler R. A review of web‐based technology in behavioural activation. Clin Psychol 2016 Jan 21;20(1):27-35 [FREE Full text] [CrossRef]
- Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc 2015 Sep;13(3):141-146 [FREE Full text] [CrossRef] [Medline]
- Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2007 Feb 23;8(1):19-32 [FREE Full text] [CrossRef]
- Lejuez CW, Hopko DR, Acierno R, Daughters SB, Pagoto SL. Ten year revision of the brief behavioral activation treatment for depression: revised treatment manual. Behav Modif 2011 Mar;35(2):111-161 [FREE Full text] [CrossRef] [Medline]
- Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018 Oct 02;169(7):467-473 [FREE Full text] [CrossRef] [Medline]
- O'Mahen HA, Woodford J, McGinley J, Warren FC, Richards DA, Lynch TR, et al. Internet-based behavioral activation--treatment for postnatal depression (Netmums): a randomized controlled trial. J Affect Disord 2013 Sep 25;150(3):814-822 [FREE Full text] [CrossRef] [Medline]
- O'Mahen HA, Richards DA, Woodford J, Wilkinson E, McGinley J, Taylor RS, et al. Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression. Psychol Med 2014 Jun;44(8):1675-1689 [FREE Full text] [CrossRef] [Medline]
- Obikane E, Baba T, Shinozaki T, Obata S, Nakanishi S, Murata C, et al. Internet-based behavioural activation to improve depressive symptoms and prevent child abuse in postnatal women (SmartMama): a protocol for a pragmatic randomized controlled trial. BMC Pregnancy Childbirth 2021 Apr 20;21(1):314 [FREE Full text] [CrossRef] [Medline]
- Singla DR, Meltzer-Brody SE, Silver RK, Vigod SN, Kim JJ, La Porte LM, et al. Scaling up maternal mental healthcare by increasing access to treatment (SUMMIT) through non-specialist providers and telemedicine: a study protocol for a non-inferiority randomized controlled trial. Trials 2021 Mar 05;22(1):186 [FREE Full text] [CrossRef] [Medline]
- O'Mahen HA, Wilkinson E, Bagnall K, Richards DA, Swales A. Shape of change in internet based behavioral activation treatment for depression. Behav Res Ther 2017 Aug;95:107-116 [FREE Full text] [CrossRef] [Medline]
- Bagnall KM. Long-term follow-up of netmumshwd: a feasibility randomised controlled trial of telephone supported online behavioural activation for postnatal depression at 16 months post-randomisation. University of Exeter. 2014 May 06. URL: https://ore.exeter.ac.uk/repository/handle/10871/15289 [accessed 2022-05-24]
- Singla DR, Hossain S, Ravitz P, Schiller CE, Andrejek N, Kim J, et al. Adapting behavioral activation for perinatal depression and anxiety in response to the COVID-19 pandemic and racial injustice. J Affect Disord 2022 Feb 15;299:180-187 [FREE Full text] [CrossRef] [Medline]
- van de Schoot R, de Bruin J, Schram R, Zahedi P, de Boer J, Weijdema F, et al. An open source machine learning framework for efficient and transparent systematic reviews. Nat Mach Intell 2021 Feb 01;3(2):125-133 [FREE Full text] [CrossRef]
- Brooke J. SUS: a 'quick and dirty' usability scale. In: Jordan PW, Thomas B, McClelland IL, Weerdmeester B, editors. Usability Evaluation in Industry. Boca Raton, FL, USA: The CRC Press; 1996:189-194.
- Dadi AF, Miller ER, Bisetegn TA, Mwanri L. Global burden of antenatal depression and its association with adverse birth outcomes: an umbrella review. BMC Public Health 2020 Feb 04;20(1):173 [FREE Full text] [CrossRef] [Medline]
- Cena L, Gigantesco A, Mirabella F, Palumbo G, Camoni L, Trainini A, et al. Prevalence of comorbid anxiety and depressive symptomatology in the third trimester of pregnancy: analysing its association with sociodemographic, obstetric, and mental health features. J Affect Disord 2021 Dec 01;295:1398-1406 [FREE Full text] [CrossRef] [Medline]
- Cheng CY, Chou YH, Chang CH, Liou SR. Trends of perinatal stress, anxiety, and depression and their prediction on postpartum depression. Int J Environ Res Public Health 2021 Sep 03;18(17):9307 [FREE Full text] [CrossRef] [Medline]
- Dennis CL, Falah-Hassani K, Shiri R. Prevalence of antenatal and postnatal anxiety: systematic review and meta-analysis. Br J Psychiatry 2017 May;210(5):315-323. [CrossRef] [Medline]
- Woods SM, Melville JL, Guo Y, Fan MY, Gavin A. Psychosocial stress during pregnancy. Am J Obstet Gynecol 2010 Jan;202(1):61.e1-61.e7 [FREE Full text] [CrossRef] [Medline]
- Lagadec N, Steinecker M, Kapassi A, Magnier MA, Chastang J, Robert S, et al. Factors influencing the quality of life of pregnant women: a systematic review. BMC Pregnancy Childbirth 2018 Nov 23;18(1):455 [FREE Full text] [CrossRef] [Medline]
- Betts KS, Williams GM, Najman JM, Alati R. The relationship between maternal depressive, anxious, and stress symptoms during pregnancy and adult offspring behavioral and emotional problems. Depress Anxiety 2015 Feb;32(2):82-90 [FREE Full text] [CrossRef] [Medline]
- Field T, Diego M, Hernandez-Reif M, Figueiredo B, Deeds O, Ascencio A, et al. Comorbid depression and anxiety effects on pregnancy and neonatal outcome. Infant Behav Dev 2010 Feb;33(1):23-29 [FREE Full text] [CrossRef] [Medline]
- Talge NM, Neal C, Glover V, Early Stress, Translational Research and Prevention Science Network: Fetal and Neonatal Experience on Child and Adolescent Mental Health. Antenatal maternal stress and long-term effects on child neurodevelopment: how and why? J Child Psychol Psychiatry 2007 Mar;48(3-4):245-261. [CrossRef] [Medline]
- Caparros-Gonzalez RA, Romero-Gonzalez B, Strivens-Vilchez H, Gonzalez-Perez R, Martinez-Augustin O, Peralta-Ramirez MI. Hair cortisol levels, psychological stress and psychopathological symptoms as predictors of postpartum depression. PLoS One 2017 Aug 28;12(8):e0182817 [FREE Full text] [CrossRef] [Medline]
- Richards DA. Stepped care: a method to deliver increased access to psychological therapies. Can J Psychiatry 2012 Apr;57(4):210-215 [FREE Full text] [CrossRef] [Medline]
- Conejo-Cerón S, Lokkerbol J, Moreno-Peral P, Wijnen B, Fernández A, Mendive JM, et al. Health-economic evaluation of psychological interventions for depression prevention: systematic review. Clin Psychol Rev 2021 Aug;88:102064. [CrossRef] [Medline]
- Wang Q, Su M, Zhang M, Li R. Integrating digital technologies and public health to fight Covid-19 pandemic: key technologies, applications, challenges and outlook of digital healthcare. Int J Environ Res Public Health 2021 Jun 04;18(11):6053 [FREE Full text] [CrossRef] [Medline]
- Addis ME, Martell CR. Overcoming Depression One Step at a Time: The New Behavioral Activation Approach to Getting Your Life Back: New Harbinger Self-help Workbook. Oakland, CA, USA: New Harbinger; 2004.
- Bassi G, Giuliano C, Perinelli A, Forti S, Gabrielli S, Salcuni S. A virtual coach (Motibot) for supporting healthy coping strategies among adults with diabetes: proof-of-concept study. JMIR Hum Factors 2022 Jan 21;9(1):e32211 [FREE Full text] [CrossRef] [Medline]
- Bassi G, Mancinelli E, Dell'Arciprete G, Rizzi S, Gabrielli S, Salcuni S. Efficacy of eHealth interventions for adults with diabetes: a systematic review and meta-analysis. Int J Environ Res Public Health 2021 Aug 26;18(17):8982 [FREE Full text] [CrossRef] [Medline]
- Mancinelli E, Bassi G, Gabrielli S, Salcuni S. The efficacy of digital cognitive-behavioral interventions in supporting the psychological adjustment and sleep quality of pregnant women with sub-clinical symptoms: a systematic review and meta-analysis. Int J Environ Res Public Health 2022 Aug 03;19(15):9549 [FREE Full text] [CrossRef] [Medline]
- Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. ISO 9241-11:2018(en). International Organization for Standardization. 2018. URL: https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en [accessed 2022-05-19]
- Nielsen J. Usability Engineering. Burlington, MA, USA: Morgan Kaufmann; 1993.
- O’Brien HL, Cairns P, Hall M. A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int J Hum Comput Stud 2018 Apr;112:28-39 [FREE Full text] [CrossRef]
- Petersen GB, Nielsen JH, Olsen JV, Kok RN. Usability guidelines for developing and evaluating web-based mental health interventions: establishing a practical framework. PsyArXiv Preprint posted online August 21, 2019. [CrossRef]
- Cole-Lewis H, Ezeanochie N, Turgiss J. Understanding health behavior technology engagement: pathway to measuring digital behavior change interventions. JMIR Form Res 2019 Oct 10;3(4):e14052 [FREE Full text] [CrossRef] [Medline]
|ART: assisted reproductive technique|
|BA: behavioral activation|
|PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analysis|
|PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for Scoping Reviews|
|RCT: randomized controlled trial|
Edited by T Leung, G Eysenbach; submitted 10.07.22; peer-reviewed by MP Gagnon, A Coe; comments to author 23.09.22; revised version received 07.12.22; accepted 03.01.23; published 28.02.23Copyright
©Elisa Mancinelli, Gaia Dell'Arciprete, Davide Pattarozzi, Silvia Gabrielli, Silvia Salcuni. Originally published in JMIR Pediatrics and Parenting (https://pediatrics.jmir.org), 28.02.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on https://pediatrics.jmir.org, as well as this copyright and license information must be included.