Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 21.08.20 in Vol 3, No 2 (2020): Jul-Dec

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/20312, first published May 15, 2020.

This paper is in the following e-collection/theme issue:

    Original Paper

    Perceptions and Attitudes Toward Mobile Health in Development of an Exclusive Breastfeeding Tool: Focus Group Study With Caregivers and Health Promoters in the Dominican Republic

    1Department of Pediatrics, Global Health Center, The Children's Hospital of Philadelphia, Philadelphia, PA, United States

    2Centro de Salud Divina Providencia, Consuelo, Dominican Republic

    3Clínica de Familia La Romana, La Romana, Dominican Republic

    4Children's Hospital of Orange County, Orange, CA, United States

    5School of Nursing, Columbia University, New York, NY, United States

    6Fox Chase Cancer Center, Philadelphia, PA, United States

    Corresponding Author:

    Clarisse G Casilang, MD

    Department of Pediatrics

    Global Health Center

    The Children's Hospital of Philadelphia

    Roberts Center for Pediatric Research

    2716 South Street

    Philadelphia, PA, 19146

    United States

    Phone: 1 267 426 6298

    Email: casilangc@email.chop.edu


    ABSTRACT

    Background: Despite growing interest in the use of technology to improve health outcomes in low- and middle-income countries (LMICs), local attitudes toward mobile health (mHealth) use in these settings are minimally understood. This is especially true in the Dominican Republic, where mHealth interventions are starting to emerge. This information is critical for developing effective mHealth interventions to address public health issues, such as low exclusive breastfeeding (EBF) rates, which can lead to poor outcomes. With an EBF rate of 5% in the first 6 months of life, the Dominican Republic has one of the lowest EBF rates worldwide.

    Objective: This study aims to describe the current use of information and communication technology (ICT) and to analyze the attitudes and perceptions related to using mHealth interventions among caregivers of children aged ≤5 years and health promoters in the Dominican Republic. Findings can inform mHealth strategies aimed at improving EBF in this, and other, LMICs.

    Methods: Participants were recruited from 3 outpatient sites: the Niños Primeros en Salud program at Centro de Salud Divina Providencia in Consuelo (rural setting) and Clínica de Familia La Romana and its program Módulo de Adolescentes Materno Infantil in La Romana (urban setting). Focus groups were conducted with caregivers and community health promoters to identify the use, attitudes, perceptions, and acceptability of mHealth as well as barriers to EBF. Discussions were conducted in Spanish, guided by semistructured interview guides. All sessions were audio-recorded and later transcribed. Thematic content analysis was conducted in Spanish by two bilingual researchers and was structured around a hybrid behavioral theory framework to identify salient themes.

    Results: All participants (N=35) reported having a mobile phone, and 29 (83%) participants had a smartphone. Sources for obtaining health information included the internet, physicians and clinic, family and friends, health promoters, and television. Barriers to mHealth use included the cost of internet service, privacy concerns, and perceived credibility of information sources. Participants indicated the desire for, and willingness to use, an mHealth intervention to support breastfeeding. The desired features of a possible mHealth intervention included offering diverse methods of information delivery such as images and video content, text messages, and person-to-person interaction as well as notifications for appointments, vaccines, and feeding schedules. Other important considerations were internet-free access and content that included maternal and child health self-management topics beyond breastfeeding.

    Conclusions: There is a high level of acceptance of ICT tools for breastfeeding promotion among caregivers in urban and rural areas of the Dominican Republic. As mHealth tools can contribute to increased breastfeeding self-efficacy, identifying desirable features of such a tool is necessary to create an effective intervention. Participants wanted to receive trusted and reliable information through various formats and were interested in information beyond breastfeeding.

    JMIR Pediatr Parent 2020;3(2):e20312

    doi:10.2196/20312

    KEYWORDS



    Introduction

    Background

    eHealth resources hold promise for advancing child health in low- and middle-income countries (LMICs) where information and communication technologies (ICT) are ubiquitous [1]. According to the United Nations Development Program, ICT are a set of “goods, applications or services that are used to distribute and exchange information,” including radio, television, telephone, computers, mobile phones, and the internet [2]. eHealth is the use of ICT in “support of health and health-related fields, including health-care services, health surveillance, health literature, health education, knowledge and research” [3]. Within eHealth, mobile health (mHealth) explores how “mobile technologies can be best used to enhance access to health services and information and to improve the way health professionals deliver health-related services to the general public” [4]. Understanding caregiver perceptions and attitudes toward using mobile phones for health-related purposes is a critical step in developing mHealth interventions that aim to improve child health outcomes internationally, including infant mortality rates [4,5].

    Globally, approximately 45% of all infant deaths under 5 years of age are linked to nutrition-related factors [6]. Early initiation of breastfeeding and effective exclusive breastfeeding (EBF) can significantly reduce infant mortality due to common childhood illnesses such as diarrhea or pneumonia [7,8]. According to data from the World Bank, the Dominican Republic has an EBF rate of infants under 6 months of age at only 5% (2014), which is one of the lowest rates worldwide [9]. The Dominican Republic also has an under-five mortality rate of 29 deaths per 1000 live births (2018), considerably higher than the median of 16 deaths per 1000 live births in Latin America and the Caribbean [10]. To address this significant child health issue, breastfeeding promotion interventions emphasizing early initiation and EBF until 6 months of age are critical. These must be effectively designed and utilized in settings such as the Dominican Republic and other LMICs where challenges persist in providing high-quality, easily accessible EBF care and support [11,12].

    Although mHealth interventions have been shown to alleviate barriers and enhance access to care in LMICs, a strategic approach in their development is needed to implement effective mHealth on a larger scale and to study how technology can improve health outcomes [4,13-18]. Recognizing that the field of mHealth is rapidly transforming the delivery of health services around the world, the World Health Organization launched an initiative dedicated to the study of eHealth in May 2005 [19]. The United Nations International Children’s Emergency Fund has officially identified “promoting the use of new technologies to more efficiently and effectively serve children, especially the most disadvantaged” as part of its Strategic Plan for 2018-2021 [20]. The literature on mHealth in LMICs has examined the use of technology in health care delivery, health systems development, disease surveillance, and implementation of mHealth-based policies [21-25]. However, caregiver perceptions and attitudes toward using mHealth in a global health setting are poorly understood [26].

    Objectives

    The specific objectives of this study were to describe the current use of ICT and analyze the attitudes and perceptions toward mHealth among caregivers of children younger than 5 years in the Dominican Republic. Although previous studies [27-30] have also utilized a stakeholder-informed process to guide the development of an mHealth intervention to promote EBF, this study was designed using a combined behavioral theory model. Findings will inform future mHealth interventions that aim to improve EBF rates in the Dominican Republic and other LMICs.


    Methods

    Institutional Review Board Review

    This study was reviewed and granted exemption by the Institutional Review Board at the Children’s Hospital of Philadelphia, which determined that this study met the exemption criteria per 45 CFR 46.104(d) 2. The Comité Nacional de Bioética en Salud in Santo Domingo, Dominican Republic, agreed that the study was exempt from full Institutional Review Board review. All study procedures were conducted in accordance with the ethical standards of the Helsinki Declaration of the World Medical Association.

    Study Sites

    The study was conducted at 3 outpatient clinical sites in the Dominican Republic: the Niños Primeros en Salud (NPS) program at Centro de Salud Divina Providencia in Consuelo and Clínica de Familia La Romana (CFLR) and its Módulo de Adolescentes Materno Infantil (MAMI) program, both in La Romana. These sites were purposefully selected to provide a diverse selection of rural and urban mothers and caregivers of children aged ≤5 years to allow for a richer understanding of varied attitudes and perceptions toward mHealth and experiences with EBF. Each site has a set of distinguishing characteristics. In brief, NPS, CFLR, and MAMI fundamentally aim to address factors that influence child nutrition, such as household food insecurity, chronic illness (specifically HIV), and young maternal age, respectively [31]. NPS provides primary outpatient care to children under the age of 5 years living in some of the poorest neighborhoods, also called barrios, in a rural community. CFLR is a large health center that provides primary care services and specializes in HIV care and prevention in the Southwest region of the country. MAMI is a satellite clinic of CFLR that provides prenatal and reproductive health care to adolescents and primary care to children of adolescent mothers up to 1 year of age.

    Study Population

    Consuelo is a rural municipality of the San Pedro de Macorís province with 30,000 inhabitants [32]. The main industry of the region is agriculture, especially sugar cane production. Many barrios in Consuelo lack basic amenities such as indoor plumbing and electricity. The catchment area of La Romana province has a population of 276,000 inhabitants, including 80,000 women aged between 15 to 50 years [33]. An estimated 4000 female commercial sex workers are based in La Romana [33]. In addition to the urban city of La Romana, many sugarcane workers and their families live in bateyes, which are underserved sugarcane plantation communities. Batey residents include Haitian permanent residents, seasonal migrant workers, and indigent Dominicans [33].

    Participants in focus group discussions (FGDs) were stratified into groups of caregivers or community health promoters to encourage comfort and candor, as caregivers may have felt uncomfortable sharing information in front of the promoters. For this study, a caregiver was defined as the mother or female guardian of a child aged ≤5 years receiving care at one of the study sites. Traditionally, health promoters are caregivers selected from within their community to serve as trusted advocates, health educators, and health system navigators for other families in their neighborhood or the surrounding community. CFLR and MAMI health promoters are full-time paid employees, whereas NPS health promoters receive a small stipend for several hours served monthly. As they are considered experienced parent leaders in their community, health promoters have a unique perspective on how mHealth can be used to carry out their daily activities.

    Eligibility Criteria

    The criteria used for participants to be considered eligible to enroll in the study were as follows:

    1. Mother or female guardian of a child aged ≤5 years or female health promoter of NPS, CFLR, or MAMI.
    2. For caregiver participants, the child is a patient receiving care at NPS, CFLR, or MAMI.
    3. Speaks and understands Spanish.

    Due to the sensitive nature of breastfeeding, the lead investigators chose to have female gender as inclusion criteria, as well as a female focus group facilitator. It was inferred that mixed-gender groups might inhibit women from candidly discussing their experiences with, and barriers to, EBF.

    Sample Size

    The sample size was established based on the study team’s experiences in group design sessions as well as recommendations for sample sizes in qualitative research [34-36]. Several sources have suggested that well-designed focus groups consist of 6 to 12 participants depending on subject and time limits [37,38]. The rationale for this range stems from the goal that enough participants must be included in the groups for a breadth of information to be captured; however, groups should not be so large that each participant does not have a chance to contribute. Moreover, the goal of a qualitative study should be to have a large enough sample size to uncover a variety of opinions but to limit the sample size at the point of saturation. The final sample size was determined by thematic saturation, the point at which new data no longer appeared to contribute to the findings due to the repetition of themes and comments by participants. Additional focus groups were discontinued when it was determined that saturation was attained.

    Recruitment

    For potential caregiver participants, the principal investigator (CC) worked with clinic staff and nurses to approach each potential participant at random in the clinic waiting room at each site, explained the nature of the study, and assessed the participant’s eligibility using a screening questionnaire. This generated a convenience sample of potential participants who were present in the clinic waiting area at each site on the days when the principal investigator (CC) was available to recruit for the study. Health promoters were recruited either by telephone or in-person at the clinics. All female health promoters were invited to participate. Those who expressed interest in participating were provided with the date, time, and location of the group discussion. As all participants might not be available on the day of the focus groups, several sources suggested over-recruitment by 20% to 50% [39,40], so goal recruitment was 9 participants per group.

    Data Collection

    Data collection took place between December 2018 and February 2019. Before each FGD, informed consent procedures were administered and written informed consent was obtained, including consent to record FGDs with a digital recorder. Participant confidentiality was assured by using floral-themed names rather than their real names during the FGD so that participants could not be identified in the written transcripts.

    Before starting the FGDs, we developed a semistructured FGD guide in English and then translated it into Spanish. Local stakeholders (ie, staff pediatricians, nurses, and other clinic staff) verified and revised the translation of preliminary interview guides. The development of the focus group guide was framed using the extended technology acceptance model (ETAM) [41] constructs, the information-motivation-behavioral skills (IMB) model [42] constructs, and scholarly literature, specifically from previous studies using focus groups as formative research for mHealth interventions in an LMIC [43] and in a high-risk population [44]. These semistructured discussion guides were iteratively refined after each focus group and modified to include new data gathered during discussions. The FGD guide for caregivers was designed to elicit which ICT they use, how they utilize ICT to access health information, what factors discourage and motivate caregivers to seek mHealth tools, and what features would be desired in a potential mHealth intervention. Caregiver groups were also asked to share their perspectives on influencing factors for EBF practices. The FGD guide for health promoters focused on identifying challenges with EBF and suggestions on how mHealth tools might be used to promote effective EBF practices.

    FGDs were facilitated by a trained local research associate and were conducted in Spanish using the FGD guide. Training was provided by one of the senior researchers (LF) who has extensive experience in focus group facilitation. Before each session, a short survey was conducted to collect information on demographics, ICT use, and health information–seeking behaviors. Sessions lasted for 60-90 min and were audio-recorded. The principal investigator (CC) took field notes during each FGD. FGDs were conducted until thematic saturation was reached, as was determined when new information was no longer being obtained during discussions [45].

    Data Analysis

    All digitally recorded interviews were transcribed verbatim in Spanish by a local transcriber. The transcripts were later professionally translated into English. Any private information accidentally revealed during the focus groups by a participant was removed. Transcripts were reviewed line by line by one of the authors (CC) to assess accuracy, perform framework indexing using the framework method [46], and start formulation of the codebook. A total of 2 authors (CC and SS), who are bilingual in English and Spanish, discussed 2 initial transcripts to refine the development of the codebook. Subsequently, all transcripts were carefully read by CC to develop a list of meaningful units corresponding to the major constructs of the mixed behavioral theory model, which were independently reviewed and discussed with SS. CC and SS then independently coded all transcripts using the established codebook. Coding discrepancies were discussed with LF and EL to obtain consensus. The data were coded using NVivo qualitative analysis software using directed content analysis following the theoretical framework. During coding, any additional meaningful units identified by coders were also identified and continuously discussed between the authors. Codes were arranged by meaning into major themes. Notable quotes pertaining to each theme were organized, discussed, and summarized in a document that presents the findings for each theme.

    We chose a directed approach to content analysis through a combined deductive-inductive process to comprehensively review transcripts and identify salient themes [47]. Through deductive use of existing theory in a mixed model of the ETAM and the IMB model (Figure 1) [41,42], we were able to conceptually extend a theoretical framework to help determine the initial coding scheme and relationships between codes, while at the same time, adding any emerging themes from probing or freely shared topics by participants in an inductive approach [47]. In addition, several triangulation categories were used to enhance the reliability, objectivity, and validity of the results collected in this qualitative descriptive study: (1) data triangulation was achieved by administering focus groups with several participants at various times in Consuelo and La Romana, (2) investigator triangulation was achieved by correlating the findings from multiple researchers in the study to reach consensus, and (3) theory triangulation was achieved by using and correlating multiple theoretical strategies in the form of the mixed behavioral theory frameworks of the ETAM and the IMB model [45,47-49].

    Figure 1. Combined conceptual model: extended technology acceptance model (ETAM) and information-motivation-behavioral skills model (IMB).
    View this figure

    Applying relevant behavioral theories to an mHealth intervention is important because it can lead to well-developed strategies for health behavior change and health promotion [50,51]. They can also increase the effectiveness of digital tools and promote a receptive environment for their use [51]. For these reasons, we chose to ground our intervention with behavioral theories that addressed both our targeted behavior of EBF for up to 6 months and acceptance of digital technology. The IMB model was initially developed to promote HIV prevention interventions in inner-city minority settings [52]. The model supports the hypothesis that to initiate and maintain a desired behavior, adherence-related information and motivation must be provided, along with appropriate tools to maintain the behavior [42,52]. In previous research, the application of the IMB model has shown great promise in developing effective EBF promotion interventions in global settings [53,54]. A common model used to understand clinical staff and patients’ mHealth adoption is the technology acceptance model (TAM) [55]. Although the TAM has been a rigorously tested model in predicting user acceptance of an innovation, some have raised the need for the model to be extended and incorporated with further constructs to enhance its explanation and prediction of acceptance behavior [55,56]. Therefore, our study used an extended TAM that incorporates the TAM with the theory of planned behavior [41]. In addition to the original constructs of perceived usefulness and perceived ease of use, a trust-related construct (perceived credibility) and 2 resource-related constructs (perceived self-efficacy and perceived cost) are incorporated [41] to better predict caregiver and health promoter intention to use mobile phones for health information seeking.


    Results

    Overview

    We conducted 6 FGDs consisting of (1) 7 health promoters from NPS, (2) 5 health promoters from CFLR, (3) 2 caregivers from MAMI, (4) 7 caregivers from CFLR, (5) 8 caregivers from MAMI, and (6) 6 caregivers from NPS. Demographics of the 35 participants are summarized in Table 1.

    Table 1. Characteristics of focus group discussion participants.
    View this table

    Demographic Characteristics

    All participants were female. Each of the 3 participating sites accounted for a similar number of participants, with approximately one-third of the total from each site. Thus, the majority were from La Romana (22/35, 63%). A total of 12 participants were health promoters in their respective community, and 23 participants were mothers of children aged ≤5 years currently receiving services at either NPS, CFLR, or MAMI. The major demographic differences between caregivers and health promoters were age, education level, and employment. Notably, caregivers were younger (15/23, 65% were aged <26 years), had less formal education, and had a higher percentage of unemployment (19/23, 83% vs 7/12, 58%) compared with health promoters.

    Participants’ Use of ICT and Sources of Health Information

    On the basis of a brief survey conducted before each FGD, all participants (N=35) reported having a cellular phone, of whom 29 (83%) reported having a smartphone. Participants obtained health information from the internet, physicians, health clinics, family and friends, health promoters, and TV.

    Perceptions and Attitudes Toward mHealth

    Most caregivers initially commented that they use ICT regularly to access health information. In the course of our FGDs, several factors influencing caregivers’ use of mobile phones regarding their child’s health emerged (Table 2). Prominent themes included ways caregivers use ICT, access limitations, perceived credibility of sources, perceived usefulness, cost, and privacy.

    Caregivers utilized ICT in several ways. For example, some used ICT to access the internet to further research a diagnosis or medical terminology used by their doctor when they did not have enough time during their visit to ask. Some used mHealth to verify, confirm, or compare information received from different sources, including their family members and doctors. Others read or found health information using ICT and confirmed this information with a health professional to verify its validity or falsehood. Cumulatively, this health information–seeking behavior added further evidence to a major determining factor for caregivers’ use of a potential mHealth intervention: perceived credibility of source. Caregivers consistently expressed the importance of having information in the mHealth tool that was validated by credible sources, such as doctors, nurses, and other trained health professionals.

    Table 2. Perceptions and attitudes toward mobile health from focus group discussions.
    View this table

    Perceived usefulness was another influencing factor for mHealth use, which was described among participants. Some caregivers described the usefulness of an mHealth tool both in terms of what they had encountered and what they wish were available. Desirable characteristics and capabilities include quick and ready access to information, the ability to send reminders for important necessities such as vaccines and medications, and helpfulness with decision-making regarding their child’s health. Several health promoters also explicitly mentioned how an mHealth tool would be especially useful to them during their home visits and provide them with an educational resource to share with their clients and families. Other factors identified among caregivers include perceived ease of use and perceived self-efficacy.

    Some barriers to mHealth use among caregivers included perceived cost and perceived loss of privacy related to use. For example, many caregivers mentioned the difficulty of maintaining monthly internet service due to cost. If there were an additional cost of the mHealth tool, most mentioned they would not pay for it. However, some argued that if the mHealth tool seemed to add value to their lives, they would pay for it. When asked how they felt about sharing private information through the mHealth intervention, many expressed concerns about privacy and indicated that they would potentially input false personal information into a nonsecure ICT to maintain their privacy.

    Perceptions and Attitudes Toward Breastfeeding and Influencing Factors

    Participants observed and shared various factors that influenced their breastfeeding practices, which could be relevant to the development of an mHealth EBF promotion tool (Table 3). Most participants were aware of the benefits of breastfeeding for both their children and themselves, and some participants mentioned additional benefits such as economic savings and environmental benefits (eg, less waste production and reduced water consumption with no need for bottles and formula). Most participants were aware of the recommended time to initiate breastfeeding and the recommended duration of EBF. Change in knowledge was mentioned across the different focus groups as a major factor important to promoting breastfeeding. Participants proposed that this could be achieved through support or information from experienced family members or health care workers and through dispelling myths shared in the community.

    Despite their knowledge of the benefits of EBF and intentions to exclusively breastfeed, detailed probing revealed that supplementing with water or formula in the first 6 months of life is common. Mothers provided reasons that included urging from the infant’s grandmother to supplement, returning back to work, feelings that the baby was still hungry or that breastmilk production was inadequate, and previous experience with another child. Several mothers from the adolescent clinic (MAMI) also mentioned that their infant’s grandmothers offered their babies beans, coffee, and other foods besides breastmilk as the initial food when their child was born.

    Many mothers described their specific memories about breastfeeding, some reporting their difficulties and others sharing their positive experiences. Some shared challenges related to breastmilk production, physical pain, newborn refusal to latch, and preference to give formula. Other mothers, who shared positive experiences with breastfeeding, mentioned a feeling of having a stronger bond with their infant, health benefits to their infant (such as falling ill less frequently or seeing their rapid growth), and observing benefits for themselves (such as relief from breast engorgement or feeling thinner).

    Table 3. Perceptions and attitudes toward breastfeeding from focus group discussions.
    View this table

    Desired Features for a Potential mHealth Intervention to Address EBF

    In addition to sharing their perceptions and attitudes toward mHealth in general, participants provided their recommendations for important features to include in a potential mHealth intervention to promote EBF (Table 4).

    A frequently mentioned recommendation on how to introduce mHealth for EBF support and promotion was having the ICT cover other topics related to their child’s health in addition to breastfeeding, such as growth and development, vaccines, prenatal and postnatal health, and common ailments. Other factors perceived to be important included (1) using an app that would be easily accessible on a smartphone with remote access due to commonly inconsistent internet service; (2) having an interactive component, whether through video call or face-to-face consultation; and (3) using simple, educational, and motivational messaging with video and images. Others suggested using myth-busting messages. Health promoters and pregnant women were also identified as specific groups that could especially benefit from this mHealth tool. For example, health promoters suggested having a platform to be used as an educational tool for home visits. Participants also proposed targeting pregnant women who could have access to this information while preparing to give birth and raise a child.

    Table 4. Desired features of a potential mobile health intervention: major themes from focus group discussions.
    View this table

    Discussion

    Principal Findings

    Mobile phones are increasingly common in the Dominican Republic, where, according to the World Bank, there were 84 mobile cellular phone subscriptions per 100 people in 2018 [57]. In addition, smartphone use in this setting is increasing rapidly; a 2019 survey found that 61% of the Dominican population owned a smartphone compared with 51% in 2017 [58]. This rapid expansion of access to mobile technology creates an opportunity to develop health-related interventions to meet the needs of rural and urban communities across the Dominican Republic. This study provides novel insights into community and caregiver perspectives of a potential mHealth intervention to promote EBF for women with children receiving care at multiple clinical sites in the Dominican Republic. This study also highlights numerous aspects of the content and service delivery model that may affect users’ acceptance and impact of the intervention. By identifying caregiver and health promoter opinions on a potential mHealth tool using behavior theory models, the results can inform effective future mHealth intervention design.

    Effective mHealth research should aim to provide a richer understanding about the nature of the cultural factors [59] that shape the adoption and success of these new technologies. This study aimed to address the gap in mHealth research related to user acceptability and the development of theory-based interventions. There is a need for more mHealth interventions grounded in behavior change theory [28,59] that explore the psychological, cognitive, and behavioral dimensions of maternal and child health, which served as the foundation of our design.

    We do not have similar previous studies for comparisons, as this study is, to our knowledge, the first study of its kind in the Dominican Republic. However, other studies have assessed the feasibility and acceptability of mHealth apps aimed at improving breastfeeding in other countries [27-30]. For example, in Saudi Arabia, more mothers expressed their intention to practice EBF after receiving mHealth-based education about EBF and early breastfeeding initiation [27]. An Australian study reported high ratings for an evidence-based breastfeeding app designed to provide men with social support and information to enhance the help they can offer their breastfeeding partners [28]. A Thai study demonstrated the potential for an mHealth app to be a useful self-management tool for breastfeeding mothers [29]. In the United States, researchers at the University of Missouri found that stakeholder and user engagement indicated that mHealth has the potential to be a useful strategy for providing breastfeeding support to mothers [30]. These studies, combined with the findings of our study, indicate the potential positive impact an effectively designed stakeholder-informed mHealth tool can have in promoting EBF.

    Mobile phones provide an opportunity to improve health behaviors, as evidenced by caregivers in this study who mentioned that their intention to breastfeed may have been enhanced if they had better access to trusted information about EBF from an mHealth app. According to the 2011 World Health Organization report on mHealth, mobile phones provide a new communication channel for health promotion and community mobilization [60]. Multiple studies have shown promising results of using mobile phones and text messaging to improve nutrition [27-30,61,62]. Multiple systematic reviews have evaluated the impact of mHealth interventions on maternal and child health in LMICs [59,63-67]. These reviews have noted that although a handful of interventions have shown some promise in improving health outcomes compared with routine care, most studies lack high methodological quality, such as theory-based design, standardization of content, and validated outcome measurements [59,63-67]. This observation is important not only during the mHealth design phase but also in the future evaluation of the resulting mHealth intervention.

    Applying Findings to Future Intervention Design

    Our findings provide an additional context to the low EBF rate in this population that can inform future breastfeeding interventions. On the basis of participant responses with probing, mixed feeding (a combination of breastmilk and formula) appears to be common. The reasons given for this practice, such as returning back to work, feeling the baby is still hungry, and feeling like breastmilk production is inadequate, have also been mentioned in previous studies [68-70]. Thus, this work confirms that it will be important to address factors associated with mixed feeding in a future mHealth intervention aimed toward this community and others with similar practices.

    Our findings suggest that caregivers and health promoters in this setting prefer to utilize a low- to no-cost health app that is easily accessible on mobile phones, regardless of internet service. This supports previous research examining trends in mHealth in LMICs [71]. Participants also generally preferred to have access to a trustworthy trained individual or specialist to navigate and promote EBF. In this setting, it is culturally accepted, and many times sought after, to have face-to-face interactions with trained professionals to obtain health education and consultation. As suggested by participants, this desired component can be applied to an mHealth intervention by either adding a video call feature or discussion forum component to the intervention. Participants also suggested that during health visits, physicians, nurses, or health promoters can use the mHealth tool to explain standardized health information and provide access to the mHealth tool for caregivers to use beyond the encounter. Similar findings have been reflected in previous research in the development and assessment of mHealth interventions in other countries, including India and Germany [12,72,73].

    Perceived loss of privacy is an important barrier to mHealth use mentioned by participants, which has also been described in other studies [74,75]. As illustrated in the quotes in Table 2, there are conflicting attitudes toward providing private information in mobile apps. Although some participants mentioned that they would not use an app that required private information, some reported that they would input false personal data to access the app. Regardless of privacy concerns, popular apps such as Facebook were still used among our participants, which may indicate that functionality and convenience may take precedence over privacy concerns. Further research is needed to address concerns regarding privacy and security in future mHealth apps and to explore if it is necessary to be specifically customized for different purposes or users.

    Caregivers in our study expressed that although an mHealth tool to promote EBF would be useful, it would be desirable if the tool could provide additional information and self-management support for other maternal and child health topics, such as growth and development, vaccines, prenatal and postnatal health, and common childhood illnesses. This corresponds with previous literature in which caregivers described mobile apps to be better suited for more broad topics that would be accessed more frequently or to meet a repeated, unique need to be worth the significant space and data on their devices [76]. In addition, in considering the design of an impactful mHealth tool that is highly valued and frequently used by parents, a previous systematic review recommended combining educational elements with troubleshooting support [71]. Future intervention designers should take these considerations into account to provide optimum benefit for the intended target population.

    Strengths

    A strength of this study is inherent in its design and employment of several categories of triangulation (data, investigator, and theory) to enhance the reliability, objectivity, and validity of the results collected [45,47-49]. In particular, data triangulation allowed for the collection of different perspectives from female caregivers and health promoters of various ages living in both rural and urban settings in the Dominican Republic. There are several examples that illustrate triangulation in our data. As seen in Table 3, there is an overlap between a myth about breastfeeding and motivation for breastfeeding. A rural health promoter mentions that “one of the biggest inconveniences [of breastfeeding] is the myth that [mothers] will get very skinny,” whereas later, an urban caregiver describes how getting skinny was a motivation for her to breastfeed. The second example of triangulation appears when a rural health promoter mentions that she would like support aimed toward pregnant teenagers because they have “no information about breastfeeding” (Table 3). However, an urban teenage mother mentions a specific website called Lactating Mothers, which she uses to seek health information regarding her child and breastfeeding (Table 2). These findings form a strong evidence base and source of various perspectives from which mHealth interventions that seek to improve EBF in the Dominican Republic and other similar settings can be designed.

    Given the extensive description of the methodology and design of our study, researchers interested in conducting similar work can better understand how our findings might apply or relate to their target population [77]. This study integrates the perspectives of stakeholders (caregivers and health promoters) throughout the design process. Formative research with stakeholder involvement is foundational to delivering effective maternal and child health educational interventions and facilitating a more sustainable and broader dissemination [76]. Furthermore, within the global health community, we must look across specific content areas toward the broader themes emerging within the literature on technology-based interventions. Consistent with previous studies, this serves as a call to action to pair formative research with strong evidence-based design, combining messaging type and content with optimum technology platforms to effectively improve health outcomes [17,18,28,59,63-67,78].

    Limitations

    Despite these strengths, there are some limitations that should be considered. There is an inherent selection bias owing to our recruitment strategy, which involved approaching potential participants in the clinical site waiting areas. One might argue that women living in local communities, who are not actively seeking primary care services, may have the greatest need for breastfeeding education and guidance. This selection bias might have been avoided if we had sought help from the health promoters to identify women in the community who do not use primary care services. However, as free services are highly accepted, women not accessing these services are less representative of the population as a whole. Another limitation is that the FGD guide was not modified to elicit the unique perspectives of mothers in the older age groups or to address any contradictions seen in the data. There was a missed opportunity to further identify barriers to EBF, such as exploring reasons for mixed feeding practices among older mothers, or provide a direct context to the contradictions observed. Third, it must be mentioned that the principal investigator was also a staff pediatrician at 2 of the clinical sites (NPS and CFLR). Although she did not facilitate the FGD, she was present for notetaking and observing the groups in each session. Owing to this, participants may have modified some aspects of their responses toward breastfeeding with the awareness of being observed (Hawthorne effect) [79]. However, the fact that participants freely admitted to behaviors such as mixed feeding, which they likely knew to be contrary to the pediatricians’ recommendations, suggested that they felt free to express their true behaviors and feelings in the presence of a pediatrician.

    Our study findings may not be generalizable to communities in the Dominican Republic where levels of employment are higher. On the basis of data from the World Bank, in 2019, the labor force participation rates (eg, percentage of people aged over 15 years who are employed or actively looking for work) were 51% female and 77% male [80], compared with 26% of our all-female study cohort. A unique distinction about the clinical sites in this study is that medical services are significantly subsidized for patients. For example, patients who qualify for NPS services have no fees for visits, laboratories, or medications. To be a patient at NPS, children must be aged ≤5 years and live in 1 of the 8 barrios (neighborhoods) served, which are the poorest in Consuelo. In addition, at CFLR, people living with HIV receive government-funded highly active antiretroviral therapy (HAART) free of charge. Laboratories and medications are offered at a significantly lower price than at other facilities in La Romana. This provides context as to how recruited participants are able to receive care despite high unemployment rates.

    Conclusions

    There is a high level of acceptance for ICT tools, particularly mHealth apps, for the promotion of breastfeeding and child health among caregivers in this setting. mHealth tools can contribute to increased breastfeeding self-efficacy, and hence, identifying the desirable features of such tools will create impactful interventions in both rural and urban settings in the Dominican Republic. Future mHealth interventions should be designed using formative research with stakeholder involvement. Ideally, the mHealth tool should implement the following features:

    • minimize barriers to use, such as low cost and access without active internet service
    • promote frequency of use by adding perceived value to caregivers, such as providing both educational and self-management content
    • address the cultural needs and acceptability of users based on behavioral theory models.

    In general, caregivers want to receive trusted and reliable information that is easily accessible through various formats, and they are interested in information beyond breastfeeding.

    Acknowledgments

    The authors wish to acknowledge all participants in this study for their valuable time and insights. The authors also acknowledge the support from the Children’s Hospital of Philadelphia’s David N. Pincus Global Health Fellowship and the Pincus Family Foundation. The authors also acknowledge support from the leadership and staff of their clinical sites, especially Adriana Deverlis, Ramona Cordero, Mioced Ramírez, Dr Francisca Vázquez, Sister Natividad Rosa, Juana Mercedes, Vivian Araujo, and Rosa Huber, for their efforts and assistance during the study’s development and implementation. The authors also acknowledge the time, effort, and dedication of their trained local focus group facilitator, Johanna Lendor, and local transcriptionist, Antonio Matos. CC was affiliated with the Children's Hospital of Philadelphia at the time this research was conducted and is currently affiliated with the Children's Hospital of Orange County. SS was funded through the National Institute of Nursing Research of the National Institutes of Health under Award Number K99NR017829. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

    Conflicts of Interest

    None declared.

    References

    1. Information and Communication Technologies: Results Profile. World Bank. 2013.   URL: https://projects.worldbank.org/en/results/2013/04/13/ict-results-profile [accessed 2019-05-14]
    2. United Nations ICT Task Force. Tools for Development: Using Information and Communications Technology to Achieve the Millennium Development Goals. United Nations ICT Task Force. 2003.   URL: http:/​/webcache.​googleusercontent.com/​search?q=cache:Ad9OS-PX7z8J:www.itu.int/​net/​wsis/​stocktaking/​docs/​activities/​1103056110/​ICTMDGFinal.​pdf+&cd=1&hl=en&ct=clnk&gl=us [accessed 2019-05-14]
    3. 51st Directing Council of PAHO, 63rd Session of the Regional Committee of WHO for the Americas: Strategy and Plan of Action on eHealth (2012-2017). PAN American Health Organization. 2011.   URL: http://www.paho.org/hq/index.php?option=com_docman&task=doc_download&gid=14572&Itemid=&lang=en [accessed 2019-05-14]
    4. Mechael P. The case for mhealth in developing countries. Innov Technol Gov Glob 2009 Jan;4(1):103-118 [FREE Full text] [CrossRef]
    5. Irawan Y, Koesoema A. The Role of ICT, Healthcare Investment and Ehealth Policy in Achieving Millennium Development Goals: A Cross-Country Comparison. In: 9th International Symposium on Medical Information and Communication Technology. 2015 Presented at: ISMICT'15; March 24-26, 2015; Kamakura, Japan   URL: https://doi.org/10.1109/ismict.2015.7107509 [CrossRef]
    6. Children: Reducing Mortality. World Health Organization. 2019.   URL: https://www.who.int/news-room/fact-sheets/detail/children-reducing-mortality [accessed 2020-03-30]
    7. León-Cava N. Quantifying the Benefits of Breastfeeding: A Summary of the Evidence. Washington, DC: PAN American Health Organization; 2002.
    8. Weisstaub G, Aguilar AM, Uauy R. Treatment and prevention of malnutrition in Latin America: focus on Chile and Bolivia. Food Nutr Bull 2014 Jun;35(2 Suppl):S39-S46. [CrossRef] [Medline]
    9. Exclusive Breastfeeding (Percentage of Children Under 6 Months) - Dominican Republic. The World Bank.   URL: https://data.worldbank.org/indicator/SH.STA.BFED.ZS?locations=DO [accessed 2019-05-13]
    10. Most Recent Child Mortality Estimates, 2018. United Nations Inter-Agency Group for Child Mortality Estimation. 2019.   URL: https://childmortality.org/data/Dominican%20Republic [accessed 2020-03-30]
    11. Pérez-Escamilla R, Curry L, Minhas D, Taylor L, Bradley E. Scaling up of breastfeeding promotion programs in low- and middle-income countries: the 'breastfeeding gear' model. Adv Nutr 2012 Nov 1;3(6):790-800 [FREE Full text] [CrossRef] [Medline]
    12. Schindler-Ruwisch JM, Roess A, Robert RC, Napolitano MA, Chiang S. Social support for breastfeeding in the era of mhealth: a content analysis. J Hum Lact 2018 Aug;34(3):543-555. [CrossRef] [Medline]
    13. Chhanabhai PN, Holt A. The disparity information and communication technology for developing countries has in the delivery of healthcare information. Open Med Inform J 2010 Sep 15;4:195-201 [FREE Full text] [CrossRef] [Medline]
    14. Lyles C, Schillinger D, Sarkar U. Connecting the dots: health information technology expansion and health disparities. PLoS Med 2015 Jul;12(7):e1001852 [FREE Full text] [CrossRef] [Medline]
    15. Chib A, van Velthoven MH, Car J. mHealth adoption in low-resource environments: a review of the use of mobile healthcare in developing countries. J Health Commun 2015;20(1):4-34. [CrossRef] [Medline]
    16. Nigenda G, Torres M, Jáuregui A, Silverman-Retana JO, Casas A, Servan-Mori E. Health information technologies for sexual and reproductive health: mapping the evidence in Latin America and the Caribbean. J Public Health Policy 2016 Nov;37(Suppl 2):213-231. [CrossRef] [Medline]
    17. Park LG, Beatty A, Stafford Z, Whooley MA. Mobile phone interventions for the secondary prevention of cardiovascular disease. Prog Cardiovasc Dis 2016;58(6):639-650 [FREE Full text] [CrossRef] [Medline]
    18. Shah R, Watson J, Free C. A systematic review and meta-analysis in the effectiveness of mobile phone interventions used to improve adherence to antiretroviral therapy in HIV infection. BMC Public Health 2019 Jul 9;19(1):915 [FREE Full text] [CrossRef] [Medline]
    19. Global Observatory for eHealth. World Health Organization.   URL: https://www.who.int/goe/en/%20 [accessed 2019-05-14]
    20. Final Results Framework of the UNICEF Strategic Plan, 2018-2021. United Nations. 2017.   URL: https://undocs.org/E/ICEF/2017/14 [accessed 2019-05-14]
    21. Lewis T, Synowiec C, Lagomarsino G, Schweitzer J. E-health in low- and middle-income countries: findings from the center for health market innovations. Bull World Health Organ 2012 May 1;90(5):332-340 [FREE Full text] [CrossRef] [Medline]
    22. Gerber T, Olazabal V, Brown K, Pablos-Mendez A. An agenda for action on global e-health. Health Aff (Millwood) 2010 Feb;29(2):233-236. [CrossRef] [Medline]
    23. Crean KW. Accelerating innovation in information and communication technology for health. Health Aff (Millwood) 2010 Feb;29(2):278-283. [CrossRef] [Medline]
    24. Piette JD, Lun KC, Moura LA, Fraser HS, Mechael PN, Powell J, et al. Impacts of e-health on the outcomes of care in low- and middle-income countries: where do we go from here? Bull World Health Organ 2012 May 1;90(5):365-372 [FREE Full text] [CrossRef] [Medline]
    25. Novillo-Ortiz D, Hernández-Pérez T. Social media in public health: an analysis of national health authorities and leading causes of death in Spanish-speaking Latin American and Caribbean countries. BMC Med Inform Decis Mak 2017 Feb 3;17(1):16 [FREE Full text] [CrossRef] [Medline]
    26. Cormick G, Ciganda A, Cafferata ML, Ripple MJ, Sosa-Estani S, Buekens P, et al. Text message interventions for follow up of infants born to mothers positive for Chagas disease in Tucumán, Argentina: a feasibility study. BMC Res Notes 2015 Sep 29;8:508 [FREE Full text] [CrossRef] [Medline]
    27. Alnasser Y, Almasoud N, Aljohni D, Almisned R, Alsuwaine B, Alohali R, et al. Impact of attitude and knowledge on intention to breastfeed: can mHealth based education influence decision to breastfeed exclusively? Ann Med Surg (Lond) 2018 Nov;35:6-12 [FREE Full text] [CrossRef] [Medline]
    28. White BK, Martin A, White JA, Burns SK, Maycock BR, Giglia RC, et al. Theory-based design and development of a socially connected, gamified mobile app for men about breastfeeding (milk man). JMIR Mhealth Uhealth 2016 Jun 27;4(2):e81 [FREE Full text] [CrossRef] [Medline]
    29. Wang C, Chaovalit P, Pongnumkul S. A breastfeed-promoting mobile app intervention: usability and usefulness study. JMIR Mhealth Uhealth 2018 Jan 26;6(1):e27 [FREE Full text] [CrossRef] [Medline]
    30. Jefferson UT, Zachary I, Majee W. Employing a user-centered design to engage mothers in the development of a mhealth breastfeeding application. Comput Inform Nurs 2019 Oct;37(10):522-531. [CrossRef] [Medline]
    31. Tette EM, Sifah EK, Nartey ET. Factors affecting malnutrition in children and the uptake of interventions to prevent the condition. BMC Pediatr 2015 Nov 19;15:189 [FREE Full text] [CrossRef] [Medline]
    32. National Census of Population and Living Place 2010. National Office of Statistics: The Portal of Dominican Statistics.   URL: https://www.one.gob.do/censos/poblacion-y-vivienda [accessed 2020-06-30]
    33. Román-Poueriet J, Fernandez AD, Beck-Sagué CM, Szabó RG, Mercedes F, Duke W, et al. HIV infection and prevention of mother-to-child transmission in childbearing women: La Romana, Dominican Republic, 2002-2006. Rev Panam Salud Publica 2009 Oct;26(4):315-323. [CrossRef] [Medline]
    34. Onwuegbuzie A, Dickinson W, Leech N, Zoran A. A qualitative framework for collecting and analyzing data in focus group research. Int J Qual Methods 2009 Sep;8(3):1-21 [FREE Full text] [CrossRef]
    35. Vasileiou K, Barnett J, Thorpe S, Young T. Characterising and justifying sample size sufficiency in interview-based studies: systematic analysis of qualitative health research over a 15-year period. BMC Med Res Methodol 2018 Nov 21;18(1):148 [FREE Full text] [CrossRef] [Medline]
    36. Hennink MM, Kaiser BN, Weber MB. What influences saturation? Estimating sample sizes in focus group research. Qual Health Res 2019 Aug;29(10):1483-1496 [FREE Full text] [CrossRef] [Medline]
    37. Morgan D. Planning Focus Groups. Thousand Oaks, CA: Sage Publications; 1998.
    38. Krueger R, Casey M. Focus groups. In: A Practical Guide for Applied Research. Fifth Edition. Newbury Park, CA: Sage Publications; 2000.
    39. Morgan DL. Focus Groups as Qualitative Research. Second Edition. Newbury Park, CA: Sage Publications; 1997.
    40. Silverman D. Qualitative research. In: Theory, Method and Practice. Second Edition. Newbury Park, CA: Sage Publications; 2004.
    41. Sun Q, Wang C, Cao H. An Extended TAM for Analyzing Adoption Behavior of Mobile Commerce. In: Eighth International Conference on Mobile Business. 2009 Presented at: ICMB'09; June 27-28, 2009; Dalian, China   URL: https://doi.org/10.1109/icmb.2009.16 [CrossRef]
    42. Fisher W, Fisher J, Harman J. The information‐motivation‐behavioral skills model: a general social psychological approach to understanding and promoting health behavior. In: Social Psychological Foundations of Health and Illness. Hoboken, NJ: Blackwell Publishing Ltd; Jan 01, 2003.
    43. Hmone MP, Dibley MJ, Li M, Alam A. A formative study to inform mHealth based randomized controlled trial intervention to promote exclusive breastfeeding practices in Myanmar: incorporating qualitative study findings. BMC Med Inform Decis Mak 2016 Jun 4;16:60 [FREE Full text] [CrossRef] [Medline]
    44. Aliabadi N, Carballo-Dieguez A, Bakken S, Rojas M, Brown W, Carry M, et al. Using the information-motivation-behavioral skills model to guide the development of an HIV prevention smartphone application for high-risk MSM. AIDS Educ Prev 2015 Dec;27(6):522-537 [FREE Full text] [CrossRef] [Medline]
    45. Fusch P, Ness L. Are we there yet? Data saturation in qualitative research. Qual Rep 2015;20:1408-1416 [FREE Full text]
    46. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol 2013 Sep 18;13:117 [FREE Full text] [CrossRef] [Medline]
    47. Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
    48. White M, Marsh E. Content analysis: a flexible methodology. Library Trends 2006;55(1):22-45 [FREE Full text] [CrossRef]
    49. Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res 1999 Dec;34(5 Pt 2):1189-1208 [FREE Full text] [Medline]
    50. Cho Y, Lee S, Islam SM, Kim S. Theories applied to m-health interventions for behavior change in low- and middle-income countries: a systematic review. Telemed J E Health 2018 Oct;24(10):727-741 [FREE Full text] [CrossRef] [Medline]
    51. Klonoff DC. Behavioral theory: the missing ingredient for digital health tools to change behavior and increase adherence. J Diabetes Sci Technol 2019 Mar;13(2):276-281 [FREE Full text] [CrossRef] [Medline]
    52. Fisher JD, Fisher WA. Changing AIDS-risk behavior. Psychol Bull 1992 May;111(3):455-474. [CrossRef] [Medline]
    53. Tuthill EL, Butler LM, Pellowski JA, McGrath JM, Cusson RM, Gable RK, et al. Exclusive breast-feeding promotion among HIV-infected women in South Africa: an information-motivation-behavioural skills model-based pilot intervention. Public Health Nutr 2017 Jun;20(8):1481-1490 [FREE Full text] [CrossRef] [Medline]
    54. Chu JY, Jiang B, Gao YP, Li L, Yang MJ, Ma FF, et al. [Evaluation on the effect of exclusive breastfeeding among women with primipara, using the Information-motivation-behavioral skills model intervention model]. Zhonghua Liu Xing Bing Xue Za Zhi 2019 Dec 10;40(12):1639-1644. [CrossRef] [Medline]
    55. Rahimi B, Nadri H, Afshar HL, Timpka T. A systematic review of the technology acceptance model in health informatics. Appl Clin Inform 2018 Jul;9(3):604-634 [FREE Full text] [CrossRef] [Medline]
    56. Lim S, Xue L, Yen CC, Chang L, Chan HC, Tai BC, et al. A study on Singaporean women's acceptance of using mobile phones to seek health information. Int J Med Inform 2011 Dec;80(12):e189-e202. [CrossRef] [Medline]
    57. Mobile Cellular Subscriptions. The World Bank.   URL: https://data.worldbank.org/indicator/IT.CEL.SETS.P2?locations=DO-US [accessed 2019-05-14]
    58. Digital in The Dominican Republic. DataReportal: Global Digital Insights.   URL: https://datareportal.com/digital-in-the-dominican-republic [accessed 2019-05-14]
    59. Higgs ES, Goldberg AB, Labrique AB, Cook SH, Schmid C, Cole CF, et al. Understanding the role of mHealth and other media interventions for behavior change to enhance child survival and development in low- and middle-income countries: an evidence review. J Health Commun 2014;19(Suppl 1):164-189 [FREE Full text] [CrossRef] [Medline]
    60. World Health Organization. MHealth: New Horizons for Health through Mobile Technologies. Second Global Survey on eHealth. Geneva, Switzerland: World Health Organization; 2011.
    61. Evans WD, Wallace JL, Snider J. Pilot evaluation of the text4baby mobile health program. BMC Public Health 2012 Nov 26;12:1031 [FREE Full text] [CrossRef] [Medline]
    62. Jiang H, Li M, Wen LM, Hu Q, Yang D, He G, et al. Effect of short message service on infant feeding practice: findings from a community-based study in Shanghai, China. JAMA Pediatr 2014 May;168(5):471-478. [CrossRef] [Medline]
    63. Lee SH, Nurmatov UB, Nwaru BI, Mukherjee M, Grant L, Pagliari C. Effectiveness of mHealth interventions for maternal, newborn and child health in low- and middle-income countries: systematic review and meta-analysis. J Glob Health 2016 Jun;6(1):010401 [FREE Full text] [CrossRef] [Medline]
    64. Sondaal SF, Browne JL, Amoakoh-Coleman M, Borgstein A, Miltenburg AS, Verwijs M, et al. Assessing the effect of mhealth interventions in improving maternal and neonatal care in low- and middle-income countries: a systematic review. PLoS One 2016;11(5):e0154664 [FREE Full text] [CrossRef] [Medline]
    65. Chen H, Chai Y, Dong L, Niu W, Zhang P. Effectiveness and appropriateness of mhealth interventions for maternal and child health: systematic review. JMIR Mhealth Uhealth 2018 Jan 9;6(1):e7 [FREE Full text] [CrossRef] [Medline]
    66. Dol J, Richardson B, Murphy GT, Aston M, McMillan D, Campbell-Yeo M. Impact of mobile health (mHealth) interventions during the perinatal period for mothers in low- and middle-income countries: a systematic review. JBI Database System Rev Implement Rep 2019 Aug;17(8):1634-1667. [CrossRef] [Medline]
    67. Coughlin SS. The need for research-tested smartphone applications for promoting breastfeeding. Mhealth 2016 May;2(5):- [FREE Full text] [CrossRef] [Medline]
    68. Waldrop J. Exploration of reasons for feeding choices in Hispanic mothers. MCN Am J Matern Child Nurs 2013;38(5):282-288. [CrossRef] [Medline]
    69. Sloand E, Budhathoki C, Junn J, Vo D, Lowe V, Pennington A. Breastfeeding among Latino families in an urban pediatric office setting. Nurs Res Pract 2016;2016:9278401 [FREE Full text] [CrossRef] [Medline]
    70. Cheney AM, Nieri T, Davis E, Prologo J, Valencia E, Anderson AT, et al. The sociocultural factors underlying Latina mothers' infant feeding practices. Glob Qual Nurs Res 2019;6:2333393618825253 [FREE Full text] [CrossRef] [Medline]
    71. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile health applications for the most prevalent conditions by the World Health Organization: review and analysis. J Med Internet Res 2013 Jun 14;15(6):e120 [FREE Full text] [CrossRef] [Medline]
    72. Modi D, Gopalan R, Shah S, Venkatraman S, Desai G, Desai S, et al. Development and formative evaluation of an innovative mHealth intervention for improving coverage of community-based maternal, newborn and child health services in rural areas of India. Glob Health Action 2015;8:26769 [FREE Full text] [CrossRef] [Medline]
    73. Wallwiener S, Müller M, Doster A, Laserer W, Reck C, Pauluschke-Fröhlich J, et al. Pregnancy eHealth and mHealth: user proportions and characteristics of pregnant women using web-based information sources-a cross-sectional study. Arch Gynecol Obstet 2016 Nov;294(5):937-944. [CrossRef] [Medline]
    74. Zhou L, Bao J, Watzlaf V, Parmanto B. Barriers to and facilitators of the use of mobile health apps from a security perspective: mixed-methods study. JMIR Mhealth Uhealth 2019 Apr 16;7(4):e11223 [FREE Full text] [CrossRef] [Medline]
    75. Kotz D, Gunter CA, Kumar S, Weiner JP. Privacy and security in mobile health: a research agenda. Computer (Long Beach Calif) 2016 Jun;49(6):22-30 [FREE Full text] [CrossRef] [Medline]
    76. Fleisher L, Erkoboni D, Halkyard K, Sykes E, Norris MS, Walker L, et al. Are mhealth interventions to improve child restraint system installation of value? A mixed methods study of parents. Int J Environ Res Public Health 2017 Sep 26;14(10):- [FREE Full text] [CrossRef] [Medline]
    77. Palinkas LA. Qualitative and mixed methods in mental health services and implementation research. J Clin Child Adolesc Psychol 2014;43(6):851-861 [FREE Full text] [CrossRef] [Medline]
    78. Arcia A, Stonbraker S, Warner ER. Continuing education module-information needs and information-seeking processes of low-income pregnant women in relation to digital maternity education resources. J Perinat Educ 2019 Jul 1;28(3):151-162 [FREE Full text] [CrossRef] [Medline]
    79. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: new concepts are needed to study research participation effects. J Clin Epidemiol 2014 Mar;67(3):267-277 [FREE Full text] [CrossRef] [Medline]
    80. Gender Data Portal: Country - Dominican Republic. World Bank.   URL: http://datatopics.worldbank.org/gender/country/dominican-republic [accessed 2020-06-30]


    Abbreviations

    CFLR: Clínica de Familia La Romana
    EBF: exclusive breastfeeding
    ETAM: extended technology acceptance model
    FGD: focus group discussion
    ICT: information and communications technology
    IMB: information-motivation-behavioral skills
    LMICs: low- and middle-income countries
    MAMI: Módulo de Adolescentes Materno Infantil
    mHealth: mobile health
    NPS: Niños Primeros en Salud
    TAM: technology acceptance model


    Edited by C Ahlers-Schmidt; submitted 15.05.20; peer-reviewed by B Aljedaani, R Theis, B Nievas Soriano; comments to author 22.06.20; revised version received 21.07.20; accepted 23.07.20; published 21.08.20

    ©Clarisse G Casilang, Samantha Stonbraker, Ingrid Japa, Mina Halpern, Luz Messina, Andrew P Steenhoff, Elizabeth D Lowenthal, Linda Fleisher. Originally published in JMIR Pediatrics and Parenting (http://pediatrics.jmir.org), 21.08.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on http://pediatrics.jmir.org, as well as this copyright and license information must be included.