Abstract
Background: Digital technologies with breastfeeding content have become an important source of information for new parents in Germany. However, little is known about the content and quality of digital breastfeeding information sources.
Objective: The objective of this paper was to evaluate the scope, content, and quality of free-of-charge smartphone mobile apps and websites with breastfeeding-related content in Germany.
Methods: A cross-sectional study of mobile apps and websites was conducted in July 2023. The App Store for iOS and Google Play Store for Android were searched for mobile apps. Bing.de and Google.de were searched for websites. The quality, suitability of information, readability, and coverage of digital information on mobile apps and websites were evaluated. We used the user version of the Mobile Applications Rating Scale, the Health-Related Web Site Evaluation Form, the Suitability Assessment of Materials, and the Flesch Index tool, as well as a self-developed checklist. We report our results according to the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) statement.
Results: Eight mobile apps and 13 websites were included. The quality of information sources was generally good for apps (median 83%, IQR 73%‐87%) and websites (median 86%, IQR 83%‐89%). The suitability of information was good for apps (median 84%, IQR 70%‐89%) and websites (median 89%, IQR 78%‐94%). The coverage of information was good for apps (median 68%, IQR 59%‐86%) and websites (median 82%, IQR 73%‐100%). However, digital information was difficult or challenging to read on most apps (median 59%, IQR 53%‐68%) and websites (median 58%, IQR 47%‐61%). Seven of 8 mobile apps and 9 of 13 websites were commercial, with embedded links to shopping sites without external certificates confirming the trustworthiness of the information.
Conclusions: Assertive action from nonprofit and governmental institutions should be provided to support parents with reliable, unbiased, open-access digital breastfeeding information in Germany.
doi:10.2196/78128
Keywords
Introduction
According to the Health Information National Trends Survey (HINTS), approximately 70% of Germans prefer to get their health information from health care professionals, followed by internet research (21%) and friends or family (5%) []. However, the credibility of health information provided via an internet search was categorized as middle to low [].
The most popular digital sources for obtaining perinatal and breastfeeding support are mobile apps, internet forums, and websites []. A 2017 survey of Belgian mothers found that more than 90% used the internet to seek information, with “breastfeeding” being the most frequently searched topic []. However, parents may be confronted with a large number of results when searching for terms such as “parenting,” which could lead to information overload [,]. With the rise in the use of smartphones came a rise in mobile health (mHealth) apps, defined as medical or public health practice supported by mobile devices []. The willingness of parents to use mHealth apps in Germany appears to be high, as long as apps are free of charge [].
Breastfeeding is associated with many short- and long-term health benefits for mothers and children. In Germany, 97% of infants are breastfed at birth, but this number drops to 73% by 2 months of life []. Digital tools may help to enhance breastfeeding success by providing information and motivation. Many mHealth-based interventions centering around pregnancy and breastfeeding have been developed in recent years and show potential to improve pregnancy care and increase breastfeeding rates and outcomes [-]. Alianmoghaddam et al [] showed that online information about child nutrition and mobile apps can be a good option for breastfeeding promotion. However, in 2025, a systematic review and meta-analysis on the impact of mobile apps for breastfeeding found only a nonsignificant increase in the odds of exclusive breastfeeding, stating that there is insufficient evidence to show sustained beneficial effects on breastfeeding [].
Information on the content and quality of digital breastfeeding information has been published in many countries, including the United States, Canada, China, Australia, Spain, and Italy [-]. Yet, little is known about the quality of digital breastfeeding information sources in Germany. The objective of this paper was to evaluate the scope, content, and quality of free-of-charge mobile apps and websites with breastfeeding information available in Germany.
Methods
Study Design
A cross-sectional study of German websites and mobile apps with breastfeeding content was conducted in July 2023. The App Store for iOS and Google Play Store for Android were searched for mobile apps. Bing.de and Google.de were searched for websites. We followed the STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) reporting guideline, omitting items 13 and 15, which were not relevant for this study, as no study participants were recruited and no outcomes were measured [].
Selection of Mobile Apps
The German App Store for iOS and Google Play Store for Android were screened with smartphones from July 19 to 20, 2023, by 2 reviewers (MZ, JP) using 9 search terms (see Table S1 in ).
Inclusion criteria for mobile apps were that mobile apps were offered free of charge, were in the German language, and contained information on breastfeeding. Exclusion criteria were restricted access, formatting as an electronic book (eg, e-books, news, magazines, podcasts, blogs, or word documents), games or gaming apps, and mobile apps whose main function was to monitor time or frequency of infant care tasks without providing educational information on breastfeeding.
Two reviewers (MZ, JP) independently screened all mobile apps for eligibility. For each search term, the first 10 mobile apps were selected, and features such as rating, costs, number of downloads, and characteristics of the mobile app were noted. A list of mobile apps was selected, duplicates were removed, lists for Android and iOS were jointly merged, and duplicates were removed again.
Evaluation of Quality, Suitability, and Readability of Mobile Apps
Three validated tools were used to evaluate mobile apps for quality, suitability, and readability. Each mobile app was reviewed independently by 2 reviewers (MZ, JP) and then evaluated using an evaluation form (see ).
To appraise the quality of mobile apps, the user version of the Mobile Application Rating Scale (uMARS) questionnaire in the original English language was used []. The uMARS is an established tool to assess the quality of mHealth apps rated by end users. It consists of 16 items, including 4 objective quality subscales (engagement, functionality, esthetics, and information), 1 subjective quality subscale, and a further subscale to measure the users’ perceived impact of the evaluated mobile app []. All items were rated on a 5-point Likert scale (1=inadequate to 5=excellent) []. See for further information on the specific questions asked.
Suitability of information was assessed with the Suitability Assessment of Materials (SAM) questionnaire, which was validated by students and health care providers from several cultures [,]. It rates health-related materials in 6 areas (content, literacy demand, graphics, layout and type, learning stimulation and motivation, and cultural appropriateness). There are 22 questions on a 3-point scale (0=not suitable, 1=adequate, 2=superior). For missing items, the instructions of the SAM were followed. For questions answered as not applicable, 2 points of the possible 44 points were subtracted. Suitability was rated based on scoring (0%‐39% suitable material, 40%‐69% adequate material, and ≥70% superior material). The suitability for a particular population was ranked from 0 (not recommended) to 10 (recommended without reservations) based on socioeconomic and cultural backgrounds of the population [].
Readability was rated with the Flesch Index online tool, which provides a score from 0 to 100 (0‐30: hard to read, 30‐50: difficult to read, 50‐60: challenging, 60‐70 normal, 70‐80: easy to read, 80‐90: easily to read, 90‐100 very easy to read) []. As the Flesch Reading Ease test was developed for the English language, it needed to be adapted for the German language []. For the evaluation, 3 randomly chosen paragraphs were copied into the online tool and the average of the Flesch Reading Ease test results was used for evaluation.
Search Terms for Websites
Websites were identified using Google.de and Bing.de between July 13 and 17, 2023 [,]. Google Trends and Ubersuggest were used to identify appropriate search terms [,]. Google Trends is a tool to get information about how often users of Google enter explicit search terms. Ubersuggest is a tool to analyze keywords, find ideas for new keywords, and give insights into the ranking of the keywords.
A layperson was asked to suggest how to search for breastfeeding information and problems. These terms were used to find the most popular search terms for this topic on Ubersuggest and Google Trends for Germany. Twelve German search terms were used (see Table S2 in ). Before screening each search term individually, the search history and cookies were deleted to simulate the first search of a layperson. For each search term, the first 10 links were selected, as consumers rarely read beyond the first page of search results [].
Selection of Websites
Two reviewers (MZ, JP) independently screened all websites for eligibility. Search terms used were identified and recorded for each website. Websites with only 2 or fewer of the selected search terms were excluded. The 2 lists from Google and Bing were compiled, and duplicates were removed. Inclusion criteria comprised use of the German language and breastfeeding content. Websites inaccessible because of dead or broken links, websites formatted as PDFs, commercial websites, social media platforms (eg, Facebook), and websites without breastfeeding content were excluded.
Evaluation of Quality, Suitability, and Readability of Mobile Websites
Three validated tools were used to evaluate websites for quality, suitability, and readability. Each website was reviewed independently by 2 reviewers (MZ, JP) and then evaluated using an evaluation form (see ).
To appraise the quality of information, the Health-Related Web Site Evaluation Form (HRWSEF) was used []. The HRWSEF is an evaluation instrument for health educators and clinicians to evaluate the appropriateness of health education websites for clients and patients. It is a 36-item tool including 9 topics (website information, content, accuracy, author, currency, audience, navigation, external links, and structure). Users judge (1=disagree, 2=agree, 0=N/A) whether the website is a good source of information for the patient or whether it should not be recommended. Instructions of the HRWSEF questionnaire were followed for missing information (questions which were not applicable were deleted from the total scoring). Therefore, the total number of points depended on the number of questions answered with “agree” or “disagree.” Quality was rated based on scoring (0%‐74.9% poor quality, 75%‐89.9% adequate quality, and ≥90% excellent quality) [].
As for mobile apps, suitability of information was assessed with the SAM questionnaire, and readability was assessed using the Flesch Index online tool [,]. The readability of the selected website was evaluated by copying 3 links of a paragraph of the sites hit by the search to the online tool, and the average of the Flesch Reading Ease test results was used for evaluation.
Coverage of Information
To assess the coverage of information, 11 basic breastfeeding topics were used, based on the guidelines of the German Healthy Start–Young Family Network []. The websites and mobile apps were screened independently by 2 reviewers with technical nutrition and lactation expertise for coverage of the 11 topics (MZ, JP). If the 2 reviewers had a different outcome, the websites and mobile apps were screened again to achieve consensus. The 11 items are listed in the 2 standardized self-developed checklists (see for the apps and for the websites). All items on the checklists were dichotomously answered (yes/no). Then 11 items were summed and converted into percentages for descriptive statistics.
Statistics
Interrater reliability (IRR) testing was undertaken between the 2 reviewers assessing mobile apps and websites by comparing scores from each rating tool. The IRR agreement was assessed using the Kendall coefficient of concordance (Kendall rank correlation coefficient) for ordinal variables [].
The scores for mobile apps and webpages were summarized using boxplots for each index, where the scores for each index were transformed into percentages to plot all indexes in one plot. Medians and IQR (25th and 75th percentiles) were calculated. Kendall τ correlation was used to examine correlations between Google Play Store ratings, App Store ratings, and the different uMARS scores, Flesch Index, and SAM questionnaire. Values from the 2 app stores were summarized by calculating means. A 2-sided P value <.05 was considered statistically significant. All analyses were performed using R Studio version 4.3.2 (R Foundation for Statistical Computing, Vienna, Austria) [].
Results
Eight mobile apps and 13 websites with breastfeeding-related content were identified.
German Mobile Apps With Breastfeeding Content
The selection process describing the numbers of mobile apps identified at each stage of the selection process is displayed in . A description of all included mobile apps is given in .
| Name of the app | Published by | Authors | Category | Average user rating on App Store/Google Play Store (range 0‐5) | Downloads in Google Play Store | Comment |
| Preglife, Schwangerschaft app | Preglife - Swedish health care company | Midwives, lactation specialists | Medicine | 4.9/4.5 | >1 million | Breastfeeding information, tracker, mum workouts, meditation, diary, reduction codes for companies |
| Medela Family - Stillen Tracker | Medela AG - Company distributing products for breastfeeding | Mostly not characterized, midwives and self-called Medela breastfeeding experts | Medicine | 4.1/4.5 | >500,000 | Breastfeeding information, tracker, shop, chatbot, connection to personal pump |
| Baby+/Dein Baby-Tracker | Philips in collaboration with Health & Parenting | Not specified | Medicine | 4.6/4.6 | >5 million | Breastfeeding information, tracker, lullabies, diary, and documentation of sentimental milestones |
| Baby & Essen | Federal Agency of Agriculture and Nutrition | Agronomist, ecotrophologist | Foods + drinks | 4.4/3.9 | >100,000 | Breastfeeding information, mode for fathers, and diary |
| Keleya: Still- & Beckenboden app | Keleya Digital Health Solutions GmbH | Midwives, breastfeeding counselors, breastfeeding expert | Medicine | 4.8/3.5 | >5000 | Breastfeeding information, meditation, gymnastics, and breastfeeding preparation online courses |
| Hipp Baby app | HIPP GmbH - food producer | Breastfeeding counselors, midwives, medical educator | Lifestyle | 4.4/2.2 | >500,000 | Breastfeeding information and map to find places for breastfeeding, and changing diapers among others |
| BabyCare-Gesund & Schwanger | Pregive GmbH - independent research institute | Physicians, midwives | Medicine | 4.5/4.7 | >10,000 | Breastfeeding information, recipes, quizzes, relaxation music, gymnastics, among others |
| ELTERN - Schwangerschaft & Baby | G+J Medien GmbH - media Publisher | Mostly not characterized, nonspecialized journalists | Medicine | 4.6/4.3 | >100,000 | Breastfeeding information, community, and documentation of sentimental milestones |
All included mobile apps were free of charge; however, for some mobile apps, upgrades were available that required a fee. The average user rating of mobile apps ranged from 3.3 to 4.7 (out of 5, with 1 being the lowest and 5 being the highest rating). The Google Play Store showed download numbers ranging from more than 5000 to more than 5 million, whereas no such information was available in the App Store for iOS. Six out of 8 mobile apps were found in the stores under the category “Medicine,” one under “Lifestyle,” and one under “Foods + Drinks.” One mobile app (Baby & Essen) was provided by a governmental agency; all others were commercial in nature.
Included mobile apps not only provided informational content but also other features (eg, 3 apps had a tracker for tracking diapers, breastfeeding meals, and sleeping).
For 3 of the included mobile apps, it was not clearly stated whether health professionals wrote the text. None of the identified mobile apps showed any certification to prove independent and correct health information or had a data protection certification.
The mobile app with governmental affiliation showed no advertisements, whereas all others were commercial in nature. Six commercial mobile apps showed advertisements for breastfeeding-related products (eg, pumps, creams, bottles and teats, pacifiers, formula, and supplements) or linked wording within the texts to websites for ordering products. One mobile app (Preglife) showed general family-related advertisements.
There were only 4 mobile apps offering content in a language other than German. The mobile app Baby+ is available in 18 other languages (eg, Turkish, Polish, Russian, and English), the mobile app Keleya: Still- & Beckenboden offers content in the English language as well, Medela in 11 other languages (eg, Russian and English), and Preglife in 9 other languages (eg, Polish and English).
Evaluation of Quality, Suitability, and Readability of Mobile Apps
The quality of the selected mobile apps using the uMARS index ranged from 3.4 to 4.6 (out of 5), with a median of 4.1 (out of 5) (83% [IQR 73%‐87%]). However, the mobile apps differed more in the perceived impact of the uMARS, ranging from 23% to 93%.
The suitability of information showed a median of 84% (IQR 70%‐89%), whereas all mobile apps reached at least half of the points in the suitability for population, and some reached the total of 10 points (Medela, Baby+). The median of the Flesch Index was 59% (IQR 53%‐68%), which is around half of possible points to reach (Figure S3 in ).
The ratings of the subjective uMARS index and the store rating by the users were correlated (Kendall τ=0.67; P=.03). There was no statistically significant correlation between any of the other scores. Detailed evaluation results of all included mobile apps are given in .
| Name of the app | uMARS quality mean score (range 0‐5; %) | uMARS subjective quality (range 0‐20; %) | uMARS perceived impact (range 0‐30; %) | Suitability of information (SAM; range dependent 0‐44; %) | Suitability for population (SAM; range 0‐10; %) | Coverage of information (range 0‐11; %) | Flesch index (range 0%‐100%) |
| Preglife, Schwangerschaft app | 4.6 (92) | 16 (80) | 25 (83) | 27/30 (90) | 8 (80) | 9 (82) | 57 |
| Medela Family - Stillen Tracker | 4.4 (88) | 13 (65) | 28 (93) | 30/34 (88) | 10 (100) | 11 (100) | 52 |
| Baby+/Dein Baby-Tracker | 4.3 (86) | 14 (70) | 18 (60) | 23/32 (72) | 10 (100) | 7 (64) | 69 |
| Baby & Essen | 4.2 (85) | 12 (60) | 24 (80) | 22/26 (85) | 7 (70) | 8 (73) | 67 |
| Keleya: Still- & Beckenboden app | 4 (80) | 13 (65) | 22 (73) | 34/38 (90) | 9 (90) | 7 (64) | 53 |
| Hipp Baby app | 3.7 (73) | 5 (25) | 12 (40) | 31/38 (82) | 6 (60) | 6 (55) | 61 |
| BabyCare-Gesund & Schwanger | 3.6 (73) | 13 (65) | 7 (23) | 12/20 (60) | 5 (50) | 4 (36) | 46 |
| ELTERN - Schwangerschaft & Baby | 3.4 (68) | 6 (30) | 14 (47) | 23/30 (68) | 6 (60) | 10 (91) | 71 |
auMARS: user version of the Mobile Application Rating Scale.
bSAM: suitability assessment of materials.
German Websites With Breastfeeding Content
The selection process describing the numbers of websites identified at each stage of the selection process is displayed in . A description of all included websites is given in .
| Name and information of the website | Link | Certification | Authors |
| Familie, the website of a media brand financed with advertisement | [39] | No | Nonspecialized journalists |
| Kindergesundheit-Info, Federal Center for Health Education | [40] | No | Not characterized |
| Babelli, a company participating in partner and advertisement program of Amazon.de financed with advertisement | [41] | Certificate of the Health Foundation | Nonspecialized editors, content checked by midwives and a lactation consultant |
| Team Muttermilch, the website of an IBCLC and pediatrician to inform and sell services | [42] | No | Individual lactation consultant |
| Medela, a company distributing products for breastfeeding | [43] | No | Mostly not characterized, midwives and self-declared breastfeeding experts |
| Wikipedia, encyclopedia | [44] | No | Not characterized |
| Netdoktor, information about health and medicine topics financed with advertisements | [45] | Afgis certification | Physicians, biologists, specialized journalists |
| Still-Lexikon, information about breastfeeding financed with advertisement and donation | [46] | World Health Organization conformity | Individual bioscientist, journalist, lactation consultant |
| Eltern, the website of the eponymous journal | [47] | No | Mostly not characterized, nonspecialized journalists |
| Lansinoh, a company distributing products for breastfeeding | [48] | No | Not characterized |
| Apotheken Umschau, the website of the eponymous journal | [49] | Afgis certification; certificate of the Health Foundation | Not characterized |
| Hipp, a company distributing food products for babies and toddlers | [50] | No | Breastfeeding counselor |
| Windeln, a company selling baby products and a magazine | [51] | No | Mostly not characterized, midwives |
aIBCLC: international board certified lactation consultant.
Four websites referred to companies selling baby products (Medela, Lansinoh, Hipp, Windeln), 3 referred to parenting or health-related magazines (eg, Eltern, Apotheken Umschau, Windeln), and 1 referred to a media brand (Familie). Of the 4 informational websites, only 1 had a government affiliation (Kindergesundheit-Info). One website was an encyclopedia (Wikipedia), and 1 referred to a mobile app (Babelli).
Seven websites did not specify which professional group wrote the texts, and only 2 websites provided content written by breastfeeding experts. One of the included websites showed a quality logo (afgis), one the certification of the Stiftung Gesundheit, and one other showed both; thus, less than a quarter of the websites had a quality of information certification.
Eight websites showed advertisements for breastfeeding-related products (eg, pumps, creams, bottles and teats, pacifiers, formula and an infant flatulence product) with a direct link to order these products. Two websites showed no advertisements (Wikipedia, Kindergesundheit-Info), 2 websites showed general advertisements (Still-Lexikon, Apotheken-Umschau), and 1 showed advertisement for a breastfeeding book and consultation (Team Muttermilch).
Evaluation of Quality, Suitability, and Readability of Websites
The quality of the selected websites showed a median HRWSEF of 86% (IQR 83%‐89%). The suitability of information varied between 64% and 100%, with a median of 89% (IQR 78%‐94%). The suitability for the German population was rated between 5 and 10 out of a maximum of 10 points, with 5 websites being recommended to the German population without reservation (Familie, Team Muttermilch, Medela, Lansinoh, Apotheken Umschau). The median of the Flesch Index was 58% (IQR 47%‐61%), which is around half of the possible points to reach (Figure S4 in ). Detailed evaluation results of all included websites are given in .
| Name and information of the website | HRWSEF; range dependent 0‐72, (%) | Suitability of information (SAM); range dependent 0‐44, (%) | Suitability for population (SAM); range 0‐10, (%) | Coverage of information range 0‐11, (%) | Flesch index, range 0%‐100% |
| Familie, the website of a media brand financed with advertisements | 65/68 (96) | 36/38 (95) | 10 (100) | 11 (100) | 64 |
| Kindergesundheit-Info, Federal Center for Health Education | 60/64 (94) | 30/32 (94) | 6 (60) | 9 (82) | 60 |
| Babelli, a company participating in partner and advertisement program of Amazon.de, financed with advertisements | 64/70 (91) | 35/36 (97) | 6 (60) | 11 (100) | 61 |
| Team Muttermilch, the website of an IBCLC and pediatrician to inform and sell services | 59/66 (89) | 32/32 (100) | 10 (100) | 9 (82) | 61 |
| Medela, a company distributing products for breastfeeding | 58/66 (88) | 31/24 (91) | 10 (100) | 11 (100) | 56 |
| Wikipedia, encyclopedia | 61/70 (87) | 20/26 (77) | 5 (50) | 8 (73) | 42 |
| Netdoktor, information about health and medicine topics financed with advertisements | 53/62 (86) | 23/30 (77) | 5 (50) | 10 (91) | 46 |
| Still-Lexikon, information about breastfeeding financed with advertisement and donation | 58/68 (85) | 23/36 (64) | 6 (60) | 11 (100) | 46 |
| Eltern, the website of the eponymous journal | 57/68 (84) | 25/28 (89) | 9 (90) | 8 (73) | 67 |
| Lansinoh, a company distributing products for breastfeeding | 55/66 (83) | 28/30 (93) | 10 (100) | 10 (91) | 59 |
| Apotheken Umschau, the website of the eponymous journal | 49/60 (82) | 34/38 (90) | 10 (100) | 8 (73) | 57 |
| Hipp, a company distributing food products for babies and toddlers | 52/64 (81) | 27/32 (84) | 5 (50) | 8 (73) | 58 |
| Windeln, a company selling baby products and a magazine | 52/68 (77) | 28/36 (78) | 7 (70) | 8 (73) | 47 |
aHRWSEF: health-related web site evaluation form.
bSAM: suitability assessment of materials.
cIBCLC: international board certified lactation consultant.
Coverage of Information
The mobile apps reached at least half of the points in the coverage of information (except Baby Care Gesund & Schwanger), and only 1 mobile app reached the total points (Medela) (). The coverage of information for the analyzed websites ranged between 8 and 11 (out of 11 items), with almost one-third reaching the maximum total points ().
The results for coverage of information show that websites provided more information for many topics than mobile apps ().

Three companies (Medela, Eltern, Hipp) offered both a website and a mobile app. Some differences between mobile app and website content were identified. Website content was of higher quality, suitability of information, and coverage of information, and was easier to read compared with the app from the same company (Table S4 in ).
Statistics
IRR testing between the 2 reviewers assessing all selected mobile apps and websites showed a Kendall coefficient of concordance values of 0.92 for mobile apps and 0.90 for websites (P<.01) (Tables S5 and S6 in ).
Discussion
Principal Findings
This is the first cross-sectional study of mobile apps and websites with breastfeeding content in Germany. The 8 apps scored a median of 4.1 (out of 5) on the uMARS scale, indicating good quality. Three of 13 websites were rated as excellent (3/13, 23%), and 10 of 13 as adequate quality (10/13, 77%) as per the HRWSEF. Four of the 8 mobile apps (4/8, 50%) and 9 of 13 websites (9/13, 70%) were rated as difficult or challenging to read based on the Flesch Index. Websites provided more comprehensive information coverage based on the checklist, with a median of 9 of 11 (IQR 8‐11) topics covered. This was slightly more than mobile apps, which had a median 7.5 of 11 (IQR 6.5‐9.5) topics covered.
Only 1 mobile app and 1 website had a governmental affiliation, whereas all other websites and mobile apps were commercial in nature. Most mobile apps (6/8, 75%) and websites (8/13, 62%) displayed advertisements for breastfeeding-related products. Only a minority of mobile apps (4/8, 50%) and websites (2/13, 15%) offered content written exclusively by medical and allied health professionals. We found the number of available commercially developed mobile apps and websites written by nonprofessionals to be concerning, since they can potentially provide biased or inaccurate information to parents.
Quality of Mobile Apps and Websites
Overall, we found that German mobile apps with breastfeeding content were of average to good quality based on their mean uMARS quality scores. Findings from studies in other countries that reviewed infant-feeding and pregnancy mobile apps rated the majority as poor or moderate quality [,,,]. Only 1 review rated 16 parenting mobile apps as good or excellent [].
Compared with those studies, our reviewer ratings were typically higher for items included in the uMARS objective score than the subjective score. According to our findings based on the subjective uMARS scale, we would not recommend 2 of the 8 mobile apps (2/8, 25%). In addition, we would only recommend 5 mobile apps (5/8, 63%) with reservations. Only 1 mobile app had a high recommendation score (Preglife; Table S3 in ). Our findings align with Cheng et al [] and may reflect reviewer bias, as most apps (7/8, 88%) were commercial. Given that the reviewers were health professionals trained in recognizing the effects of advertisements on health behavior, their positionality may have influenced the scoring. Specifically, commercial apps may have received lower ratings because of the reviewers’ awareness of how marketing strategies can shape consumer choices and health outcomes. A review of Virani et al [] found that commercial parenting apps were more popular than governmental, likely because they are more visually appealing and entertaining. Apps that offer additional features, such as trackers, receive higher user ratings—an increase of 27% for each added feature []. However, monitoring and tracking breastfeeding seems to be the least effective way to improve breastfeeding outcomes [].
Three websites were rated as excellent, and 10 as adequate quality. The selected German websites were of much better quality than those reviewed in previous studies [,].
The majority of mobile apps and websites received high ratings for health information, while a smaller proportion was deemed adequate. Previous evaluations reported lower scores, indicating that the quality of these resources has presumably improved in recent years [,,].
Suitability for Population and Readability
Germany is ethnically diverse, with about a quarter of the population having a migration background []. In contrast to a review of Australian apps and websites, adequate suitability for population was considered for about half of the reviewed mobile apps and websites in our study [].
Three-quarters of the websites and half of the mobile apps in this study were considered challenging or difficult to read and understand. A high literacy level is required to understand the content of many mobile apps and websites [,,]. A previous survey in Germany found that 23% of the interviewed persons (n=2902) said the health information provided verbally or written was difficult to understand []. For example, print materials and health mobile apps for weight loss could be improved by using simpler language []. Apps that are only available in German could at least be improved by using a lower level of literacy if they aim to reach non-native German speakers. Turkish, Polish, Russian, and Syrian people are the largest immigration groups in Germany []. The mobile app Baby+ is available in 18 other languages, which is likely the reason it has the most downloads.
Mobile App and Website Authors
Three of 8 apps and 7 of 13 websites provided insufficient information about the qualifications of their authors. In Germany, titles such as “breastfeeding counselor” or “breastfeeding expert” are not certified professions, whereas “International Board Certified Lactation Consultant” (IBCLC) is protected []. Among the websites and apps included in this study, only 3 websites and no mobile app were authored by IBCLCs. From the perspective of parents, Hughson et al [] claimed that users prefer mobile apps that come from a trusted source, whereas Biviji et al [] found little concern among the users about evidence-based content. Helpful online breastfeeding support can increase the likelihood of breastfeeding [], but breastfeeding-related advice and information that is potentially produced by unqualified health professionals or lay persons or without clear authorship is concerning.
Coverage of Evidence-Based Content
Content that is not evidence based is harmful because it may spread myths, outdated or inaccurate advice, or contradict current public health recommendations, potentially increasing parental confusion and negatively affecting breastfeeding rates. Additionally, there is a lack of standards for the development of health apps []
Our results match previous findings stating that the coverage of information in mobile apps and websites is poor and partially contrary to Infant Feeding Guidelines [,,,,]. When screening the apps and websites, the uMARS referred to the quality of information asking “Is app content correct, well written, and relevant to the goal/topic of the app?” (see , app evaluation form), and the HRWSEF referred to accuracy asking “The information is accurate” (disagree, agree, or not applicable; see , website evaluation form). However, as the user instruction for these tools suggests browsing the website(s) for a few minutes and the app(s) for at least 10 minutes (see and ), it is not possible to view the complete content. The rating of these questions is therefore based on the content assessed. To highlight the importance of evidence-based information, based on the German guidelines of the German Healthy Start-Young Family Network by the Federal Center for Nutrition, the authors used the self-developed checklist for coverage of information.
Advertisements Within Mobile Apps and Websites
Of the 13 websites reviewed, 8 linked directly to shops for breastfeeding products or breast-milk substitutes or displayed related advertising. One site (Babelli), which claims to be certified by the Health Foundation, linked to welcome gifts from companies producing breast-milk substitutes. Three apps directly referred to companies promoting their own products (Baby+, Hipp, Medela), and 3 others displayed advertisements for breastfeeding-related products or linked parts of their text to online shops. In our view, information intended to support breastfeeding should not include advertising for breast-milk substitutes. Nevertheless, manufacturers use digital platforms to combine breastfeeding information with marketing [,]. The International Code of Marketing of Breastmilk Substitutes of the World Health Organization [], European Union legislation on infant formula [], and German legislation on infant formula [] all stipulate that there should be no advertising or other form of promotion of infant formula to the general public. The World Health Organization recently published technical guidance on regulatory measures to restrict digital marketing of breast-milk substitutes []. Until now, Germany has only adopted some of the provisions of The International Code; therefore, information on follow-on formula is permitted to be advertised to the general public [].
Certification
Several certificates for quality of health-related websites exist in Germany, including Action Forum Health Information System (afgis) [], Stiftung Gesundheit (Health Foundation) [], and the medical search machine for German-speaking countries (Medisuch) []. The HONCode (Health on the Net Foundation) [] was a reliable certification for ethical and qualitative standards of websites with health-related topics. Although it stopped its service in 2022, some websites still showed the certification at the time of our search. Only 3 websites were certified, and not even a quarter of the websites had any proof for correct medical information.
Strengths and Limitations
One strength of this study is that the quality appraisal of websites and mobile apps was performed using a variety of validated tools.
The scope of this study was limited to mobile apps and websites with breastfeeding information available in German. Therefore, the findings of this study are not generalizable to websites and mobile apps in other languages.
This study focused on free-of-charge mobile apps, which are used most often. It is plausible that higher quality information might be available on breastfeeding mobile apps that charge a fee. Some health insurance companies offer a mobile app for pregnancy or parenthood with breastfeeding content “free of charge,” but these are only available to their insured members through app stores. Our mobile app search did not include mobile apps provided by health insurance companies. Due to the possibility of using Google Trends and Ubersuggest, the selection of websites involved more differentiated search terms compared to mobile apps. This might have increased the likelihood of selection bias.
Conclusion
The reviewed apps and websites were generally of acceptable quality, but many included advertisements for breast-milk substitutes. Credible health authorities should improve visibility through effective keywords, regular updates, and content authored by qualified professionals. Independent certification for noncommercial, accurate health information is needed, and all content should follow relevant guidelines. Texts should be motivating, easy to read, and supported by summaries, visuals, and videos to aid users with limited time or literacy. To reflect diverse populations, providers should use inclusive images and offer translations into commonly spoken languages.
Features such as breastfeeding support, meal and sleep tracking, quizzes, recipes, milestone documentation, and chat functions may enhance user engagement and app ratings and could be integrated by public actors when designing evidence-based health apps.
In conclusion, although current evidence is insufficient to demonstrate sustained beneficial effects of breastfeeding promotion and support on breastfeeding rates through mobile apps alone [], integration of evidence-based educational content in mobile apps together with personalized remote support nonetheless holds potential to improve breastfeeding outcomes [,].
Acknowledgments
We would like to thank Julia Papst for reviewing the apps and websites. We would like to thank Frances Strobl for providing comments and copyediting.
Funding
This work was financially supported in part by the Child Health Foundation (Stiftung Kindergesundheit, www.kindergesundheit.de), Munich and the German Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF) as part of the German Center for Child and Adolescent Health (DZKJ), 01GL2406A. BVK is the Else Kröner Seniorprofessor of Pediatrics at LMU–University of Munich, financially supported by the charitable Else Kröner-Fresenius-Foundation, LMU Medical Faculty and LMU University Hospitals.
Conflicts of Interest
MZ, VJ, and MAT report no conflicts of interest. BVK has received reimbursement for speaking at conferences supported by companies marketing nutritional or healthcare-related products and by not-for-profit biomedical associations including the American Academy of Pediatrics, European Academy of Pediatrics, Biomedical Alliance in Europe, United European Gastroenterology, German Society for Pediatrics and Adolescent Medicine, and German Professional Association for Gynecology and Obstetrics.
References
- Baumann E, Czerwinski F, Rosset M, Seelig M, Suhr R. Wie informieren sich die Menschen in Deutschland zum Thema Gesundheit? Erkenntnisse aus der ersten Welle von HINTS Germany [Article in German]. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. Sep 2020;63(9):1151-1160. [CrossRef]
- Demirci JR, Cohen SM, Parker M, Holmes A, Bogen DL. Access, use, and preferences for technology-based perinatal and breastfeeding support among childbearing women. J Perinat Educ. 2016;25(1):29-36. [CrossRef] [Medline]
- Slomian J, Bruyère O, Reginster JY, Emonts P. The internet as a source of information used by women after childbirth to meet their need for information: a web-based survey. Midwifery. May 2017;48:46-52. [CrossRef] [Medline]
- Carter B. Parenting: a glut of information. J Child Health Care. Jun 2007;11(2):82-84. [CrossRef] [Medline]
- O’Higgins A, Murphy OC, Egan A, Mullaney L, Sheehan S, Turner MJ. The use of digital media by women using the maternity services in a developed country. Ir Med J. 2014;107(10):313-315. [Medline]
- mHealth: new horizons for health through mobile technologies: second global survey on eHealth. World Health Organization; 2011. URL: https://iris.who.int/server/api/core/bitstreams/ad1b13c0-7c82-47b4-8dd5-f0a26c3a3cc3/content [Accessed 2026-02-11]
- Uncovska M, Freitag B, Meister S, Fehring L. Patient acceptance of prescribed and fully reimbursed mHealth apps in Germany: an UTAUT2‑based online survey study. J Med Syst. Jan 27, 2023;47(1):14. [CrossRef] [Medline]
- Theurich MA, Weikert C, Abraham K, Koletzko B. Breastfeeding rate and promotion in selected European countries [Article in German with English abstract]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Aug 2018;61(8):926-936. [CrossRef] [Medline]
- Qian J, Wu T, Lv M, et al. The value of mobile health in improving breastfeeding outcomes among perinatal or postpartum women: systematic review and meta‑analysis of randomized controlled trials. JMIR Mhealth Uhealth. Jul 16, 2021;9(7):e26098. [CrossRef] [Medline]
- Lau Y, Htun TP, Tam WSW, Klainin-Yobas P. Efficacy of e-technologies in improving breastfeeding outcomes among perinatal women: a meta-analysis. Matern Child Nutr. Jul 2016;12(3):381-401. [CrossRef] [Medline]
- Blackmore A, Howell B, Romme K, et al. The effectiveness of virtual lactation support: a systematic review and meta‑analysis. J Hum Lact. Aug 2022;38(3):452-465. [CrossRef] [Medline]
- Hughson JAP, Daly JO, Woodward-Kron R, Hajek J, Story D. The rise of pregnancy apps and the implications for culturally and linguistically diverse women: narrative review. JMIR Mhealth Uhealth. Nov 16, 2018;6(11):e189. [CrossRef] [Medline]
- Chan KL, Chen M. Effects of social media and mobile health apps on pregnancy care: meta‑analysis. JMIR Mhealth Uhealth. Jan 30, 2019;7(1):e11836. [CrossRef] [Medline]
- Alianmoghaddam N, Phibbs S, Benn C. “I did a lot of Googling”: a qualitative study of exclusive breastfeeding support through social media. Women Birth. Apr 2019;32(2):147-156. [CrossRef] [Medline]
- Ziebart M, Kammermeier M, Koletzko B, Patro-Golab B. Mobile applications for promoting and supporting breastfeeding: systematic review and meta-analysis. Matern Child Nutr. Jan 2025;21(1):e13733. [CrossRef] [Medline]
- Biviji R, Williams KS, Vest JR, Dixon BE, Cullen T, Harle CA. Consumer perspectives on maternal and infant health apps: qualitative content analysis. J Med Internet Res. Sep 1, 2021;23(9):e27403. [CrossRef] [Medline]
- MacMillan Uribe AL, DiFilippo KN, Jarnell K, Patterson JA. Evaluation of commercially available infant‑feeding mobile applications using App Quality Evaluation Tool. J Nutr Educ Behav. Aug 2023;55(8):604-611. [CrossRef] [Medline]
- Virani A, Duffett-Leger L, Letourneau N. Parenting apps review: in search of good quality apps. mHealth. 2019;5:44. [CrossRef] [Medline]
- Zhao J, Freeman B, Li M. How do infant feeding apps in China measure up? A content quality assessment. JMIR Mhealth Uhealth. Dec 6, 2017;5(12):e186. [CrossRef] [Medline]
- Cheng H, Tutt A, Llewellyn C, et al. Content and quality of infant feeding smartphone apps: five‑year update on a systematic search and evaluation. JMIR Mhealth Uhealth. May 27, 2020;8(5):e17300. [CrossRef] [Medline]
- Artieta-Pinedo I, Paz-Pascual C, Grandes G, Villanueva G, Ema Q Group. An evaluation of Spanish and English on-line information sources regarding pregnancy, birth and the postnatal period. Midwifery. Mar 2018;58:19-26. [CrossRef] [Medline]
- Brunelli L, De Vita C, Cenedese F, et al. Gaps and future challenges of Italian apps for pregnancy and postnatal care: systematic search on app stores. J Med Internet Res. Aug 10, 2021;23(8):e29151. [CrossRef] [Medline]
- von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med. Oct 16, 2007;147(8):573-577. [CrossRef] [Medline]
- Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. Jun 10, 2016;4(2):e72. [CrossRef] [Medline]
- Messner EM, Terhorst Y, Barke A, et al. The German version of the Mobile App Rating Scale (MARS‑G): development and validation study. JMIR Mhealth Uhealth. Mar 27, 2020;8(3):e14479. [CrossRef] [Medline]
- Doak CC, Doak LG, Root JH. Teaching patients with low literacy skills. Am J Nurs. Dec 1996;96(12):16M. [CrossRef]
- Doak CC, Doak LG, Root JH. Suitability assessment of materials for evaluation of health-related information for adults. Practice Development Inc URL: https://moodle2.units.it/pluginfile.php/290571/mod_folder/content/0/sam.pdf?forcedownload=1 [Accessed 2026-02-11]
- Schöll P. Flesch-index berechnen - kostenlos [Website in German]. Fleschindex. URL: https://fleschindex.de [Accessed 2022-11-23]
- Amstad T. Wie verständlich sind unsere zeitungen? [Dissertation] [Website in German]. Zurich; 1978. URL: https://kansalliskirjasto.finna.fi/Record/fikka.108133 [Accessed 2026-02-10]
- Google [Website in German]. URL: www.google.de [Accessed 2023-10-07]
- Microsoft Bing [Website in German]. URL: www.bing.de [Accessed 2023-10-07]
- Google Trends [Website in German]. URL: https://trends.google.de/trends/ [Accessed 2023-10-07]
- Keyword ideas. Ubersuggest. URL: https://ubersuggest.zendesk.com/hc/en-us/sections/4405443414555-Keyword-Ideas [Accessed 2023-10-07]
- Morahan-Martin JM. How internet users find, evaluate, and use online health information: a cross-cultural review. Cyberpsychol Behav. Oct 2004;7(5):497-510. [CrossRef] [Medline]
- Health-related web site evaluation form. Carlbring Research; 2020. URL: https://www.carlbring.se/form/itform_eng.pdf [Accessed 2022-05-31]
- Koletzko B, Bauer CP, Cierpka M, et al. Ernährung und Bewegung von Säuglingen und stillenden Frauen [Article in German]. Monatsschr Kinderheilkd. Sep 2016;164(9):771-798. [CrossRef]
- IRR: various coefficients of interrater reliability and agreement. 2019. URL: https://CRAN.R-project.org/package=irr [Accessed 2026-02-11]
- R: a language and environment for statistical computing. R Foundation for Statistical Computing. 2023. URL: https://www.R-project.org/ [Accessed 2026-02-11]
- Familie [Website in German]. URL: https://www.familie.de [Accessed 2026-02-12]
- Kindergesundheit-Info [Website in German]. URL: https://www.kindergesundheit-info.de [Accessed 2026-02-12]
- Babelli [Website in German]. URL: https://www.babelli.de [Accessed 2026-02-12]
- Team Muttermilch [Website in German]. URL: https://teammuttermilch.de [Accessed 2026-02-12]
- Medela [Website in German]. URL: https://www.medela.de [Accessed 2026-02-12]
- Enzyclopedia [Website in German]. Wikipedia. URL: https://de.wikipedia.org [Accessed 2026-02-12]
- Netdoktor [Website in German]. URL: https://www.netdoktor.de [Accessed 2026-02-12]
- Still-Lexikon [Website in German]. URL: https://www.still-lexikon.de [Accessed 2026-02-12]
- Eltern [Website in German]. URL: https://www.eltern.de [Accessed 2026-02-12]
- Lansinoh [Website in German]. URL: https://lansinoh.de [Accessed 2026-02-12]
- Apotheken Umschau [Website in German]. URL: https://www.apotheken-umschau.de [Accessed 2026-02-12]
- Hipp [Website in German]. URL: https://www.hipp.de [Accessed 2026-02-12]
- Windeln [Website in German]. URL: https://www.windeln.de/magazin [Accessed 2026-02-12]
- Taki S, Campbell KJ, Russell CG, Elliott R, Laws R, Denney-Wilson E. Infant feeding websites and apps: a systematic assessment of quality and content. Interact J Med Res. Sep 29, 2015;4(3):e18. [CrossRef] [Medline]
- Musgrave LM, Kizirian NV, Homer CSE, Gordon A. Mobile phone apps in Australia for improving pregnancy outcomes: systematic search on app stores. JMIR mhealth uHealth. Nov 16, 2020;8(11):e22340. [CrossRef] [Medline]
- Dinour LM, Pole A. Evaluation of breastfeeding app features: content analysis study. JMIR Pediatr Parent. Oct 26, 2022;5(4):e37581. [CrossRef] [Medline]
- Almohanna AA, Win KT, Meedya S. Effectiveness of internet‑based electronic technology interventions on breastfeeding outcomes: systematic review. J Med Internet Res. May 29, 2020;22(5):e17361. [CrossRef] [Medline]
- Jawad D, Cheng H, Wen LM, et al. Interactivity, quality, and content of websites promoting health behaviors during infancy: 6‑year update of the systematic assessment. J Med Internet Res. Oct 7, 2022;24(10):e38641. [CrossRef] [Medline]
- Ausländer und migranten in Deutschland [Website in German]. Mediendienst Integration. URL: https://mediendienst-integration.de/migration/bevoelkerung.html [Accessed 2023-06-10]
- Brauchma J, et al. Health promotion and overweight prevention-a systematic evaluation of available information materials with a focus on risk groups [Article in German]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. Dec 2019;62(12):1522-1530. [CrossRef]
- Qualifikationen in der Stillberatung [Website in German]. Europäisches Institut für Stillen und Laktation. URL: https://www.stillen-institut.com/de/qualifikationen-in-der-stillberatung.html#:~:text=Im%20deutschsprachigen%20Raum%20ist%20der,innen%20können%20und%20wissen%20müssen [Accessed 2023-04-10]
- Newby R, Brodribb W, Ware RS, Davies PSW. Internet use by first‑time mothers for infant feeding support. J Hum Lact. Aug 2015;31(3):416-424. [CrossRef] [Medline]
- van Velthoven MH, Wyatt JC, Meinert E, Brindley D, Wells G. How standards and user involvement can improve app quality: a lifecycle approach. Int J Med Inform. Oct 2018;118:54-57. [CrossRef] [Medline]
- Jones A, Bhaumik S, Morelli G, et al. Digital marketing of breast‑milk substitutes: a systematic scoping review. Curr Nutr Rep. Sep 2022;11(3):416-430. [CrossRef] [Medline]
- Digital marketing of breastmilk substitutes: how social media and influencer marketing undermine informed choice. Save the Children; 2024. URL: https://dylbw5db8047o.cloudfront.net/uploads/BMS-Final-Report.pdf [Accessed 2026-02-11]
- International code of marketing of breast-milk subsitutes. World Health Organization; 1981. URL: https://iris.who.int/server/api/core/bitstreams/f6704ad6-4ce5-4f37-8562-5a64f0f693ae/content [Accessed 2020-04-17]
- Commission delegated regulation (EU) 2016/127. Official Journal of the European Union; 2016. URL: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32016R0127 [Accessed 2026-02-12]
- Verordnung über diätetische Lebensmittel (Diätverordnung) [Report in German]. Bundesministerium der Justiz und für Verbraucherschutz; 2005. URL: https://faolex.fao.org/docs/pdf/ger89197.pdf [Accessed 2026-02-12]
- Guidance on regulatory measures aimed at restricting digital marketing of breast-milk substitutes. World Health Organization; 2023. URL: https://iris.who.int/server/api/core/bitstreams/caf4eb9d-951d-4ecc-b7aa-1c5b86bbe570/content [Accessed 2026-02-11]
- Marketing of breast-milk substitutes: national implementation of the International Code, status report 2022. World Health Organization; 2022. URL: https://iris.who.int/server/api/core/bitstreams/99dbb0e0-daf3-4296-b496-6f09cb5eeffa/content [Accessed 2026-02-11]
- Afgis - aktionsforum gesundheitsinformationssystem [Website in German]. URL: https://www.afgis.de [Accessed 2023-09-27]
- Stiftung gesundheit - wissen ist die beste medizin [Website in German]. URL: https://www.stiftung-gesundheit.de [Accessed 2023-09-27]
- Medisuch [Website in German]. URL: https://www.medisuch.de/ueberMedisuch.asp [Accessed 2023-09-27]
- Health on the net foundation [Website in German]. Wikipedia. URL: https://de.wikipedia.org/wiki/Health_On_the_Net_Foundation [Accessed 2023-09-27]
- Gavine A, Marshall J, Buchanan P, et al. Remote provision of breastfeeding support and education: systematic review and meta-analysis. Matern Child Nutr. Apr 2022;18(2):e13296. [CrossRef] [Medline]
Abbreviations
| HRWSEF: Health-Related Web Site Evaluation Form |
| IRR: interrater reliability |
| mHealth: mobile health |
| SAM: Suitability Assessment of Materials |
| STROBE: Strengthening the Reporting of Observational Studies in Epidemiology |
| uMARS: user version of the Mobile Application Rating Scale |
Edited by Sherif Badawy; submitted 02.Jun.2025; peer-reviewed by Gerlinde Lenaerts, Sreekanth Narayan; final revised version received 27.Nov.2025; accepted 24.Dec.2025; published 16.Mar.2026.
Copyright© Monika Ziebart, Vanessa Jäger, Melissa A Theurich, Berthold Viktor Koletzko. Originally published in JMIR Pediatrics and Parenting (https://pediatrics.jmir.org), 16.Mar.2026.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Pediatrics and Parenting, is properly cited. The complete bibliographic information, a link to the original publication on https://pediatrics.jmir.org, as well as this copyright and license information must be included.

