Evaluation of Mobile Apps Targeted to Parents of Infants in the Neonatal Intensive Care Unit: Systematic App Review

Background Parents of preterm infants increasingly use their mobile phone to search for health information. In a recent review, websites targeted toward parents with infants in the neonatal intensive care unit (NICU) were found to have poor to moderate quality educational material; however, there is a dearth of literature regarding mobile apps for NICU parents. Objective This study aimed to identify and evaluate apps targeting parents of infants in the NICU for quality of information, usability, and credibility. Methods We systematically searched the Apple App Store and Google Play using 49 key terms (eg, “preterm infant”) from July 26 to August 18, 2017. English apps targeting NICU parents that cost less than $20 were included. Apps for health care professionals, e-books/magazines, or nonrelevant results were excluded. In total, 3 tools were used for evaluation: Mobile Application Rating Scale (MARS) to measure quality; Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-AV) to measure the app’s content usability; and Trust it or Trash It to measure credibility. Results The initial search yielded 6579 apps, with 49 apps eligible after title and description screening. In total, 27 apps met the eligibility criteria with 9 apps available in both app stores; of those, the app with the most recent update date was chosen to be included in the analysis. Thus, 18 unique apps were included for final analysis. Using MARS, 7 apps (7/18, 39%) received a good score on overall quality (ie, 4.0 out of 5.0), with none receiving an excellent score. In addition, 8 apps (8/18, 44%) received a PEMAT-AV score between 51% and 75% on the understandability subscale, and 8 apps (8/18, 44%) scored between 76% and 100% on the actionability subscale. Trust It or Trash It deemed 13 apps (13/18, 72%) as trash for reasons including no identification of sources or lack of current information, with only 5 (5/18, 28%) deemed trustworthy. Reviewer’s expert evaluation found 16 apps contained content that matched information provided by multiple sources; however, most apps did not meet other objective measurement items to support credibility. When comparing the MARS overall quality and subjective quality scores with trustworthiness of apps, there was no statistically significant difference. A statistically significant difference was found between the 2 MARS quality scores, indicating that, on average, apps were ranked significantly lower on subjective quality compared with overall quality measures. Conclusions This evaluation revealed that of the available apps targeting NICU parents, less than half should be considered as acceptable educational material. Over two-thirds of the apps were found to have issues regarding credibility and just over a quarter were considered good quality. The apps currently available for NICU parents are lacking and of concern in terms of quality and credibility.

[1]  C. Sohn,et al.  Perceptions of Patient Engagement Applications During Pregnancy: A Qualitative Assessment of the Patient’s Perspective , 2017, JMIR mHealth and uHealth.

[2]  J. Allison,et al.  Pregnant women's interest in a website or mobile application for healthy gestational weight gain. , 2014, Sexual & reproductive healthcare : official journal of the Swedish Association of Midwives.

[3]  A. Hellström,et al.  Mothers' experiences of having their newborn child in a neonatal intensive care unit. , 2006, Scandinavian journal of caring sciences.

[4]  A. Powell,et al.  Interrater Reliability of mHealth App Rating Measures: Analysis of Top Depression and Smoking Cessation Apps , 2016, JMIR mHealth and uHealth.

[5]  Jenay M. Beer,et al.  Mindfulness-Based Symptom and Stress Management Apps for Adults With Chronic Lung Disease: Systematic Search in App Stores , 2018, JMIR mHealth and uHealth.

[6]  Guido Giunti,et al.  Supply and Demand in mHealth Apps for Persons With Multiple Sclerosis: Systematic Search in App Stores and Scoping Literature Review , 2018, JMIR mHealth and uHealth.

[7]  Zhicheng Wang,et al.  Challenges in Assessing Mobile Health App Quality: A Systematic Review of Prevalent and Innovative Methods. , 2016, American journal of preventive medicine.

[8]  Mark Leys,et al.  Information needs of parents of children admitted to a neonatal intensive care unit: a review of the literature (1990-2008). , 2009, Patient education and counseling.

[9]  J. Powell,et al.  Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. , 2002, JAMA.

[10]  Deborah Lupton,et al.  An Australian survey of women's use of pregnancy and parenting apps. , 2016, Women and birth : journal of the Australian College of Midwives.

[11]  M. Leys,et al.  Illness trajectory and Internet as a health information and communication channel used by parents of infants admitted to a neonatal intensive care unit. , 2013, Journal of advanced nursing.

[12]  Kate Branchett,et al.  Neonatal palliative and end of life care: What parents want from professionals , 2012 .

[13]  Emily Knight,et al.  Public Health Guidelines for Physical Activity: Is There an App for That? A Review of Android and Apple App Stores , 2014, JMIR mHealth and uHealth.

[14]  Tobias Kowatsch,et al.  The Potential of Mobile Apps for Improving Asthma Self-Management: A Review of Publicly Available and Well-Adopted Asthma Apps , 2017, JMIR mHealth and uHealth.

[15]  Beth Sundstrom,et al.  Mothers “Google It Up:” Extending Communication Channel Behavior in Diffusion of Innovations Theory , 2016, Health communication.

[16]  Oksana Zelenko,et al.  Mobile App Rating Scale: A New Tool for Assessing the Quality of Health Mobile Apps , 2015, JMIR mHealth and uHealth.

[17]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement , 2015, Systematic Reviews.

[18]  Sarah J. Shoemaker,et al.  Development of the Patient Education Materials Assessment Tool (PEMAT): a new measure of understandability and actionability for print and audiovisual patient information. , 2014, Patient education and counseling.

[19]  Lynn Clark Callister,et al.  The Parental Experience of Having an Infant in the Newborn Intensive Care Unit , 2009, Journal of Perinatal Education.

[20]  B. Lantz,et al.  Parental participation in neonatal care , 2017 .

[21]  W. Nilsen,et al.  Health behavior models in the age of mobile interventions: are our theories up to the task? , 2011, Translational behavioral medicine.

[22]  Stoyan R. Stoyanov,et al.  Review and Evaluation of Mindfulness-Based iPhone Apps , 2015, JMIR mHealth and uHealth.

[23]  K. Siek,et al.  Postpartum Health Information Seeking Using Mobile Phones: Experiences of Low-Income Mothers , 2016, Maternal and Child Health Journal.

[24]  J. Myers,et al.  Use of social media and internet to obtain health information by rural adolescent mothers. , 2015, Applied nursing research : ANR.

[25]  Justine Dol,et al.  Learning to parent from Google? Evaluation of available online health evidence for parents of preterm infants requiring neonatal intensive care , 2019, Health Informatics J..

[26]  Jeannette Milgrom,et al.  Risk factors for antenatal depression, postnatal depression and parenting stress , 2008, BMC psychiatry.

[27]  C. Bührer,et al.  Use of social networking sites by parents of very low birth weight infants: experiences and the potential of a dedicated site , 2013, European Journal of Pediatrics.

[28]  Mia W. Doron,et al.  Supporting parents in the NICU: A new app from the US, MyPreemie , 2013 .

[29]  Jennifer L. Gregg,et al.  Preferred health resources and use of social media to obtain health and depression information by adolescent mothers. , 2014, Journal of child and adolescent psychiatric nursing : official publication of the Association of Child and Adolescent Psychiatric Nurses, Inc.

[30]  R. Dellavalle,et al.  Mobile medical and health apps: state of the art, concerns, regulatory control and certification , 2014, Online journal of public health informatics.

[31]  Adrian P. Lauf,et al.  Parent Education is Changing: A Review of Smartphone Apps , 2017, MCN. The American journal of maternal child nursing.

[32]  J. Ray,et al.  Maternal and neonatal separation and mortality associated with concurrent admissions to intensive care units , 2012, Canadian Medical Association Journal.

[33]  Kenneth D. Mandl,et al.  Mychildren's: Integration of a Personally Controlled Health Record with a Tethered Patient Portal for a Pediatric and Adolescent Population , 2009, AMIA.

[34]  P. Hinds,et al.  Parent Perspectives of Neonatal Intensive Care at the End-of-Life. , 2016, Journal of pediatric nursing.

[35]  Ruth M. Masterson Creber,et al.  Review and Analysis of Existing Mobile Phone Apps to Support Heart Failure Symptom Monitoring and Self-Care Management Using the Mobile Application Rating Scale (MARS). , 2016 .

[36]  N. Feeley,et al.  Clinging to closeness: The parental view on developing a close bond with their infants in a NICU. , 2018, Midwifery.

[37]  Martin F Mendiola,et al.  Valuable Features in Mobile Health Apps for Patients and Consumers: Content Analysis of Apps and User Ratings , 2015, JMIR mHealth and uHealth.

[38]  L. Franck,et al.  Parental involvement in neonatal pain management: an empirical and conceptual update. , 2012, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[39]  B. Carter,et al.  Families' views upon experiencing change in the neonatal intensive care unit environment: from the ‘baby barn’ to the private room , 2008, Journal of Perinatology.

[40]  Cindy Grosik,et al.  Identification of internal and external stressors in parents of newborns in intensive care. , 2013, The Permanente journal.

[41]  Marsha Campbell-Yeo,et al.  Smartphone and Internet Preferences of Parents: Information Needs and Desired Involvement in Infant Care and Pain Management in the NICU , 2017, Advances in neonatal care : official journal of the National Association of Neonatal Nurses.