Please use this identifier to cite or link to this item:
Full metadata record
DC FieldValueLanguage
dc.contributor.authorPham, Quynh-
dc.contributor.authorGraham, Gary-
dc.contributor.authorCarrion Ribas, Carme-
dc.contributor.authorMorita, Plinio P.-
dc.contributor.authorSeto, Emily-
dc.contributor.authorStinson, Jennifer N.-
dc.contributor.authorCafazzo, Joseph A.-
dc.contributor.otherUniversity of Toronto-
dc.contributor.otherUniversity Health Network-
dc.contributor.otherUniversitat Oberta de Catalunya (UOC)-
dc.identifier.citationPham, Q., Graham, G., Carrión Ribas, C., Morita, P.P., Seto, E., Stinson, J.N. & Cafazzo, J.A. (2019). A Library of Analytic Indicators to Evaluate Effective Engagement with Consumer mHealth Apps for Chronic Conditions: Scoping Review. JMIR mHealth and uHealth, 7(1), e11941-. doi: 10.2196/11941en
dc.description.abstractBackground: There is mixed evidence to support current ambitions for mobile health (mHealth) apps to improve chronic health and well-being. One proposed explanation for this variable effect is that users do not engage with apps as intended. The application of analytics, defined as the use of data to generate new insights, is an emerging approach to study and interpret engagement with mHealth interventions. Objective: This study aimed to consolidate how analytic indicators of engagement have previously been applied across clinical and technological contexts, to inform how they might be optimally applied in future evaluations. Methods: We conducted a scoping review to catalog the range of analytic indicators being used in evaluations of consumer mHealth apps for chronic conditions. We categorized studies according to app structure and application of engagement data and calculated descriptive data for each category. Chi-square and Fisher exact tests of independence were applied to calculate differences between coded variables. Results: A total of 41 studies met our inclusion criteria. The average mHealth evaluation included for review was a two-group pretest-posttest randomized controlled trial of a hybrid-structured app for mental health self-management, had 103 participants, lasted 5 months, did not provide access to health care provider services, measured 3 analytic indicators of engagement, segmented users based on engagement data, applied engagement data for descriptive analyses, and did not report on attrition. Across the reviewed studies, engagement was measured using the following 7 analytic indicators: the number of measures recorded (76%, 31/41), the frequency of interactions logged (73%, 30/41), the number of features accessed (49%, 20/41), the number of log-ins or sessions logged (46%, 19/41), the number of modules or lessons started or completed (29%, 12/41), time spent engaging with the app (27%, 11/41), and the number or content of pages accessed (17%, 7/41). Engagement with unstructured apps was mostly measured by the number of features accessed (8/10, P=.04), and engagement with hybrid apps was mostly measured by the number of measures recorded (21/24, P=.03). A total of 24 studies presented, described, or summarized the data generated from applying analytic indicators to measure engagement. The remaining 17 studies used or planned to use these data to infer a relationship between engagement patterns and intended outcomes. Conclusions: Although researchers measured on average 3 indicators in a single study, the majority reported findings descriptively and did not further investigate how engagement with an app contributed to its impact on health and well-being. Researchers are gaining nuanced insights into engagement but are not yet characterizing effective engagement for improved outcomes. Raising the standard of mHealth app efficacy through measuring analytic indicators of engagement may enable greater confidence in the causal impact of apps on improved chronic health and well-being.en
dc.publisherJMIR mHealth and uHealth-
dc.relation.ispartofJMIR mHealth and uHealth, 2019, 7(1)-
dc.rightsCC BY-
dc.subjecteffective engagementen
dc.subjectlog dataen
dc.subjectmobile healthen
dc.subjectmobile applicationsen
dc.subjectchronic diseaseen
dc.subjectscoping reviewen
dc.subjectparticipació efectivaca
dc.subjectparticipación efectivaes
dc.subjectdades transmesesca
dc.subjectdatos transmitidoses
dc.subjectsalut mòbilca
dc.subjectsalud móviles
dc.subjectaplicacions mòbilsca
dc.subjectaplicaciones móvileses
dc.subjectmalaltia crònicaca
dc.subjectenfermedad crónicaes
dc.subjectrevisió d'abastca
dc.subjectrevisión de alcancees
dc.subject.lcshChronically illen
dc.subject.lcshMobile appsen
dc.titleA library of analytic indicators to evaluate effective engagement with consumer mHealth apps for chronic conditions: Scoping review-
dc.subject.lemacMalalts crònicsca
dc.subject.lemacAplicacions mòbilsca
dc.subject.lcshesEnfermos crónicoses
dc.subject.lcshesAplicaciones móvileses
Appears in Collections:Articles

Files in This Item:
File Description SizeFormat 
Carrion_JMIR_Library.pdf397.46 kBAdobe PDFView/Open

This item is licensed under a Creative Commons License Creative Commons