背景:在涉及儿童的电子健康干预研究中,青少年,和他们的父母,研究人员测量了用户体验以协助干预开发,精致,和评价。迄今为止,不存在广泛接受的用户体验定义或衡量标准,以支持在干预措施内部或跨干预措施进行评估和比较的标准化方法.
目的:我们在随后的Delphi咨询中进行范围审查,以确定如何在eHealth研究中定义和衡量用户体验,表征所使用的测量工具,并为用户体验领域建立工作定义,可用于未来的eHealth评估。
方法:我们系统地检索了2005年1月1日至2019年4月11日的已发表和灰色文献的电子数据库。我们纳入了评估针对任何健康状况的电子健康干预措施的研究,该干预措施旨在供儿童使用,青少年,和他们的父母。电子健康干预措施需要网络,计算机-,或基于移动的,由互联网介导,具有一定程度的交互性。我们要求进行研究,将用户体验的测量报告为第一人称体验,涉及干预用户报告的认知和行为因素。我们使用已发布的标准评估了纳入研究的用户体验度量的质量:接近成熟的,有希望的,或尚未建立。我们对每项研究中如何定义和测量用户体验进行了描述性分析。审查结果随后为Delphi与eHealth研究人员和青少年用户进行磋商时使用的调查问题提供了信息,以了解应如何定义和衡量用户体验。
结果:在筛选合格的8634篇文章中,这篇综述包括129篇文章和1篇勘误表。共有30名eHealth研究人员和27名青少年参加了Delphi咨询。在文献和咨询的基础上,我们提出了6个主要用户体验领域的工作定义:可接受性,满意,信誉,可用性,用户报告的依从性,和感知的影响。尽管大多数研究都采用了特定于研究的措施,我们确定了10项完善的衡量标准,以量化6个用户体验领域中的5个(除自我报告的依从性外).我们的青少年和研究人员参与者将感知影响列为用户体验最重要的领域之一,而可用性则是最不重要的领域之一。青少年和研究人员之间的排名在其他领域有所不同。
结论:研究结果强调了在研究中定义和衡量用户体验的各种方式,以及研究人员和青少年用户最重视的方面。我们建议纳入用户体验的工作定义和可用措施,以支持跨研究结果的一致评估和报告。未来的研究可以完善用户体验的定义和测量,探索用户体验与其他电子健康结果的关系,并告知以人为中心的电子健康干预措施的设计和使用。
BACKGROUND: Across eHealth intervention studies involving children, adolescents, and their parents, researchers have measured user experience to assist with intervention development, refinement, and evaluation. To date, no widely accepted definitions or measures of user experience exist to support a standardized approach for evaluation and comparison within or across interventions.
OBJECTIVE: We conduct a scoping
review with subsequent
Delphi consultation to identify how user experience is defined and measured in eHealth research studies, characterize the measurement tools used, and establish working definitions for domains of user experience that could be used in future eHealth evaluations.
METHODS: We systematically searched electronic databases for published and gray literature available from January 1, 2005, to April 11, 2019. We included studies assessing an eHealth intervention that targeted any health condition and was designed for use by children, adolescents, and their parents. eHealth interventions needed to be web-, computer-, or mobile-based, mediated by the internet with some degree of interactivity. We required studies to report the measurement of user experience as first-person experiences, involving cognitive and behavioral factors reported by intervention users. We appraised the quality of user experience measures in included studies using published criteria: well-established, approaching well-established, promising, or not yet established. We conducted a descriptive analysis of how user experience was defined and measured in each study.
Review findings subsequently informed the survey questions used in the
Delphi consultations with eHealth researchers and adolescent users for how user experience should be defined and measured.
RESULTS: Of the 8634 articles screened for eligibility, 129 articles and 1 erratum were included in the
review. A total of 30 eHealth researchers and 27 adolescents participated in the
Delphi consultations. On the basis of the literature and consultations, we proposed working definitions for 6 main user experience domains: acceptability, satisfaction, credibility, usability, user-reported adherence, and perceived impact. Although most studies incorporated a study-specific measure, we identified 10 well-established measures to quantify 5 of the 6 domains of user experience (all except for self-reported adherence). Our adolescent and researcher participants ranked perceived impact as one of the most important domains of user experience and usability as one of the least important domains. Rankings between adolescents and researchers diverged for other domains.
CONCLUSIONS: Findings highlight the various ways in which user experience has been defined and measured across studies and what aspects are most valued by researchers and adolescent users. We propose incorporating the working definitions and available measures of user experience to support consistent evaluation and reporting of outcomes across studies. Future studies can refine the definitions and measurement of user experience, explore how user experience relates to other eHealth outcomes, and inform the design and use of human-centered eHealth interventions.