OBJECTIVE: This study aims to evaluate the usability of SHAREdash based on the system development lifecycle stage 3 evaluation goals of efficiency, satisfaction, and validity.
METHODS: Public health professionals from rural health departments from Washington, Idaho, Oregon, and Alaska were enrolled in the usability study from January to April 2022. The web-based evaluation consisted of 2 think-aloud tasks and a semistructured qualitative interview. Think-aloud tasks assessed efficiency and effectiveness, and the interview investigated satisfaction and overall usability. Verbatim transcripts from the tasks and interviews were analyzed using directed content analysis.
RESULTS: Of the 9 participants, all were female and most worked at a local health department (7/9, 78%). A mean of 10.1 (SD 1.4) clicks for task 1 (could be completed in 7 clicks) and 11.4 (SD 2.0) clicks for task 2 (could be completed in 9 clicks) were recorded. For both tasks, most participants required no prompting-89% (n=8) participants for task 1 and 67% (n=6) participants for task 2, respectively. For effectiveness, all participants were able to complete each task accurately and comprehensively. Overall, the participants were highly satisfied with the dashboard with everyone remarking on the utility of using it to support their work, particularly to compare their jurisdiction to others. Finally, half of the participants stated that the ability to share the graphs from the dashboard would be \"extremely useful\" for their work. The only aspect of the dashboard cited as problematic is the amount of missing data that was present, which was a constraint of the data available about rural jurisdictions.
CONCLUSIONS: Think-aloud tasks showed that the SHAREdash allows users to complete tasks efficiently. Overall, participants reported being very satisfied with the dashboard and provided multiple ways they planned to use it to support their work. The main usability issue identified was the lack of available data indicating the importance of addressing the ongoing issues of missing and fragmented public health data, particularly for rural communities.
目的:本研究旨在根据系统开发生命周期第3阶段的效率评估目标来评估SHARedash的可用性,满意,和有效性。
方法:来自华盛顿农村卫生部门的公共卫生专业人员,爱达荷州,俄勒冈,和阿拉斯加在2022年1月至4月参加了可用性研究.基于网络的评估包括2个大声思考的任务和一个半结构化的定性访谈。大声思考任务评估效率和有效性,访谈调查了满意度和整体可用性。使用定向内容分析分析了来自任务和访谈的逐字记录。
结果:在9名参与者中,全部为女性,大部分在当地卫生部门工作(7/9,78%)。记录了任务1的平均10.1(SD1.4)次点击(可以在7次点击中完成)和任务2的11.4(SD2.0)次点击(可以在9次点击中完成)。对于这两项任务,大多数参与者不需要提示-任务1的参与者分别为89%(n=8)和任务2的参与者为67%(n=6).为了有效性,所有参与者都能够准确全面地完成每一项任务。总的来说,参与者对仪表板非常满意,每个人都在谈论使用它来支持他们的工作的效用,特别是将他们的管辖权与其他人进行比较。最后,一半的参与者表示,从仪表板共享图表的能力将对他们的工作“非常有用”。仪表板中唯一有问题的方面是存在的缺失数据量,这是农村司法管辖区可用数据的限制。
结论:大声思考任务表明,SHARedash允许用户有效地完成任务。总的来说,参与者报告说对仪表板非常满意,并提供了他们计划使用它来支持他们的工作的多种方式。确定的主要可用性问题是缺乏可用数据,表明解决公共卫生数据缺失和分散的持续问题的重要性,尤其是农村社区。