PDF(Pubmed)
Abstract：
BACKGROUND: Given the dearth of resources to support rural public health practice, the solutions in health analytics for rural equity across the northwest dashboard (SHAREdash) was created to support rural county public health departments in northwestern United States with accessible and relevant data to identify and address health disparities in their jurisdictions. To ensure the development of useful dashboards, assessment of usability should occur at multiple stages throughout the system development life cycle. SHAREdash was refined via user-centered design methods, and upon completion, it is critical to evaluate the usability of SHAREdash.
OBJECTIVE: This study aims to evaluate the usability of SHAREdash based on the system development lifecycle stage 3 evaluation goals of efficiency, satisfaction, and validity.
METHODS: Public health professionals from rural health departments from Washington, Idaho, Oregon, and Alaska were enrolled in the usability study from January to April 2022. The web-based evaluation consisted of 2 think-aloud tasks and a semistructured qualitative interview. Think-aloud tasks assessed efficiency and effectiveness, and the interview investigated satisfaction and overall usability. Verbatim transcripts from the tasks and interviews were analyzed using directed content analysis.
RESULTS: Of the 9 participants, all were female and most worked at a local health department (7/9, 78%). A mean of 10.1 (SD 1.4) clicks for task 1 (could be completed in 7 clicks) and 11.4 (SD 2.0) clicks for task 2 (could be completed in 9 clicks) were recorded. For both tasks, most participants required no prompting-89% (n=8) participants for task 1 and 67% (n=6) participants for task 2, respectively. For effectiveness, all participants were able to complete each task accurately and comprehensively. Overall, the participants were highly satisfied with the dashboard with everyone remarking on the utility of using it to support their work, particularly to compare their jurisdiction to others. Finally, half of the participants stated that the ability to share the graphs from the dashboard would be \"extremely useful\" for their work. The only aspect of the dashboard cited as problematic is the amount of missing data that was present, which was a constraint of the data available about rural jurisdictions.
CONCLUSIONS: Think-aloud tasks showed that the SHAREdash allows users to complete tasks efficiently. Overall, participants reported being very satisfied with the dashboard and provided multiple ways they planned to use it to support their work. The main usability issue identified was the lack of available data indicating the importance of addressing the ongoing issues of missing and fragmented public health data, particularly for rural communities.
OBJECTIVE: This study aims to evaluate the usability of SHAREdash based on the system development lifecycle stage 3 evaluation goals of efficiency, satisfaction, and validity.
METHODS: Public health professionals from rural health departments from Washington, Idaho, Oregon, and Alaska were enrolled in the usability study from January to April 2022. The web-based evaluation consisted of 2 think-aloud tasks and a semistructured qualitative interview. Think-aloud tasks assessed efficiency and effectiveness, and the interview investigated satisfaction and overall usability. Verbatim transcripts from the tasks and interviews were analyzed using directed content analysis.
RESULTS: Of the 9 participants, all were female and most worked at a local health department (7/9, 78%). A mean of 10.1 (SD 1.4) clicks for task 1 (could be completed in 7 clicks) and 11.4 (SD 2.0) clicks for task 2 (could be completed in 9 clicks) were recorded. For both tasks, most participants required no prompting-89% (n=8) participants for task 1 and 67% (n=6) participants for task 2, respectively. For effectiveness, all participants were able to complete each task accurately and comprehensively. Overall, the participants were highly satisfied with the dashboard with everyone remarking on the utility of using it to support their work, particularly to compare their jurisdiction to others. Finally, half of the participants stated that the ability to share the graphs from the dashboard would be \"extremely useful\" for their work. The only aspect of the dashboard cited as problematic is the amount of missing data that was present, which was a constraint of the data available about rural jurisdictions.
CONCLUSIONS: Think-aloud tasks showed that the SHAREdash allows users to complete tasks efficiently. Overall, participants reported being very satisfied with the dashboard and provided multiple ways they planned to use it to support their work. The main usability issue identified was the lack of available data indicating the importance of addressing the ongoing issues of missing and fragmented public health data, particularly for rural communities.
摘要：
背景：鉴于支持农村公共卫生实践的资源匮乏，西北仪表板(SHARedash)农村公平健康分析解决方案的创建是为了向美国西北部农村县公共卫生部门提供可获取的相关数据,以识别和解决辖区内的健康差异.为了确保开发有用的仪表板，可用性评估应该在整个系统开发生命周期的多个阶段进行。SHAREDASH通过以用户为中心的设计方法进行了改进，完成后，评估SHARedash的可用性至关重要。
目的：本研究旨在根据系统开发生命周期第3阶段的效率评估目标来评估SHARedash的可用性，满意,和有效性。
方法：来自华盛顿农村卫生部门的公共卫生专业人员，爱达荷州,俄勒冈,和阿拉斯加在2022年1月至4月参加了可用性研究.基于网络的评估包括2个大声思考的任务和一个半结构化的定性访谈。大声思考任务评估效率和有效性，访谈调查了满意度和整体可用性。使用定向内容分析分析了来自任务和访谈的逐字记录。
结果：在9名参与者中，全部为女性，大部分在当地卫生部门工作(7/9，78%)。记录了任务1的平均10.1（SD1.4）次点击（可以在7次点击中完成）和任务2的11.4（SD2.0）次点击（可以在9次点击中完成）。对于这两项任务，大多数参与者不需要提示-任务1的参与者分别为89%(n=8)和任务2的参与者为67%(n=6).为了有效性，所有参与者都能够准确全面地完成每一项任务。总的来说,参与者对仪表板非常满意，每个人都在谈论使用它来支持他们的工作的效用，特别是将他们的管辖权与其他人进行比较。最后,一半的参与者表示，从仪表板共享图表的能力将对他们的工作“非常有用”。仪表板中唯一有问题的方面是存在的缺失数据量，这是农村司法管辖区可用数据的限制。
结论：大声思考任务表明，SHARedash允许用户有效地完成任务。总的来说,参与者报告说对仪表板非常满意，并提供了他们计划使用它来支持他们的工作的多种方式。确定的主要可用性问题是缺乏可用数据，表明解决公共卫生数据缺失和分散的持续问题的重要性，尤其是农村社区。
目的：本研究旨在根据系统开发生命周期第3阶段的效率评估目标来评估SHARedash的可用性，满意,和有效性。
方法：来自华盛顿农村卫生部门的公共卫生专业人员，爱达荷州,俄勒冈,和阿拉斯加在2022年1月至4月参加了可用性研究.基于网络的评估包括2个大声思考的任务和一个半结构化的定性访谈。大声思考任务评估效率和有效性，访谈调查了满意度和整体可用性。使用定向内容分析分析了来自任务和访谈的逐字记录。
结果：在9名参与者中，全部为女性，大部分在当地卫生部门工作(7/9，78%)。记录了任务1的平均10.1（SD1.4）次点击（可以在7次点击中完成）和任务2的11.4（SD2.0）次点击（可以在9次点击中完成）。对于这两项任务，大多数参与者不需要提示-任务1的参与者分别为89%(n=8)和任务2的参与者为67%(n=6).为了有效性，所有参与者都能够准确全面地完成每一项任务。总的来说,参与者对仪表板非常满意，每个人都在谈论使用它来支持他们的工作的效用，特别是将他们的管辖权与其他人进行比较。最后,一半的参与者表示，从仪表板共享图表的能力将对他们的工作“非常有用”。仪表板中唯一有问题的方面是存在的缺失数据量，这是农村司法管辖区可用数据的限制。
结论：大声思考任务表明，SHARedash允许用户有效地完成任务。总的来说,参与者报告说对仪表板非常满意，并提供了他们计划使用它来支持他们的工作的多种方式。确定的主要可用性问题是缺乏可用数据，表明解决公共卫生数据缺失和分散的持续问题的重要性，尤其是农村社区。
