Abstract：
OBJECTIVE: To develop a mobile-based multimedia Nursing Competency Evaluation (NCE) system based on the Attention, Relevance, Confidence, Satisfaction model and verify its effectiveness.
BACKGROUND: In education, mobile devices can enable the delivery of learning content without time and spatial constraints. Mobile-based test is emerging as a novel method using technologies to appraise students\' performance on practicum. This mobile-based test go beyond the simple evaluation of memorised knowledge, a limitation common to paper-based tests. They are useful because they can include multimedia items such as videos, animations and pictures to comprehensively evaluate students\' clinical competencies.
METHODS: This study was conducted in a nursing university in Seoul, South Korea in September 2021. A mixed method randomised controlled design was employed to evaluate its usability. The participants in the experimental group used the Nursing Competency Evaluation system and joined in focus group interviews for verifying the effects of the Nursing Competency Evaluation system qualitatively. Those in the control group responded to the mobile-based test, but which has only text-based test items. The system usability, effectiveness and learning satisfaction in both groups were measured after the mobile-based test experience. Quantitative and qualitative data were analysed using t-tests and thematic analysis using focus group interviews, respectively.
RESULTS: Sixty nursing students participated, with 30 each in the experimental and control groups. There were no significant differences in nursing competency scores between the two groups. However, average scores for effectiveness and learning satisfaction were significantly higher in the experimental than in the control group. Nineteen experimental group participants partook in the interviews, with many describing that the Nursing Competency Evaluation system allowed them to experience new learning contents and efficiently learn practical nursing skills that can be useful in clinical settings.
CONCLUSIONS: The Nursing Competency Evaluation system is a promising method because it used mobile technologies and multimedia to appraise students\' performance on nursing practicum. It was found that the Nursing Competency Evaluation system with multimedia items is more realistic, interactive and satisfactory compared with text-based mobile test. Thus, we expect it to be used in future nursing curriculums to improve students\' nursing competencies.
BACKGROUND: In education, mobile devices can enable the delivery of learning content without time and spatial constraints. Mobile-based test is emerging as a novel method using technologies to appraise students\' performance on practicum. This mobile-based test go beyond the simple evaluation of memorised knowledge, a limitation common to paper-based tests. They are useful because they can include multimedia items such as videos, animations and pictures to comprehensively evaluate students\' clinical competencies.
METHODS: This study was conducted in a nursing university in Seoul, South Korea in September 2021. A mixed method randomised controlled design was employed to evaluate its usability. The participants in the experimental group used the Nursing Competency Evaluation system and joined in focus group interviews for verifying the effects of the Nursing Competency Evaluation system qualitatively. Those in the control group responded to the mobile-based test, but which has only text-based test items. The system usability, effectiveness and learning satisfaction in both groups were measured after the mobile-based test experience. Quantitative and qualitative data were analysed using t-tests and thematic analysis using focus group interviews, respectively.
RESULTS: Sixty nursing students participated, with 30 each in the experimental and control groups. There were no significant differences in nursing competency scores between the two groups. However, average scores for effectiveness and learning satisfaction were significantly higher in the experimental than in the control group. Nineteen experimental group participants partook in the interviews, with many describing that the Nursing Competency Evaluation system allowed them to experience new learning contents and efficiently learn practical nursing skills that can be useful in clinical settings.
CONCLUSIONS: The Nursing Competency Evaluation system is a promising method because it used mobile technologies and multimedia to appraise students\' performance on nursing practicum. It was found that the Nursing Competency Evaluation system with multimedia items is more realistic, interactive and satisfactory compared with text-based mobile test. Thus, we expect it to be used in future nursing curriculums to improve students\' nursing competencies.
摘要：
目的：开发基于注意力的移动多媒体护理能力评估（NCE）系统，相关性,信心,满意度模型并验证其有效性。
背景：在教育中，移动设备可以在没有时间和空间限制的情况下实现学习内容的交付。基于移动的测试正在成为一种新颖的方法，该方法使用技术来评估学生在实习中的表现。这种基于移动的测试超越了对记忆知识的简单评估，纸质测试常见的限制。它们是有用的，因为它们可以包括多媒体项目，如视频，动画和图片，以全面评估学生的临床能力。
方法：本研究在首尔的一所护理大学进行，韩国2021年9月。采用混合方法随机对照设计来评估其可用性。试验组参与者采用护理胜任力评价体系,参加焦点小组访谈,对护理胜任力评价体系的效果进行定性验证。对照组的人对基于移动的测试做出了回应，但只有基于文本的测试项目。系统可用性,两组的有效性和学习满意度在移动测试体验后进行测量.定量和定性数据使用t检验和主题分析使用焦点小组访谈，分别。
结果：有60名护生参加，实验组和对照组各30个。两组护理能力评分差异无统计学意义。然而,实验组的有效性和学习满意度的平均得分明显高于对照组。19名实验组参与者参加了访谈，许多人描述护理能力评估系统使他们能够体验新的学习内容并有效地学习在临床环境中有用的实用护理技能。
结论：护理能力评估系统是一种有前途的方法，因为它使用移动技术和多媒体来评估学生在护理实习中的表现。结果发现，采用多媒体项目的护理能力评价系统更加现实，与基于文本的移动测试相比，交互式和令人满意的。因此，我们希望它能在未来的护理课程中使用，以提高学生的护理能力。
背景：在教育中，移动设备可以在没有时间和空间限制的情况下实现学习内容的交付。基于移动的测试正在成为一种新颖的方法，该方法使用技术来评估学生在实习中的表现。这种基于移动的测试超越了对记忆知识的简单评估，纸质测试常见的限制。它们是有用的，因为它们可以包括多媒体项目，如视频，动画和图片，以全面评估学生的临床能力。
方法：本研究在首尔的一所护理大学进行，韩国2021年9月。采用混合方法随机对照设计来评估其可用性。试验组参与者采用护理胜任力评价体系,参加焦点小组访谈,对护理胜任力评价体系的效果进行定性验证。对照组的人对基于移动的测试做出了回应，但只有基于文本的测试项目。系统可用性,两组的有效性和学习满意度在移动测试体验后进行测量.定量和定性数据使用t检验和主题分析使用焦点小组访谈，分别。
结果：有60名护生参加，实验组和对照组各30个。两组护理能力评分差异无统计学意义。然而,实验组的有效性和学习满意度的平均得分明显高于对照组。19名实验组参与者参加了访谈，许多人描述护理能力评估系统使他们能够体验新的学习内容并有效地学习在临床环境中有用的实用护理技能。
结论：护理能力评估系统是一种有前途的方法，因为它使用移动技术和多媒体来评估学生在护理实习中的表现。结果发现，采用多媒体项目的护理能力评价系统更加现实，与基于文本的移动测试相比，交互式和令人满意的。因此，我们希望它能在未来的护理课程中使用，以提高学生的护理能力。
