Technology-based assessment

  • 文章类型: Journal Article
    数字化评估在指导临床决策和监测进展和疾病轨迹方面具有相当大的潜力。长期以来,已建立了TimedUpandGo测试(TUG),用于评估老年医学,并开发和验证了仪器版本(iTUG)。本范围审查包括应用iTUG的研究,旨在确定用例,以显示iTUG评估在何处以及如何指导干预措施和临床管理。文献检索仅限于同行评审的研究,这些研究在至少20名60岁以上的受试者的样本中使用3米长的TUG进行了干预前后的测量。在3018条确定的文章中,包括20条。确定了四个临床用例:后续治疗的分层,监测特发性正常压力脑积水患者的疾病或治疗相关变化并评估干预措施(1),和帕金森病患者(2);关节置换手术后的监测(3),并在不同的运动和康复干预后进行评估(4)。纳入的研究显示了iTUG技术和程序方面的多样性。确定的用例突出了临床相关性和iTUG临床应用的高潜力。协商一致的方法以及全面的报告将有助于进一步开发iTUG支持临床管理的潜力。未来的研究应该调查分段iTUG分析的好处,反应性和参与者对iTUG临床意义变化的看法。
    Digitized assessments have a considerable potential to guide clinicial decision making and monitor progress and disease trajectories. The Timed Up and Go test (TUG) has been long established for assessment in geriatric medicine and instrumented versions (iTUG) have been developed and validated. This scoping review includes studies that applied the iTUG and aims to identify use cases to show where and how iTUG assessment could guide interventions and clinical management. The literature search was limited to peer-reviewed studies that performed pre- and post-intervention measurements with a 3-meter TUG instrumented with body-worn technology in samples of at least 20 subjects aged 60+ years. Of 3018 identified articles 20 were included. Four clinical use cases were identified: stratification for subsequent therapy, monitoring of disease or treatment-associated changes and evaluation of interventions in patients with idiopathic normal pressure hydrocephalus (1), and patients with Parkinson\'s disease (2); monitoring after joint replacement surgery (3), and evaluation after different exercise and rehabilitation interventions (4). The included studies show diversity in terms of iTUG technology and procedures. The identified use cases highlight clinical relevance and high potential for the clinical application of the iTUG. A consensual approach as well as comprehensive reporting would help to further exploit the potential of the iTUG to support clinical management. Future studies should investigate the benefits of segmental iTUG analysis, responsiveness and participants\' perspectives on clinically meaningful changes in iTUG.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    技术进步使得适应直接行为评估的课堂使用变得越来越可能。这项研究检查了儿童在HTKS-Kids上的分数,一个新的,很大程度上是儿童主导版本的既定自我调节个人研究评估,头趾-膝盖-肩关节-修订任务(HTKS-R)对于基于HTKS-Kids平板电脑的评估,这是由儿童的幼儿教师促成的,我们检查了(1)初步的信度和效度;(2)儿童年龄和背景特征预测的分数变化;(3)表明HTKS-Kids提供的信息与教师对儿童的评分不同.
    参与者包括来自纽约州北部两个城市地区的n=79名4岁儿童,美国。父母平均受教育时间为12.5年,范围3-20。一名研究人员将HTKS-R用于个别儿童,和老师(八个白人,两名拉丁裔)接受了使用基于HTKS-Kids平板电脑的评估的培训,并要求每个研究儿童玩一次。老师还对每个孩子进行了关于课堂自我调节的10个儿童行为评定量表(CBRS)项目的评分。
    我们发现(1)HTKS-Kids捕获了儿童自我调节的变化,并与既定措施呈正相关。(2)父母教育是HTKS-Kids分数的最佳预测因子,(3)教师在CBRS上对黑人儿童的评价明显更差,白人儿童的评价更好,群体差异的大小类似于父母教育的贡献。相比之下,黑人和白人儿童在HTKS-Kids上没有得分差异。
    HTKS-Kids是一种有前途的新的基于平板电脑的自我调节评估,可以取代或补充传统的教师评分,这往往受到内隐偏见的影响。
    UNASSIGNED: Technology advances make it increasingly possible to adapt direct behavioral assessments for classroom use. This study examined children\'s scores on HTKS-Kids, a new, largely child-led version of the established individual research assessment of self-regulation, Head-Toes-Knees-Shoulders-Revised task (HTKS-R). For the HTKS-Kids tablet-based assessment, which was facilitated by children\'s preschool teachers, we examined (1) preliminary reliability and validity; (2) variation in scores predicted by child age and background characteristics; and (3) indication that HTKS-Kids provides different information from teacher ratings of children.
    UNASSIGNED: Participants included n = 79 4-year-old children from two urban areas in upstate New York, USA. Average parent education was 12.5 years, ranging 3-20. A researcher administered the HTKS-R to individual children, and teachers (eight white, two Latino) were trained to use the HTKS-Kids tablet-based assessment and asked to play once with each study child. Teachers also rated each child on 10 Child Behavior Rating Scale (CBRS) items about classroom self-regulation.
    UNASSIGNED: We found evidence that (1) the HTKS-Kids captures variation in children\'s self-regulation and correlates positively with established measures, (2) parent education was the best predictor of HTKS-Kids scores, and (3) teachers rated Black children significantly worse and white children better on the CBRS, with the magnitude of group differences similar to the contribution of parent education. In contrast, Black and white children showed no score differences on HTKS-Kids.
    UNASSIGNED: The HTKS-Kids is a promising new tablet-based assessment of self-regulation that could replace or supplement traditional teacher ratings, which are often subject to implicit bias.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    执行功能是对人类发展各个领域的正常运作具有重要意义的心理过程,包括学业成绩。出于这个原因,从临床和教育的角度来看,人们对如何评估它们非常感兴趣。本文介绍了黄红的发展和标准化过程,一种使用数字支持以有趣的格式直接评估6至11岁儿童执行功能的工具。该测试基于执行功能的三因素模型:抑制,工作记忆,和认知灵活性。黄红色包括六个子测试:认知抑制,行为抑制,听觉工作记忆,视觉工作记忆,认知灵活性,和执行功能的全球评估测试。对245名6至11岁的男孩和女孩进行了测试。除了黄红色子测试,金标准测试适用于评估的每个执行功能。测试的心理测量特性在可靠性和有效性证据方面都很强大。可靠性指标均大于0.8。作为收敛有效性的证据,在测试之间建立了相关性,测试被认为是黄金标准。所有的相关性都是显著的,值在0.42和0.73之间。另一方面,使用验证性因子分析对测试的因子结构进行分析。尽管可以证明因子结构随年龄的逐渐分化,只有在老年时才能找到两个因素,一个用于抑制/灵活性,一个用于工作记忆。
    Executive functions are psychological processes of great importance for proper functioning in various areas of human development, including academic performance. For this reason, from both clinical and educational perspectives, there is great interest in how they are assessed. This article describes the development and standardization process of Yellow-Red, an instrument for directly assessing executive functions in children between 6 and 11 years of age in a playful format using digital support. The test was based on a three-factor model of executive functioning: inhibition, working memory, and cognitive flexibility. Yellow-Red comprises six subtests: cognitive inhibition, behavioral inhibition, auditory working memory, visual working memory, cognitive flexibility, and a global assessment test of executive functions. The test was administered to 245 boys and girls between 6 and 11 years of age. Along with the Yellow-Red subtests, gold standard tests were applied for each of the executive functions assessed. The test\'s psychometric properties are powerful in both reliability and validity evidence. The reliability indices are all greater than 0.8. As evidence of convergent validity, correlations were established between the tests, and the tests considered gold standards. All correlations were significant, with values ranging between 0.42 and 0.73. On the other hand, the factor structure of the test was analyzed using confirmatory factor analysis. Although it is possible to demonstrate the progressive differentiation of the factor structure with age, it was only possible to find two factors at older ages, one for inhibition/flexibility and one for working memory.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    替换现有技术或将新技术引入高等教育机构的日常工作中并不是一件小事。目前,许多高等教育机构面临着用电子考试取代现有的笔试管理程序的挑战。为了指导这个过程,本文提出了新的基于技术的考试接受模型(TEAM),并从高等教育教师的角度对其模型结构和有用性进行了实证评估。该模型可用于指导从纸质考试到电子考试的过渡以及创新(例如,自适应)电子考试格式。该模型包括感知有用性,计算机自我效能感,电脑焦虑,先前的经验,便利条件,和主观规范作为使用电子考试的行为意图的预测因子。为了对模型进行实证检验,使用结构方程模型分析了63所德国大学的992名教师对标准化在线问卷的回答.模型拟合是可以接受的。77%(传统电子考试)和82%(自适应电子考试),解释了使用这些类型考试的意图差异的很大一部分。有了团队,现在可以使用一个高度预测的模型来解释使用电子考试的行为意图。它为在高等教育中成功实施电子考试提供了理论依据。
    The replacement of existing technology or the introduction of novel technology into the day-to-day routines of higher education institutions is not a trivial task. Currently, many higher education institutions are faced with the challenge of replacing existing procedures for administering written exams with e-exams. To guide this process, this paper proposes the novel technology-based exams acceptance model (TEAM) and empirically evaluates its model structure and usefulness from the perspective of higher education teachers. The model can be used to guide the transition from paper-based exams to e-exams and the implementation of innovative (e.g., adaptive) e-exam formats. The model includes perceived usefulness, computer self-efficacy, computer anxiety, prior experience, facilitating conditions, and subjective norm as predictors of the behavioral intention to use e-exams. To test the model empirically, the responses of 992 teachers at 63 German universities to a standardized online questionnaire were analyzed using structural equation modeling. The model fit was acceptable. With 77% (conventional e-exams) and 82% (adaptive e-exams), a large proportion of the variance of the intention to use these types of exams was explained. With TEAM, a highly predictive model for explaining the behavioral intention to use e-exams is now available. It offers a theoretical basis that can be used for the successful implementation of e-exams in higher education.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    体力活动不足和肌肉力量低下可导致肌肉减少症和肌强弱症的早期发展,这可能会增加老年人群跌倒的数量和风险。同时,锻炼计划可以阻止甚至恢复肌肉质量的损失,力量,电源,和功能能力,从而降低老年人跌倒的风险。然而,缺乏调查加强计划对八十岁老人的影响的研究。本研究调查了40周的肌肉力量锻炼计划的训练-训练-再训练周期对八十岁老人的姿势稳定性和估计的跌倒风险的影响。27名制度化参与者被分为两组:肌肉力量锻炼组(MSEG,n=14)和对照组(CG,n=13)。在第一个训练期之后,与基线相比,MSEG改善了姿势稳定性,并将估计的跌倒风险降低了7.9%.相比之下,CG使他们的稳定性恶化,并使他们跌倒的风险增加了17%以上。在去训练和再训练期间,组间没有发现显着变化。这项研究表明,力量锻炼有效地改善了姿势控制并降低了跌倒风险评分。此外,干预措施能够降低八十岁老人姿势控制恶化的前进速度,锻炼的头几个月有很大的增量。
    Physical inactivity and low levels of muscle strength can lead to the early development of sarcopenia and dynapenia, which may increase the number and risk of falls in the elderly population. Meanwhile, exercise programs can stop or even revert the loss of muscle mass, strength, power, and functional capacity and consequently decrease the risk of falls in older adults. However, there is a lack of studies investigating the effect of strengthening programs in octogenarians. The present study investigates the effects of 40 weeks of a training-detraining-retraining cycle of muscle strength exercise program on postural stability and estimated fall risk in octogenarians. Twenty-seven institutionalized participants were allocated into two groups: the muscular strength exercise group (MSEG, n = 14) and control group (CG, n = 13). After the first training period, the MSEG improved postural stability and decreased the estimated fall risk by 7.9% compared to baseline. In comparison, CG worsened their stability and increased their risk of falling by more than 17%. No significant changes were found between groups in the detraining and the retraining period. This study demonstrated that strength exercise effectively improved postural control and reduced fall risk scores. In addition, the interventions were able to reduce the forward speed of postural control deterioration in octogenarians, with great increments in the first months of exercise.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    Students\' response sequences to a technology-based problem-solving task can be treated as a discrete time stochastic process with a conditional Markov property-after conditioning on the students\' abilities of problem solving, the next state only depends on the current state. This article proposes a sequential response model (SRM) with a Bayesian approach for parameter estimation that incorporates comprehensive information from the response process to infer problem-solving ability more effectively. A Monte Carlo simulation study showed that parameters were well-recovered. An illustrated example is provided to showcase additional gains using our model for understanding the response process with a real-world interactive assessment item \"Tickets\" in the programme for international student assessment (PISA) 2012.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

  • 文章类型: Editorial
    暂无摘要。
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    The aims of this paper are: to provide a comprehensive introduction to eDia, an online diagnostic assessment system; to show how the use of technology can contribute to solve certain crucial problems in education by supporting the personalization of learning; and to offer a general reference for further eDia-based studies. The primary function for which the system is designed is to provide regular diagnostic feedback in three main domains of education, reading, mathematics, and science, from the beginning of schooling to the end of the 6 years of primary education. The cognitive foundations of the system, the assessment frameworks, are based on a three-dimensional approach in each domain, distinguishing the psychological (reasoning), the application, and the disciplinary (curricular content) dimensions of learning. The frameworks have been carefully mapped into item banks containing over a 1,000 innovative (multimedia-supported) items in each dimension. The online assessments were piloted, and the system has been operating in experimental mode in over 1,000 schools for several years. This paper outlines the theoretical foundations of the eDia system and summarizes how results from research on the cognitive sciences, learning and instruction, and technology-based assessment have been integrated into a working system designed to assess a large population of students. The paper describes the main functions of eDia and discusses how it supports item writing, constructing tests, online test delivery, automated scoring, data processing, scaling and the provision of feedback both for students and teachers. It shows how diagnostic assessments can be implemented in school practice to facilitate differentiated instruction through regular measurements and to provide instruments for teachers to make formative assessments. Beyond its main function (supporting development toward personalizing education), the eDia platform has been used for assessments in a number of areas from pre-school to higher education both in Hungary and in a number of other countries as well. The paper also reviews results from eDia-based studies and highlights how technology-based assessment extends the possibilities of educational research by making more constructs measurable.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    基于技术的评估提供了独特的机会,可以收集有关学生认知发展的数据,并利用这些数据为学生和教师提供反馈,以改善学习。这项研究的目的是展示如何通过基于技术的阅读评估在日常教育实践中评估学习的心理维度,数学和科学。我们分析了评估的三个相关方面:认知发展,性别差异和垂直缩放。该研究的样本来自匈牙利1-8年级(7至14岁)的小学生。每个年级有1500至2000名学生。在线测试是根据阅读的1638个项目构建的,数学,和eDia系统中的科学领域。结果证实,纪律,学习的应用和心理维度可以通过经验来区分。学生的认知发展是数学中最稳定(和有效)的,最大的发展发生在学校教育的最初几年。路径模型表明,可以根据学生的学校知识水平在中等水平上预测学习的心理维度,该水平由作为潜在结构的学习的学科和应用维度组成。预测能力在两个维度上几乎相同。一般来说,女孩在阅读的心理维度上发展得更快,数学和科学学习;然而,性别差异的大小因年龄和领域而异。这项研究(1)提供的证据表明,即使在教育背景下,学习的心理维度也可以变得可见,(2)强调了在校期间学习的心理维度的明确发展的重要性,(3)表明,有利于女孩的学习心理维度的发展水平存在性别差异,但这因年级和领域而异。
    Technology-based assessment offers unique opportunities to collect data on students\' cognitive development and to use that data to provide both students and teachers with feedback to improve learning. The aim of this study was to show how the psychological dimension of learning can be assessed in everyday educational practice through technology-based assessment in reading, mathematics and science. We analyzed three related aspects of the assessments: cognitive development, gender differences and vertical scaling. The sample for the study was drawn from primary school students in Grades 1-8 (ages 7 to 14) in Hungary. There were 1500 to 2000 students in each grade cohort. Online tests were constructed from 1638 items from the reading, mathematics, and science domains in the eDia system. The results confirmed that the disciplinary, application and psychological dimensions of learning can be distinguished empirically. Students\' cognitive development was the most steady (and effective) in mathematics, where the greatest development occurred in the first years of schooling. Path models suggested that the psychological dimension of learning can be predicted at a moderate level based on students\' level of school knowledge consisting of the disciplinary and application dimensions of learning as latent constructs. The predictive power was almost the same in both dimensions. Generally, girls developed faster in the psychological dimension of reading, mathematics and science learning; however, the size of gender differences varied by age and domain. This study (1) provides evidence that the psychological dimension of learning can be made visible even in an educational context, (2) highlights the importance of the explicit development of the psychological dimension of learning during school lessons, and (3) shows that there are gender differences in the developmental level of the psychological dimension of learning in favor of girls but that this varies by grade and domain.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

  • 文章类型: Journal Article
    以证据为中心的设计(ECD)是用于设计和开发评估的框架,可确保从测试设计开始就考虑和收集有效性证据。混合学习和评估需要将学习的各个方面与测试的各个方面处于相同的严谨性水平。在本文中,我们描述了ECD框架的扩展(称为e-ECD),以便它包括ECD中三个核心模型中每个模型的相关学习方面的规范,以及为指定系统内学习和评估之间的关系腾出空间。这里提出的框架没有假设特定的学习理论或特定的学习目标,而是允许将它们纳入评估框架,这样,他们可以由研究人员或评估开发人员希望专注于学习。
    Evidence-centered design (ECD) is a framework for the design and development of assessments that ensures consideration and collection of validity evidence from the onset of the test design. Blending learning and assessment requires integrating aspects of learning at the same level of rigor as aspects of testing. In this paper, we describe an expansion to the ECD framework (termed e-ECD) such that it includes the specifications of the relevant aspects of learning at each of the three core models in the ECD, as well as making room for specifying the relationship between learning and assessment within the system. The framework proposed here does not assume a specific learning theory or particular learning goals, rather it allows for their inclusion within an assessment framework, such that they can be articulated by researchers or assessment developers that wish to focus on learning.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

公众号