PDF(Pubmed)
Abstract：
A quick and reliable test of vocabulary knowledge is a vital component of many studies looking at a range of language processing skills. Recent proliferation of online (web-based) research has generated a growing need for reliable open-access vocabulary tests that can be administered online. This data report presents the newly developed 30-item Web-based Open-access Reliable Decision on Synonyms (WORDS) English Vocabulary Test. In Experiment 1, we tested 109 participants (age range: 18-69 years) on an initial set of 51 potential multiple-choice test items in which participants read a target word (e.g., ubiquitous) and selected a (near-)synonym (e.g., omnipresent) from among three semantically unrelated foils (e.g., interpersonal, catatonic, voluminous). We conducted an item response theory analysis of participants\' accuracy data to select an optimal subset of 30 items to include in the final version of the test. In Experiment 2, we verified the reliability of this 30-item version in a different sample (N = 121; 18-79 years); reliability (internal consistency) was good (Cronbach\'s α = 0.82). We confirmed that, consistent with numerous previous studies, (1) responses were more accurate and quicker for more frequent compared to less frequent words, and (2) older adults showed greater vocabulary knowledge compared to younger adults. The WORDS test takes on average 4 minutes (5 minutes 40 seconds including consent/debrief) to complete. It can be freely accessed via Gorilla Open Materials (https://app.gorilla.sc/openmaterials/694887), allowing ease of use and for useful comparisons between data collected by different researchers.
摘要：
快速可靠的词汇知识测试是许多研究语言处理技能的重要组成部分。最近，在线（基于Web的）研究激增，对可以在线管理的可靠的开放获取词汇测试的需求日益增长。本数据报告介绍了新开发的30项基于Web的开放访问可靠的同义词（WORDS）英语词汇测试决策。在实验1中，我们对109名参与者（年龄范围：18-69岁）进行了初始的51项潜在多项选择测试项目的测试，参与者在其中阅读目标单词（例如，无处不在)，并选择了一个(近)同义词(例如，无所不在)来自三个语义无关的箔(例如，人际关系,紧张,volumous).我们对参与者的准确性数据进行了项目反应理论分析，以选择30个项目的最佳子集，包括在最终版本的测试中。在实验2中，我们在不同的样本（N=121；18-79年）中验证了此30项版本的可靠性；可靠性（内部一致性）良好（Cronbach'sα=0.82）。我们确认,与许多以前的研究一致，(1)与频率较低的单词相比，频率较高的回答更准确、更快，（2）与年轻人相比，老年人表现出更多的词汇知识。WORDS测试平均需要4分钟（包括同意/汇报在内的5分钟40秒）才能完成。它可以通过大猩猩开放材料（https://app）自由访问。大猩猩.sc/openmaterials/694887),允许易于使用，并在不同研究人员收集的数据之间进行有用的比较。
