Online proctoring

在线监督
  • 文章类型: Journal Article
    近年来,疫情迫使教育系统从传统教学转向在线教学或混合学习。有效监视远程在线考试的能力是限制教育系统中这一阶段在线评估的可扩展性的因素。人类学习是最常用的方法,可以要求学习者在考试中心参加考试,或者通过视觉监控要求学习者打开相机。然而,这些方法需要大量的劳动力,努力,基础设施,和硬件。本文通过捕获考生的实时视频,提出了一种基于AI的自动化监考系统-“考勤系统”,用于在线评估。我们的细心系统包括四个组件来估计错误,如人脸检测,多人检测,脸欺骗,和头部姿势估计。注意网络检测面并绘制边界框以及置信度。注意网还使用仿射变换的旋转矩阵检查面的对齐。将人脸网算法与Attentive-Net相结合来提取地标和面部特征。通过使用浅CNN活跃度网仅针对对齐的面部启动用于识别欺骗面部的过程。使用SolvePnp方程估计考官的头部姿势,检查他/她是否在寻求他人的帮助。犯罪调查和预防实验室(CIPL)数据集和具有各种类型的不当行为的定制数据集用于评估我们提出的系统。大量的实验结果表明,我们的方法更准确,可靠和健壮的监督系统,可以在实时环境中实际实现为自动监督系统。作者报告了改进的准确度为0.87,结合了注意网,活体网和头部姿势估计。
    In recent years, the pandemic situation has forced the education system to shift from traditional teaching to online teaching or blended learning. The ability to monitor remote online examinations efficiently is a limiting factor to the scalability of this stage of online evaluation in the education system. Human Proctoring is the most used common approach by either asking learners to take a test in the examination centers or by monitoring visually asking learners to switch on their camera. However, these methods require huge labor, effort, infrastructure, and hardware. This paper presents an automated AI-based proctoring system- \'Attentive system\' for online evaluation by capturing the live video of the examinee. Our Attentive system includes four components to estimate the malpractices such as face detection, multiple person detection, face spoofing, and head pose estimation. Attentive Net detects the faces and draws bounding boxes along with confidences. Attentive Net also checks the alignment of the face using the rotation matrix of Affine Transformation. The face net algorithm is combined with Attentive-Net to extract landmarks and facial features. The process for identifying spoofed faces is initiated only for aligned faces by using a shallow CNN Liveness net. The head pose of the examiner is estimated by using the SolvePnp equation, to check if he/she is seeking help from others. Crime Investigation and Prevention Lab (CIPL) datasets and customized datasets with various types of malpractices are used to evaluate our proposed system. Extensive Experimental results demonstrate that our method is more accurate, reliable and robust for proctoring system that can be practically implemented in real time environment as Automated proctoring System. An improved accuracy of 0.87 is reported by authors with the combination of Attentive Net, Liveness net and head pose estimation.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    目标:技术在医学中普遍存在,但是我们很少研究它是如何形成评估的,学习,知识,和性能。评估的文化也塑造了身份,社会关系,以及被职业认可为合法的知识和行为。因此,医学教育中技术与评估的结合值得回顾。在Covid-19大流行期间,在线监督服务变得更加普遍,作为继续高风险在线监考的一种手段。随着对加强监控的批评,歧视,以及将控制权外包给商业供应商,这是简单的“在线移动考试”,这个极端的例子可以告诉我们我们的评估技术如何影响受训者与医学教育机构之间的关系?
    方法:我们结合了后数字和后现象学方法来分析2020年在线监督的英国皇家内科医学院(MRCP)会员考试的书面组成部分。我们检查脚本,规范,通过这个在线监督的例子产生的信任关系,然后在历史和经济背景下定位它们。我们发现,监考服务投射出一种虚假的客观性,由于考生必须遵守严格的监督规范而受到损害,以及看不见的人类监督者对数字数据的解释。尽管如此,这种监督服务是由数据驱动的创新形象推动的,为了应对日益严重的在线作弊问题,和厌恶,在医学教育机构内,改变评估格式(因此需要接受不同形式的知识是合法的)。
    结论:医学教育机构对在线监督技术的使用加强了既定的规范,已经出现在考试中,监视和不信任。此外,它加剧了相互冲突的商业化议程之间的紧张关系,问责制,和值得信赖的专业人员的教育。我们的分析提供了一个例子,说明为什么必须停止并考虑引入技术“解决方案”的整体含义,并询问与医学教育更广泛目标相关的技术和评估实践的交集。
    OBJECTIVE:  Technology is pervasive in medicine, but we too rarely examine how it shapes assessment, learning, knowledge, and performance. Cultures of assessment also shape identities, social relations, and the knowledge and behavior recognized as legitimate by a profession. Therefore, the combination of technology and assessment within medical education is worthy of review. Online proctoring services have become more prevalent during the Covid-19 pandemic, as a means of continuing high-stakes invigilated examinations online. With criticisms about increased surveillance, discrimination, and the outsourcing of control to commercial vendors, is this simply \"moving exams online\", or are there more serious implications? What can this extreme example tell us about how our technologies of assessment influence relationships between trainees and medical education institutions?
    METHODS:  We combine postdigital and postphenomenology approaches to analyze the written component of the 2020 online proctored United Kingdom Royal College of Physicians (MRCP) membership exam. We examine the scripts, norms, and trust relations produced through this example of online proctoring, and then locate them in historical and economic contexts. We find that the proctoring service projects a false objectivity that is undermined by the tight script with which examinees must comply in an intensified norm of surveillance, and by the interpretation of digital data by unseen human proctors. Nonetheless, such proctoring services are promoted by an image of data-driven innovation, a rhetoric of necessity in response to a growing problem of online cheating, and an aversion, within medical education institutions, to changing assessment formats (and thus the need to accept different forms of knowledge as legitimate).
    CONCLUSIONS:  The use of online proctoring technology by medical education institutions intensifies established norms, already present within examinations, of surveillance and distrust. Moreover, it exacerbates tensions between conflicting agendas of commercialization, accountability, and the education of trustworthy professionals. Our analysis provides an example of why it is important to stop and consider the holistic implications of introducing technological \"solutions\", and to interrogate the intersection of technology and assessment practices in relation to the wider goals of medical education.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

    求助全文

  • 文章类型: Journal Article
    在过去的1-2年里,教育领域发生了巨大的飞跃。.学校和学院正在网上过渡,为学生提供更多的资源。COVID-19大流行为学生提供了更多以自己的速度学习和提高自己的机会。在线监督服务(评估的一部分)也在增加,基于人工智能的监督系统(以下称为AIPS)已经席卷了市场。在线监督系统(以下称为OPS),总的来说,利用在线工具来维护考试的神圣性。虽然大多数该软件使用各种模块,他们收集的敏感信息引起了学生社区的关注。有各种各样的心理,在开发AIPS时需要考虑文化和技术参数。本文系统地回顾了现有的人工智能和非基于人工智能的监督系统。通过对Scopus的系统搜索,WebofScience和ERIC存储库,从2015年到2021年,共列出了43篇论文。我们解决了4个主要研究问题,这些问题侧重于AIPS的现有架构,AIPS要考虑的参数,AIPS的趋势和问题以及AIPS的未来。我们对OPS和AIPS的360度分析表明,与AIPS相关的安全问题正在成倍增加,并引起了合理的关注。主要问题包括安全和隐私问题,伦理问题,信任基于人工智能的技术,缺乏技术使用方面的培训,成本和更多。很难知道这些在线保理技术的好处是否大于其风险。我们目前可以得出的最合理的结论是,这些技术及其各种能力的道德合理性要求我们严格确保在关注与可能的利益之间取得平衡。据我们所知,对AIPS和OPS没有这样的分析。我们的工作进一步解决了AIPS在人力和技术方面的问题。它还列出了最近才推出的关键点和新技术,但在未来几年可能会对在线教育和OPS产生重大影响。
    There have been giant leaps in the field of education in the past 1-2 years.. Schools and colleges are transitioning online to provide more resources to their students. The COVID-19 pandemic has provided students more opportunities to learn and improve themselves at their own pace. Online proctoring services (part of assessment) are also on the rise, and AI-based proctoring systems (henceforth called as AIPS) have taken the market by storm. Online proctoring systems (henceforth called as OPS), in general, makes use of online tools to maintain the sanctity of the examination. While most of this software uses various modules, the sensitive information they collect raises concerns among the student community. There are various psychological, cultural and technological parameters need to be considered while developing AIPS. This paper systematically reviews existing AI and non-AI-based proctoring systems. Through the systematic search on Scopus, Web of Science and ERIC repositories, 43 paper were listed out from the year 2015 to 2021. We addressed 4 primary research questions which were focusing on existing architecture of AIPS, Parameters to be considered for AIPS, trends and Issues in AIPS and Future of AIPS. Our 360-degree analysis on OPS and AIPS reveals that security issues associated with AIPS are multiplying and are a cause of legitimate concern. Major issues include Security and Privacy concerns, ethical concerns, Trust in AI-based technology, lack of training among usage of technology, cost and many more. It is difficult to know whether the benefits of these Online Proctoring technologies outweigh their risks. The most reasonable conclusion we can reach in the present is that the ethical justification of these technologies and their various capabilities requires us to rigorously ensure that a balance is struck between the concerns with the possible benefits to the best of our abilities. To the best of our knowledge, there is no such analysis on AIPS and OPS. Our work further addresses the issues in AIPS in human and technological aspect. It also lists out key points and new technologies that have only recently been introduced but could significantly impact online education and OPS in the years to come.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Sci-hub)

       PDF(Pubmed)

公众号