language model

语言模型
  • 文章类型: Journal Article
    丰富的信息和人与人之间的相互联系,识别特定领域的知识渊博的个人对组织来说已经变得至关重要。人工智能(AI)算法已被用来评估知识并定位特定领域的专家,减轻专家剖析和识别的人工负担。然而,只有有限的研究机构探索AI算法在医学和生物医学领域的专家发现中的应用。本研究旨在对现有的有关利用AI算法进行医疗领域专家识别的文献进行范围审查。我们使用自定义搜索字符串系统地搜索了五个平台,通过其他来源确定了21项研究。该搜索涵盖了截至2023年的研究,研究资格和选择符合PRISMA2020声明。从搜索中评估了总共571项研究。在这些中,我们纳入了2014年至2020年间进行的6项符合我们审查标准的研究.四项研究使用机器学习算法作为他们的模型,而两个人使用自然语言处理。一项研究结合了两种方法。与基线算法相比,所有六项研究在专家检索方面都取得了显著成功,由各种评分指标衡量。AI提高了专家发现的准确性和有效性。然而,智能医学专家检索还需要更多的工作。
    With abundant information and interconnectedness among people, identifying knowledgeable individuals in specific domains has become crucial for organizations. Artificial intelligence (AI) algorithms have been employed to evaluate the knowledge and locate experts in specific areas, alleviating the manual burden of expert profiling and identification. However, there is a limited body of research exploring the application of AI algorithms for expert finding in the medical and biomedical fields. This study aims to conduct a scoping review of existing literature on utilizing AI algorithms for expert identification in medical domains. We systematically searched five platforms using a customized search string, and 21 studies were identified through other sources. The search spanned studies up to 2023, and study eligibility and selection adhered to the PRISMA 2020 statement. A total of 571 studies were assessed from the search. Out of these, we included six studies conducted between 2014 and 2020 that met our review criteria. Four studies used a machine learning algorithm as their model, while two utilized natural language processing. One study combined both approaches. All six studies demonstrated significant success in expert retrieval compared to baseline algorithms, as measured by various scoring metrics. AI enhances expert finding accuracy and effectiveness. However, more work is needed in intelligent medical expert retrieval.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Systematic Review
    背景:用于提供与健康相关的服务(移动健康[mHealth])的移动设备的使用迅速增加,导致通过系统审查总结最新技术和实践的需求。然而,系统审查过程是一个资源密集和耗时的过程。生成人工智能(AI)已经成为自动化繁琐任务的潜在解决方案。
    目的:本研究旨在探索使用生成式AI工具在系统审查过程中自动化耗时且资源密集型任务的可行性,并评估使用此类工具的范围和局限性。
    方法:我们使用了设计科学研究方法。提出的解决方案是使用与生成AI的共同创造,比如ChatGPT,生成软件代码,使进行系统审查的过程自动化。
    结果:生成了一个触发提示,生成人工智能的帮助被用来指导发展的步骤,执行,并调试Python脚本。通过与ChatGPT的对话交换解决了代码中的错误,并创建了一个暂定脚本。该代码从GooglePlay商店中提取了mHealth解决方案,并在其描述中搜索了暗示证据库的关键字。结果导出到一个CSV文件,与其他类似系统审查过程的初始产出进行了比较。
    结论:这项研究证明了使用生成AI来自动化对mHealth应用程序进行系统评价的耗时过程的潜力。这种方法对于编码技能有限的研究人员特别有用。然而,该研究存在与设计科学研究方法相关的局限性,主观性偏见,以及用于训练语言模型的搜索结果的质量。
    BACKGROUND: The use of mobile devices for delivering health-related services (mobile health [mHealth]) has rapidly increased, leading to a demand for summarizing the state of the art and practice through systematic reviews. However, the systematic review process is a resource-intensive and time-consuming process. Generative artificial intelligence (AI) has emerged as a potential solution to automate tedious tasks.
    OBJECTIVE: This study aimed to explore the feasibility of using generative AI tools to automate time-consuming and resource-intensive tasks in a systematic review process and assess the scope and limitations of using such tools.
    METHODS: We used the design science research methodology. The solution proposed is to use cocreation with a generative AI, such as ChatGPT, to produce software code that automates the process of conducting systematic reviews.
    RESULTS: A triggering prompt was generated, and assistance from the generative AI was used to guide the steps toward developing, executing, and debugging a Python script. Errors in code were solved through conversational exchange with ChatGPT, and a tentative script was created. The code pulled the mHealth solutions from the Google Play Store and searched their descriptions for keywords that hinted toward evidence base. The results were exported to a CSV file, which was compared to the initial outputs of other similar systematic review processes.
    CONCLUSIONS: This study demonstrates the potential of using generative AI to automate the time-consuming process of conducting systematic reviews of mHealth apps. This approach could be particularly useful for researchers with limited coding skills. However, the study has limitations related to the design science research methodology, subjectivity bias, and the quality of the search results used to train the language model.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

  • 文章类型: Journal Article
    背景:这项研究整合了人类研究人员和OpenAI的ChatGPT在系统评价任务中的表现的比较分析,并通过对5项研究的回顾,描述了自然语言处理(NLP)模型在临床实践中的应用评估。
    目的:本研究旨在评估ChatGPT和人类研究人员从临床文章中提取关键信息的可靠性。并调查NLP在临床环境中的实际使用,如选定的研究所证明的。
    方法:研究设计包括由人类研究人员和ChatGPT独立执行的临床文章的系统评价。使用Fleiss和Cohenκ统计量评估评估者之间和内部参数提取的一致性水平。
    结果:比较分析显示,ChatGPT与人类研究人员在大多数参数方面具有高度一致性,由于对研究设计的协议较少,临床任务,和临床实施。该综述确定了5项重要研究,证明了NLP在临床环境中的不同应用。这些研究结果强调了NLP在各种情况下改善临床效率和患者预后的潜力。从增强过敏检测和分类到改善创伤后应激障碍退伍军人心理治疗的质量指标。
    结论:我们的发现强调了NLP模型的潜力,包括ChatGPT,在执行系统评价和其他临床任务时。尽管有一定的局限性,NLP模型为提高医疗保健效率和准确性提供了有希望的途径。未来的研究必须专注于扩大临床应用的范围,并探索在医疗保健环境中实施NLP应用的伦理考虑。
    BACKGROUND: This research integrates a comparative analysis of the performance of human researchers and OpenAI\'s ChatGPT in systematic review tasks and describes an assessment of the application of natural language processing (NLP) models in clinical practice through a review of 5 studies.
    OBJECTIVE: This study aimed to evaluate the reliability between ChatGPT and human researchers in extracting key information from clinical articles, and to investigate the practical use of NLP in clinical settings as evidenced by selected studies.
    METHODS: The study design comprised a systematic review of clinical articles executed independently by human researchers and ChatGPT. The level of agreement between and within raters for parameter extraction was assessed using the Fleiss and Cohen κ statistics.
    RESULTS: The comparative analysis revealed a high degree of concordance between ChatGPT and human researchers for most parameters, with less agreement for study design, clinical task, and clinical implementation. The review identified 5 significant studies that demonstrated the diverse applications of NLP in clinical settings. These studies\' findings highlight the potential of NLP to improve clinical efficiency and patient outcomes in various contexts, from enhancing allergy detection and classification to improving quality metrics in psychotherapy treatments for veterans with posttraumatic stress disorder.
    CONCLUSIONS: Our findings underscore the potential of NLP models, including ChatGPT, in performing systematic reviews and other clinical tasks. Despite certain limitations, NLP models present a promising avenue for enhancing health care efficiency and accuracy. Future studies must focus on broadening the range of clinical applications and exploring the ethical considerations of implementing NLP applications in health care settings.
    导出

    更多引用

    收藏

    翻译标题摘要

    我要上传

       PDF(Pubmed)

公众号