关键词: Artificial Intelligence ChatGPT Machine Learning Natural Language Model Patient Education

来  源:   DOI:10.1053/j.jfas.2024.06.009

Abstract:
As a natural progression from educational pamphlets to the worldwide web, and now artificial intelligence (AI), OpenAI chatbots provide a simple way of obtaining pathology-specific patient information, however, little is known concerning the readability and quality of foot and ankle surgery information. This investigation compares such information using the commercially available OpenAI ChatGPT Chatbot and FootCareMD®. A list of common foot and ankle pathologies from FootCareMD® were queried and compared with similar results using ChatGPT. From both resources, the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL) scores were calculated for each condition. Qualitative analysis of each query was performed using the JAMA Benchmark Criteria Score and the DISCERN Score.The overall ChatGPT and FootCareMD® FRES scores were 31.12±7.86 and 55.18±7.27, respectively (p<0.0001). The overall ChatGPT and FootCareMD® FKGL scores were 13.79±1.22 and 9.60±1.24 respectively (p<0.0001), except for the pilon fracture FKGL scores (p=0.09). The average JAMA Benchmark for all information obtained through ChatGPT and FootCareMD® were 0±0 and 1.95±0.15 (p < 0.001), respectively. The DISCERN Score for all information obtained through ChatGPT and FootCareMD® were 52.53±5.39 and 66.93±4.57 (p < 0.001), respectively. AI-assisted queries concerning common foot and ankle pathologies are written at a higher grade level and with less reliability and accuracy compared to similar information available on FootCareMD®. With the ease of use and increase in AI technology, consideration should be given to the nature and quality of information being shared with respect to the diagnosis and treatment of foot and ankle conditions. LEVEL OF EVIDENCE: IV.
摘要:
从教育小册子到万维网的自然发展,现在是人工智能(AI),OpenAI聊天机器人提供了一种获取病理特定患者信息的简单方法,然而,关于足踝手术信息的可读性和质量知之甚少。本调查使用市售的OpenAIChatGPTChatbot和FootCareMD®比较了这些信息。查询来自FootCareMD®的常见足部和踝关节病变列表,并使用ChatGPT与类似结果进行比较。从这两种资源中,计算每种情况下的Flesch阅读轻松评分(FRES)和Flesch-Kincaid等级(FKGL)评分。使用JAMA基准标准评分和DISCERN评分对每个查询进行定性分析。总体ChatGPT和FootCareMD®FRES评分分别为31.12±7.86和55.18±7.27(p<0.0001)。ChatGPT和FootCareMD®FKGL总分分别为13.79±1.22和9.60±1.24(p<0.0001),除Pilon骨折FKGL评分外(p=0.09)。通过ChatGPT和FootCareMD®获得的所有信息的平均JAMA基准分别为0±0和1.95±0.15(p<0.001),分别。通过ChatGPT和FootCareMD®获得的所有信息的DISCERN评分分别为52.53±5.39和66.93±4.57(p<0.001),分别。与FootCareMD®上提供的类似信息相比,有关常见足部和踝关节病变的AI辅助查询的等级更高,可靠性和准确性较低。随着AI技术的易用性和增加,应考虑与足部和踝关节疾病的诊断和治疗有关的信息的性质和质量。证据级别:IV.
公众号