背景:近年来,人工智能(AI)在医疗保健中的应用范围不断扩大,这些工具,如ChatGPT,以生成面向患者的信息已经引起了特别的兴趣。因此,由学术/专业(A/P)来源提供的在线唇裂(CL/P)手术信息针对ChatGPT进行了准确性评估,全面性,和清晰度。
方法:11名整形外科医生和29名非医疗人员盲目比较了ChatGPT或A/P来源对30个常见CL/P手术问题的回答。外科医生表示偏爱,确定的准确性,并得分全面和清晰。非医疗个体表示偏好。使用七个可读性公式确定可读性得分的计算。使用配对t检验对CL/P手术在线信息进行统计学分析。
结果:外科医生,60.88%的时间,盲目偏好ChatGPT产生的材料,而不是A/P来源。此外,外科医生一致表明,ChatGPT产生的材料更全面,更清晰.在准确性方面,ChatGPT与专业组织提供的资源之间没有显着差异。在没有医学背景的人中,ChatGPT产生的材料在60.46%的时间是优选的。对于来自ChatGPT和A/P来源的材料,在7个可读性公式中,患者熟练程度的可读性得分超过建议水平.
结论:随着基于ChatGPT的语言工具在医疗保健领域的重要性上升,这些工具的潜在应用应由专家根据现有的高质量来源进行评估。我们的结果表明,ChatGPT能够在精度方面生产高质量的材料,全面性,和清晰度首选的整形外科医生和个人没有医学背景。
BACKGROUND: The application of artificial intelligence (AI) in healthcare has expanded in recent years, and these tools such as ChatGPT to generate patient-facing information have garnered particular interest. Online cleft lip and palate (CL/P) surgical information supplied by academic/professional (A/P) sources was therefore evaluated against ChatGPT regarding accuracy, comprehensiveness, and
clarity.
METHODS: 11 plastic and reconstructive surgeons and 29 non-medical individuals blindly compared responses written by ChatGPT or A/P sources to 30 frequently asked CL/P surgery questions. Surgeons indicated preference, determined accuracy, and scored comprehensiveness and
clarity. Non-medical individuals indicated preference. Calculations of readability scores were determined using seven readability formulas. Statistical analysis of CL/P surgical online information was performed using paired t-tests.
RESULTS: Surgeons, 60.88% of the time, blindly preferred material generated by ChatGPT over A/P sources. Additionally, surgeons consistently indicated that ChatGPT-generated material was more comprehensive and had greater
clarity. No significant difference was found between ChatGPT and resources provided by professional organizations in terms of accuracy. Among individuals with no medical background, ChatGPT-generated materials were preferred 60.46% of the time. For materials from both ChatGPT and A/P sources, readability scores surpassed advised levels for patient proficiency across seven readability formulas.
CONCLUSIONS: As the prominence of ChatGPT-based language tools rises in the healthcare space, potential applications of the tools should be assessed by experts against existing high-quality sources. Our results indicate that ChatGPT is capable of producing high-quality material in terms of accuracy, comprehensiveness, and
clarity preferred by both plastic surgeons and individuals with no medical background.