关键词: artificial intelligence female stress urinary incontinence female urology survey study urinary incontinence

Mesh : Humans Urinary Incontinence, Stress / surgery Female Artificial Intelligence Practice Guidelines as Topic Urology / standards Surveys and Questionnaires Patient Education as Topic Societies, Medical

来  源:   DOI:10.1097/UPJ.0000000000000577

Abstract:
UNASSIGNED: Stress urinary incontinence (SUI) affects countless women worldwide. Given ChatGPT\'s rising ubiquity, patients may turn to the platform for SUI advice. Our objective was to evaluate the quality of clinical information about SUI from the ChatGPT platform.
UNASSIGNED: The most-asked patient questions regarding SUI were derived from patient materials from societal websites and forums, and queried using ChatGPT 3.5. The responses from ChatGPT were compiled into a survey and disseminated to 3 AUA guideline committee members who developed the Surgical Management of Female SUI guidelines. They were asked to grade responses on reliability, understandability, quality, and actionability using DISCERN and Patient Education Materials Assessment Tool standardized questionnaires. Accuracy was assessed with a 4-point Likert scale and readability using Flesch Reading Ease score.
UNASSIGNED: The overall material was rated as moderate to moderately high quality (DISCERN = 3.73/5) with potentially important but no serious shortcomings. Reliability and quality were reported to be 63% and 75%. Understandability was 89%, actionability 18%, and accuracy 88%. All question domains were rated at moderate or better. Actionability was poor in all domains. Every response was \"hard to read\" translating to a college graduate reading level.
UNASSIGNED: The urologic community should critically evaluate this platform\'s output if patients are to use it for adjunctive medical guidance. AUA committee members, who are experts in the field, rate ChatGPT-produced responses on SUI as moderate to moderately high quality, moderate reliability, excellent understandability, and poor actionability utilizing standardized questionnaires. The reading level of the material was advanced, which is an area of potential improvement to make generated responses more comprehensible.
摘要:
压力性尿失禁(SUI)影响着全世界无数的女性。鉴于ChatGPT的日益普及,患者可能会转向平台寻求SUI建议。我们的目标是评估来自ChatGPT平台的SUI临床信息的质量。
关于SUI的最多的患者问题来自社会网站和论坛的患者材料,并使用ChatGPT3.5进行查询。ChatGPT的回应被汇编成一项调查,并分发给3名AUA指南委员会成员,他们制定了女性SUI手术管理指南。他们被要求对回答的可靠性进行评级,可理解性,质量,使用DISCERN和患者教育材料评估工具标准化问卷的可操作性。使用4点Likert量表评估准确性,并使用FleschReadingEase评分评估可读性。
总体材料被评为中等至中等质量(DISCERN=3.73/5),具有潜在的重要但没有严重的缺点。可靠性和质量分别为63%和75%。可理解性为89%,可操作性18%,准确率为88%。所有问题域的评级均为中等或更好。所有领域的可操作性都很差。每个回答都是“难以阅读”,翻译成大学毕业生的阅读水平。
如果患者将其用于辅助医疗指导,泌尿科社区应严格评估该平台的输出。AUA委员会成员,他们是该领域的专家,ChatGPT在SUI上产生的响应率为中等至中等高质量,中等可靠性,优秀的可理解性,使用标准化问卷的可操作性较差。材料的阅读水平提高了,这是一个潜在的改进领域,可以使生成的响应更容易理解。
公众号