Viñuela Florido Manuel, Suárez Aguilar Javier, Maldonado Andrés A, Cristóbal Velasco Lara
Ann Plast Surg. 2024 Oct 1;93(4):409-412. doi: 10.1097/SAP.0000000000004045. Epub 2024 Aug 2.
The deep inferior epigastric perforator (DIEP) flap is currently one of the main options in breast reconstruction. The information about this surgery is critical for the patient, in order to choose the breast reconstruction method. Our study aims to analyze and compare the quality and accuracy of the information related to the DIEP flap reconstruction method provided by social media platforms (SMPs) and the new large language models (LLMs).
A total of 50 videos in English and Spanish were selected from the main SMPs (YouTube, Instagram, and Facebook) using the keywords "DIEP flap" and "colgajo DIEP." The duration, number of likes, dislikes, number of visits, upload date, author, and the video category (institutional video, media, patient experience, academic, and surgery) were analyzed. 3 specific questions were asked to 2 new LLMs (ChatGPT and Google Bard). The quality of information in SMPs and LLMs was analyzed and compared by 2 independent board-certified plastic surgeons using the Journal of American Medical Association and DISCERN scales.
LLMs showed a statistically significant higher quality of information when compared with SMPs based on the DISCERN scores. The average DISCERN scores for answers given by ChatGPT and Google Bard were 54 ± 6.841 and 61.17 ± 6.306, respectively (good quality). In SMPs, the average scores were 2.31 ± 0.67 (insufficient quality) and 32.87 ± 9.62 (low quality) for the Journal of American Medical Association and DISCERN scales respectively. Thirty-eight percent of the videos in SMPs were performed by nonmedical authors.
The quality of information for breast reconstruction using DIEP flaps from LLMs was considered good and significantly better than in SMPs. The information found in SMPs was insufficient and of low quality. Academic plastic surgeons have an opportunity to provide quality content on this type of reconstruction in LLM and SMPs.
腹壁下深动脉穿支（DIEP）皮瓣目前是乳房重建的主要选择之一。有关该手术的信息对患者至关重要，以便其选择乳房重建方法。我们的研究旨在分析和比较社交媒体平台（SMPs）和新型大语言模型（LLMs）提供的与DIEP皮瓣重建方法相关信息的质量和准确性。
使用关键词“DIEP皮瓣”和“DIEP皮瓣手术”从主要的SMPs（YouTube、Instagram和Facebook）中选取了50个英文和西班牙文视频。分析了视频时长、点赞数、点踩数、访问量、上传日期、作者以及视频类别（机构视频、媒体、患者体验、学术和手术）。向2个新型大语言模型（ChatGPT和谷歌巴德）提出了3个具体问题。由2名独立的获得美国整形外科委员会认证的整形外科医生使用《美国医学会杂志》和DISCERN量表分析和比较SMPs和LLMs中的信息质量。
根据DISCERN评分，与SMPs相比，LLMs显示出在统计学上显著更高的信息质量。ChatGPT和谷歌巴德给出答案的平均DISCERN评分分别为54±6.841和61.17±6.306（质量良好）。在SMPs中，《美国医学会杂志》和DISCERN量表的平均评分分别为2.31±0.67（质量不足）和32.87±9.62（质量低）。SMPs中38%的视频由非医学作者制作。
LLMs中关于使用DIEP皮瓣进行乳房重建的信息质量被认为良好，且明显优于SMPs中的信息。在SMPs中发现的信息不足且质量较低。学术整形外科医生有机会在LLMs和SMPs中提供有关此类重建的高质量内容。
