Peng Jialun, Tu Muyang, Li Shengwei, Ding Xiong, Zhai Qilong, Wu Hongyu, Li Jinzheng
Department of Hepatobiliary Surgery, The Second Affiliated Hospital of Chongqing Medical University, No. 76, Linjiang Road, Chongqing, 400010, China.
Medical Imaging, Shengjing Hospital of China Medical University. No, 36 Sanhao Road, Heping District, Shenyang, 110004, Liaoning Province, China.
BMC Cancer. 2025 Sep 24;25(1):1428. doi: 10.1186/s12885-025-14825-2.
Despite its high fatality rate, pancreatic cancer remains largely overlooked by the public. The rise of short-form video platforms has made them hubs for health-related content, yet the quality and reliability of this information are often in doubt.
This study is poised to scrutinize the quality and trustworthiness of videos pertaining to pancreatic cancer across these digital landscapes.
We analyzed the content and publishers of such videos on TikTok, Bilibili, and Kwai using the Global Quality Scale (GQS), modified DISCERN (mDISCERN), and Medical Quality Video Evaluation Tool (MQ-VET). We also correlated the findings with video rankings and compared the quality between the Chinese and USA platforms in 2023 and 2024.
In 2023, 300 videos were analyzed with median scores indicating medium quality but low reliability, the median GQS, mDISCERN and MQ-VET scores were 2, 2 and 45, respectively. The short videos created by medical practitioners demonstrated significantly higher median scores compared to those by non-medical practitioners in GQS scores (3 [IQR, 2-4] vs. 2 [IQR, 2-3]; P < 0.001), mDISCERN scores (2 [IQR, 2-3] vs. 2 [IQR, 1-2]; P < 0.001), and MQ-VET scores (46 [IQR, 40-52] vs. 37 [IQR, 30-45.5]; P < 0.001). mDISCERN scores showed superiority in treatment-related (3 [IQR, 2-3]), prevention-related (3 [IQR, 2.75-3]), and disease-related videos (including anatomical, pathologic, epidemiologic, and basic research related to pancreatic cancer)(2 [IQR, 2-3]) compared to News and Reports (2 [IQR, 1-2]) and invalid information content (1 [IQR, 1-1]; P < 0.001). TikTok had significantly higher mDISCERN scores (2 [IQR, 2-3] vs Bilibili: 2 [IQR, 1.75-3]; P = 0.024) and MQ-VET scores (47 [IQR, 43-53.5] vs Kwai: 44.5 [IQR, 38.25-49.75]; P = 0.033) for medical professional videos. Video quality showed a weak correlation with rankings. And the GQS scores of short videos in China in 2024 decreased compared with that in 2023 (2 [IQR, 2-3] vs 3 [IQR, 2-4]; P = 0.009). Additionally, in 2024, both medical and non-medical practitioners' videos on the Chinese TikTok platform exhibited lower quality and reliability compared to their counterparts in the USA.
Pancreatic cancer-related short videos are of medium quality and low reliability, particularly on Chinese platforms. Videos from medical professionals are more trustworthy. There is a need for better curation and algorithms to ensure accurate health information dissemination and to enhance public understanding and management of pancreatic cancer.
尽管胰腺癌死亡率很高,但在很大程度上仍被公众忽视。短视频平台的兴起使其成为健康相关内容的汇聚地,然而这些信息的质量和可靠性常常受到质疑。
本研究旨在审视这些数字平台上与胰腺癌相关视频的质量和可信度。
我们使用全球质量量表(GQS)、改良的DISCERN(mDISCERN)和医学质量视频评估工具(MQ-VET),分析了TikTok、哔哩哔哩和快手上此类视频的内容和发布者。我们还将研究结果与视频排名相关联,并比较了2023年和2024年中国和美国平台上视频的质量。
2023年,共分析了300个视频,中位数分数表明质量中等但可靠性较低,GQS、mDISCERN和MQ-VET的中位数分数分别为2、2和45。与非医学从业者制作的短视频相比,医学从业者制作的短视频在GQS分数(3[四分位距,2 - 4]对2[四分位距,2 - 3];P < 0.001)、mDISCERN分数(2[四分位距,2 - 3]对2[四分位距,1 - 2];P < 0.001)和MQ-VET分数(46[四分位距,40 - 52]对37[四分位距,30 - 45.5];P < 0.001)方面显著更高。与新闻报道(2[四分位距,1 - 2])和无效信息内容(1[四分位距,1 - 1];P < 0.001)相比,mDISCERN分数在治疗相关(3[四分位距,2 - 3])、预防相关(3[四分位距,2.75 - 3])以及疾病相关视频(包括与胰腺癌相关的解剖学、病理学、流行病学和基础研究)(2[四分位距,2 - 3])中表现更优。对于医学专业视频,TikTok的mDISCERN分数(2[四分位距,2 - 3]对比哔哩哔哩:2[四分位距,1.75 - 3];P = 0.024)和MQ-VET分数(47[四分位距,43 - 53.5]对比快手:44.5[四分位距,38.25 - 49.75];P = 0.033)显著更高。视频质量与排名之间存在弱相关性。2024年中国短视频的GQS分数与2023年相比有所下降(2[四分位距,2 - 3]对3[四分位距,2 - 4];P = 0.009)。此外,2024年中国TikTok平台上医学和非医学从业者的视频与美国同行相比,质量和可靠性均较低。
与胰腺癌相关的短视频质量中等但可靠性较低,尤其是在中国平台上。医学专业人士制作的视频更值得信赖。需要更好的管理和算法来确保准确的健康信息传播,并加强公众对胰腺癌的理解和管理。