Hou Jen-Cheng, Li Chin-Jou, Chou Chien-Chen, Shih Yen-Cheng, Fong Si-Lei, Dufau Stephane E, Lin Po-Tso, Tsao Yu, McGonigal Aileen, Yu Hsiang-Yu
Research Center for Information Technology Innovation, Academia Sinica, Taipei, Taiwan.
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan.
Mayo Clin Proc Digit Health. 2023 Nov 24;1(4):619-628. doi: 10.1016/j.mcpdig.2023.10.004. eCollection 2023 Dec.
To investigate the feasibility and accuracy of artificial intelligence (AI) methods of facial deidentification in hospital-recorded epileptic seizure videos, for improved patient privacy protection while preserving clinically important features of seizure semiology.
Videos of epileptic seizures displaying seizure-related involuntary facial changes were selected from recordings at Taipei Veterans General Hospital Epilepsy Unit (between August 1, 2020 and February 28, 2023), and a single representative video frame was prepared per seizure. We tested 3 AI transformation models: (1) morphing the original facial image with a different male face; (2) substitution with a female face; and (3) cartoonization. Facial deidentification and preservation of clinically relevant facial detail were calculated based on: (1) scoring by 5 independent expert clinicians and (2) objective computation.
According to the clinician scoring of 26 facial frames in 16 patients, the best compromise between deidentification and preservation of facial semiology was the cartoonization model. A male facial morphing model was superior to the cartoonization model for deidentification, but clinical detail was sacrificed. Objective similarity testing of video data reported deidentification scores in agreement with the clinicians' scores; however, preservation of semiology gave mixed results likely due to inadequate existing comparative databases.
Artificial intelligence-based face transformation of medical seizure videos is feasible and may be useful for patient privacy protection. In our study, the cartoonization approach provided the best compromise between deidentification and preservation of seizure semiology.
探讨人工智能(AI)方法对医院记录的癫痫发作视频进行面部去识别的可行性和准确性,以在保护癫痫发作符号学临床重要特征的同时,更好地保护患者隐私。
从台北荣民总医院癫痫科(2020年8月1日至2023年2月28日)的记录中选取显示与癫痫发作相关的非自愿面部变化的癫痫发作视频,并为每次发作准备一个代表性视频帧。我们测试了3种AI变换模型:(1)用不同男性面部对原始面部图像进行变形;(2)用女性面部替换;(3)卡通化。基于以下两点对面部去识别和临床相关面部细节的保留进行计算:(1)由5名独立专家临床医生评分;(2)客观计算。
根据16例患者26个面部帧的临床医生评分,去识别和保留面部符号学之间的最佳折衷方案是卡通化模型。男性面部变形模型在去识别方面优于卡通化模型,但牺牲了临床细节。视频数据的客观相似性测试报告的去识别分数与临床医生的分数一致;然而,由于现有的比较数据库不足,符号学的保留结果参差不齐。
基于人工智能的医学癫痫发作视频面部变换是可行的,可能有助于保护患者隐私。在我们的研究中,卡通化方法在去识别和保留癫痫发作符号学之间提供了最佳折衷方案。