Zhao Yawei, Liu Qinghe, Liu Pan, Liu Xinwang, He Kunlun
IEEE Trans Pattern Anal Mach Intell. 2025 Jan;47(1):433-449. doi: 10.1109/TPAMI.2024.3470072. Epub 2024 Dec 4.
Although data-driven methods usually have noticeable performance on disease diagnosis and treatment, they are suspected of leakage of privacy due to collecting data for model training. Recently, federated learning provides a secure and trustable alternative to collaboratively train model without any exchange of medical data among multiple institutes. Therefore, it has draw much attention due to its natural merit on privacy protection. However, when heterogenous medical data exists between different hospitals, federated learning usually has to face with degradation of performance. In the paper, we propose a new personalized framework of federated learning to handle the problem. It successfully yields personalized models based on awareness of similarity between local data, and achieves better tradeoff between generalization and personalization than existing methods. After that, we further design a differentially sparse regularizer to improve communication efficiency during procedure of model training. Additionally, we propose an effective method to reduce the computational cost, which improves computation efficiency significantly. Furthermore, we collect five real medical datasets, including two public medical image datasets and three private multi-center clinical diagnosis datasets, and evaluate its performance by conducting nodule classification, tumor segmentation, and clinical risk prediction tasks. Comparing with 14 existing related methods, the proposed method successfully achieves the best model performance, and meanwhile up to 60% improvement of communication efficiency.
尽管数据驱动的方法在疾病诊断和治疗方面通常具有显著的性能,但由于为模型训练收集数据,它们被怀疑存在隐私泄露问题。最近,联邦学习提供了一种安全可靠的替代方案,可在多个机构之间无需交换任何医疗数据的情况下协同训练模型。因此,它因其在隐私保护方面的天然优势而备受关注。然而,当不同医院之间存在异构医疗数据时,联邦学习通常不得不面临性能下降的问题。在本文中,我们提出了一种新的联邦学习个性化框架来解决这个问题。它基于对本地数据之间相似性的感知成功生成个性化模型,并且在泛化和个性化之间比现有方法实现了更好的权衡。之后,我们进一步设计了一种差分稀疏正则化器,以提高模型训练过程中的通信效率。此外,我们提出了一种有效的方法来降低计算成本,这显著提高了计算效率。此外,我们收集了五个真实的医疗数据集,包括两个公共医疗图像数据集和三个私人多中心临床诊断数据集,并通过进行结节分类、肿瘤分割和临床风险预测任务来评估其性能。与14种现有的相关方法相比,所提出的方法成功实现了最佳的模型性能,同时通信效率提高了60%。