Artificial Intelligence Medical Research Center, School of Intelligent Systems Engineering, Shenzhen Campus of Sun Yat-sen University, Shenzhen, China.
AI for Science (AI4S)-Preferred Program, School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen, China.
Commun Biol. 2024 Nov 5;7(1):1440. doi: 10.1038/s42003-024-07171-9.
Measurement techniques often result in domain gaps among batches of cellular data from a specific modality. The effectiveness of cross-batch annotation methods is influenced by inductive bias, which refers to a set of assumptions that describe the behavior of model predictions. Different annotation methods possess distinct inductive biases, leading to varying degrees of generalizability and interpretability. Given that certain cell types exhibit unique functional patterns, we hypothesize that the inductive biases of cell annotation methods should align with these biological patterns to produce meaningful predictions. In this study, we propose KIDA, Knowledge-based Inductive bias and Domain Adaptation. The knowledge-based inductive bias constrains the prediction rules learned from the reference dataset, composed of multiple batches, to functional patterns relevant to biology, thereby enhancing the generalization of the model to unseen batches. Since the query dataset also contains gaps from multiple batches, KIDA's domain adaptation employs pseudo labels for self-knowledge distillation, effectively narrowing the distribution gap between model predictions and the query dataset. Benchmark experiments demonstrate that KIDA is capable of achieving accurate cross-batch cell type annotation.
测量技术通常会导致来自特定模态的细胞数据批次之间出现领域差距。跨批次标注方法的有效性受到归纳偏差的影响,归纳偏差是指一组描述模型预测行为的假设。不同的标注方法具有不同的归纳偏差,导致不同程度的泛化能力和可解释性。鉴于某些细胞类型表现出独特的功能模式,我们假设细胞标注方法的归纳偏差应该与这些生物学模式相匹配,以产生有意义的预测。在这项研究中,我们提出了 KIDA,基于知识的归纳偏差和领域自适应。基于知识的归纳偏差约束了从由多个批次组成的参考数据集中学到的预测规则,使其符合与生物学相关的功能模式,从而提高了模型对未见批次的泛化能力。由于查询数据集也包含来自多个批次的差距,KIDA 的领域自适应采用伪标签进行自我知识蒸馏,有效地缩小了模型预测和查询数据集之间的分布差距。基准实验表明,KIDA 能够实现准确的跨批次细胞类型标注。