Lim David K, Rashid Naim U, Oliva Junier B, Ibrahim Joseph G
Department of Biostatistics, University of North Carolina at Chapel Hill.
Department of Computer Science, University of North Carolina at Chapel Hill.
J Comput Graph Stat. 2024;33(2):638-650. doi: 10.1080/10618600.2023.2276122. Epub 2023 Dec 15.
Deep Learning (DL) methods have dramatically increased in popularity in recent years, with significant growth in their application to various supervised learning problems. However, the greater prevalence and complexity of missing data in such datasets present significant challenges for DL methods. Here, we provide a formal treatment of missing data in the context of deeply learned generalized linear models, a supervised DL architecture for regression and classification problems. We propose a new architecture, , that is one of the first to be able to flexibly account for both ignorable and non-ignorable patterns of missingness in input features and response at training time. We demonstrate through statistical simulation that our method outperforms existing approaches for supervised learning tasks in the presence of missing not at random (MNAR) missingness. We conclude with a case study of the Bank Marketing dataset from the UCI Machine Learning Repository, in which we predict whether clients subscribed to a product based on phone survey data. Supplementary materials for this article are available online.
近年来,深度学习(DL)方法的受欢迎程度急剧上升,其在各种监督学习问题中的应用有了显著增长。然而,此类数据集中缺失数据的更普遍存在和复杂性给DL方法带来了重大挑战。在此,我们在深度广义线性模型的背景下对缺失数据进行了形式化处理,深度广义线性模型是一种用于回归和分类问题的监督式DL架构。我们提出了一种新的架构,它是最早能够在训练时灵活处理输入特征和响应中可忽略和不可忽略缺失模式的架构之一。我们通过统计模拟证明,在存在非随机缺失(MNAR)的情况下,我们的方法在监督学习任务中优于现有方法。我们以UCI机器学习库中的银行营销数据集为例进行了案例研究,在该研究中,我们根据电话调查数据预测客户是否订阅了某产品。本文的补充材料可在线获取。