Nusrat Nowrin, Rahman M S
Institute of Statistical Research and Training, University of Dhaka, Dhaka, Bangladesh.
J Appl Stat. 2021 Sep 17;49(16):4254-4277. doi: 10.1080/02664763.2021.1977260. eCollection 2022.
Separation or monotone-likelihood can be observed in fitting process of a multinomial logistic model using maximum likelihood estimation (MLE) when sample size is small and/or one of the outcome categories is rare and/or there is one or more influential covariates, resulting in infinite or biased estimate of at least one regression coefficient of the model. This study investigated empirically to identify the optimal data condition to define both 'separation' and 'near-to-separation' (partial separation) and explored their consequences in MLE and provided a solution by applying a penalized likelihood approach, which has been proposed in the literature, by adding a Jeffreys prior-based penalty term to the original likelihood function to remove the first-order bias in the MLEs of the multinomial logit model via equivalent Poisson regression. Furthermore, the penalized estimating equation (PMLE) is extended to a weighted estimating equation allowing for survey-weight for analyzing data from a complex survey. The simulation study suggests that the PMLE outperforms the MLE by providing smaller amount of bias and mean squared of error and better coverage. The methods are applied to analyze data on choice of health facility for treatment of childhood diseases.
在使用最大似然估计(MLE)拟合多项逻辑模型的过程中,当样本量较小和/或其中一个结果类别罕见和/或存在一个或多个有影响的协变量时,可能会出现分离或单调似然情况,从而导致模型的至少一个回归系数的估计值无穷大或有偏差。本研究进行了实证调查,以确定定义“分离”和“接近分离”(部分分离)的最佳数据条件,并探讨它们在MLE中的后果,并通过应用文献中提出的惩罚似然方法提供了一种解决方案,即在原始似然函数中添加基于杰弗里斯先验的惩罚项,通过等效泊松回归消除多项逻辑模型MLE中的一阶偏差。此外,惩罚估计方程(PMLE)扩展为允许进行调查加权的加权估计方程,以分析来自复杂调查的数据。模拟研究表明,PMLE通过提供较小的偏差量和均方误差以及更好的覆盖率,优于MLE。这些方法被应用于分析关于儿童疾病治疗的医疗机构选择的数据。