IEEE Trans Med Imaging. 2022 May;41(5):1114-1124. doi: 10.1109/TMI.2021.3135147. Epub 2022 May 2.
The ideal observer (IO) sets an upper performance limit among all observers and has been advocated for assessing and optimizing imaging systems. For general joint detection and estimation (detection-estimation) tasks, estimation ROC (EROC) analysis has been established for evaluating the performance of observers. However, in general, it is difficult to accurately approximate the IO that maximizes the area under the EROC curve. In this study, a hybrid method that employs machine learning is proposed to accomplish this. Specifically, a hybrid approach is developed that combines a multi-task convolutional neural network and a Markov-Chain Monte Carlo (MCMC) method in order to approximate the IO for detection-estimation tasks. Unlike traditional MCMC methods, the hybrid method is not limited to use of specific utility functions. In addition, a purely supervised learning-based sub-ideal observer is proposed. Computer-simulation studies are conducted to validate the proposed method, which include signal-known-statistically/background-known-exactly and signal-known-statistically/background-known-statistically tasks. The EROC curves produced by the proposed method are compared to those produced by the MCMC approach or analytical computation when feasible. The proposed method provides a new approach for approximating the IO and may advance the application of EROC analysis for optimizing imaging systems.
理想观察者(IO)为所有观察者设定了一个上限性能,并被倡导用于评估和优化成像系统。对于一般的联合检测和估计(检测-估计)任务,已经建立了估计 ROC(EROC)分析来评估观察者的性能。然而,一般来说,很难准确地逼近最大化 EROC 曲线下面积的 IO。在这项研究中,提出了一种使用机器学习的混合方法来实现这一目标。具体来说,开发了一种混合方法,将多任务卷积神经网络和马尔可夫链蒙特卡罗(MCMC)方法结合起来,以便为检测-估计任务逼近 IO。与传统的 MCMC 方法不同,混合方法不受特定效用函数的限制。此外,还提出了一种基于纯监督学习的次理想观察者。进行了计算机模拟研究来验证所提出的方法,其中包括信号已知统计/背景完全已知和信号已知统计/背景已知统计任务。当可行时,将所提出方法生成的 EROC 曲线与 MCMC 方法或分析计算生成的 EROC 曲线进行比较。所提出的方法为逼近 IO 提供了一种新的方法,并可能推进 EROC 分析在优化成像系统中的应用。