IEEE Trans Med Imaging. 2023 Dec;42(12):3895-3906. doi: 10.1109/TMI.2023.3314695. Epub 2023 Nov 30.
Chemical staining of the blood smears is one of the crucial components of blood analysis. It is an expensive, lengthy and sensitive process, often prone to produce slight variations in colour and seen structures due to a lack of unified protocols across laboratories. Even though the current developments in deep generative modeling offer an opportunity to replace the chemical process with a digital one, there are specific safety-ensuring requirements due to the severe consequences of mistakes in a medical setting. Therefore digital staining system would profit from an additional confidence estimation quantifying the quality of the digitally stained white blood cell. To this aim, during the staining generation, we disentangle the latent space of the Generative Adversarial Network, obtaining separate representation s of the white blood cell and the staining. We estimate the generated image's confidence of white blood cell structure and staining quality by corrupting these representations with noise and quantifying the information retained between multiple outputs. We show that confidence estimated in this way correlates with image quality measured in terms of LPIPS values calculated for the generated and ground truth stained images. We validate our method by performing digital staining of images captured with a Differential Inference Contrast microscope on a dataset composed of white blood cells of 24 patients. The high absolute value of the correlation between our confidence score and LPIPS demonstrates the effectiveness of our method, opening the possibility of predicting the quality of generated output and ensuring trustworthiness in medical safety-critical setup.
血液涂片的化学染色是血液分析的关键组成部分之一。这是一个昂贵、冗长且敏感的过程,由于实验室之间缺乏统一的协议,颜色和可见结构经常会出现细微的变化。尽管当前深度生成模型的发展为用数字技术取代化学过程提供了机会,但由于医疗环境中错误的严重后果,数字染色系统需要特定的安全保障要求。因此,数字染色系统将受益于额外的置信度估计,以量化数字化染色白细胞的质量。为此,在染色生成过程中,我们分离生成对抗网络的潜在空间,获得白细胞和染色的单独表示。我们通过用噪声破坏这些表示并量化多个输出之间保留的信息来估计生成图像的白细胞结构和染色质量的置信度。我们表明,以这种方式估计的置信度与根据生成的和真实染色图像计算的 LPIPS 值衡量的图像质量相关。我们通过对由 24 名患者的白细胞组成的数据集进行微分推理对比度显微镜拍摄的图像进行数字染色来验证我们的方法。我们的置信度得分和 LPIPS 之间的相关性的绝对值很高,证明了我们的方法的有效性,为预测生成输出的质量并确保在医疗安全关键设置中的可信度开辟了可能性。