Liu Kechun, Li Beibin, Wu Wenjun, May Caitlin, Chang Oliver, Knezevich Stevan, Reisch Lisa, Elmore Joann, Shapiro Linda
University of Washington.
Microsoft Research.
IEEE Winter Conf Appl Comput Vis. 2023 Jan;2023:1918-1927. doi: 10.1109/wacv56688.2023.00196. Epub 2023 Feb 6.
Detection of melanocytes serves as a critical prerequisite in assessing melanocytic growth patterns when diagnosing melanoma and its precursor lesions on skin biopsy specimens. However, this detection is challenging due to the visual similarity of melanocytes to other cells in routine Hematoxylin and Eosin (H&E) stained images, leading to the failure of current nuclei detection methods. Stains such as Sox10 can mark melanocytes, but they require an additional step and expense and thus are not regularly used in clinical practice. To address these limitations, we introduce VSGD-Net, a novel detection network that learns melanocyte identification through virtual staining from H&E to Sox10. The method takes only routine H&E images during inference, resulting in a promising approach to support pathologists in the diagnosis of melanoma. To the best of our knowledge, this is the first study that investigates the detection problem using image synthesis features between two distinct pathology stainings. Extensive experimental results show that our proposed model outperforms state-of-the-art nuclei detection methods for melanocyte detection. The source code and pre-trained model are available at: https://github.com/kechunl/VSGD-Net.
在对皮肤活检标本进行黑色素瘤及其前驱病变诊断时,检测黑素细胞是评估黑素细胞生长模式的关键前提。然而,由于在常规苏木精和伊红(H&E)染色图像中黑素细胞与其他细胞在视觉上相似,这种检测具有挑战性,导致当前的细胞核检测方法失效。诸如Sox10等染色剂可以标记黑素细胞,但它们需要额外的步骤和费用,因此在临床实践中并不经常使用。为了解决这些局限性,我们引入了VSGD-Net,这是一种新型检测网络,它通过从H&E到Sox10的虚拟染色来学习黑素细胞识别。该方法在推理过程中仅采用常规H&E图像,从而为支持病理学家诊断黑色素瘤提供了一种有前景的方法。据我们所知,这是第一项利用两种不同病理染色之间的图像合成特征来研究检测问题的研究。大量实验结果表明,我们提出的模型在黑素细胞检测方面优于现有的细胞核检测方法。源代码和预训练模型可在以下网址获取:https://github.com/kechunl/VSGD-Net。