Ye Mang, Shen Jianbing, Lin Gaojie, Xiang Tao, Shao Ling, Hoi Steven C H
IEEE Trans Pattern Anal Mach Intell. 2022 Jun;44(6):2872-2893. doi: 10.1109/TPAMI.2021.3054775. Epub 2022 May 5.
Person re-identification (Re-ID) aims at retrieving a person of interest across multiple non-overlapping cameras. With the advancement of deep neural networks and increasing demand of intelligent video surveillance, it has gained significantly increased interest in the computer vision community. By dissecting the involved components in developing a person Re-ID system, we categorize it into the closed-world and open-world settings. The widely studied closed-world setting is usually applied under various research-oriented assumptions, and has achieved inspiring success using deep learning techniques on a number of datasets. We first conduct a comprehensive overview with in-depth analysis for closed-world person Re-ID from three different perspectives, including deep feature representation learning, deep metric learning and ranking optimization. With the performance saturation under closed-world setting, the research focus for person Re-ID has recently shifted to the open-world setting, facing more challenging issues. This setting is closer to practical applications under specific scenarios. We summarize the open-world Re-ID in terms of five different aspects. By analyzing the advantages of existing methods, we design a powerful AGW baseline, achieving state-of-the-art or at least comparable performance on twelve datasets for four different Re-ID tasks. Meanwhile, we introduce a new evaluation metric (mINP) for person Re-ID, indicating the cost for finding all the correct matches, which provides an additional criteria to evaluate the Re-ID system for real applications. Finally, some important yet under-investigated open issues are discussed.
行人重识别(Re-ID)旨在通过多个不重叠的摄像头检索出感兴趣的行人。随着深度神经网络的发展以及智能视频监控需求的增加,它在计算机视觉领域引起了极大的关注。通过剖析开发行人Re-ID系统中涉及的组件,我们将其分为封闭世界和开放世界两种设置。广泛研究的封闭世界设置通常在各种面向研究的假设下应用,并且使用深度学习技术在许多数据集上取得了令人鼓舞的成功。我们首先从深度特征表示学习、深度度量学习和排序优化这三个不同的角度对封闭世界行人Re-ID进行全面概述并深入分析。随着封闭世界设置下性能趋于饱和,行人Re-ID的研究重点最近已转向开放世界设置,面临着更具挑战性的问题。这种设置更接近特定场景下的实际应用。我们从五个不同方面总结了开放世界Re-ID。通过分析现有方法的优点,我们设计了一个强大的AGW基线,在四个不同的Re-ID任务的十二个数据集上实现了当前最优或至少可比的性能。同时,我们为行人Re-ID引入了一种新的评估指标(mINP),它表示找到所有正确匹配的成本,为评估实际应用中的Re-ID系统提供了一个额外的标准。最后,讨论了一些重要但研究不足的开放问题。