Zhao Jing, Zhang Yi, Sun Shiliang, Dai Haiwei
School of Computer Science and Technology, East China Normal University, Shanghai 200062, China.
Entropy (Basel). 2021 Sep 30;23(10):1290. doi: 10.3390/e23101290.
Hidden Markov model (HMM) is a vital model for trajectory recognition. As the number of hidden states in HMM is important and hard to be determined, many nonparametric methods like hierarchical Dirichlet process HMMs and Beta process HMMs (BP-HMMs) have been proposed to determine it automatically. Among these methods, the sampled BP-HMM models the shared information among different classes, which has been proved to be effective in several trajectory recognition scenes. However, the existing BP-HMM maintains a state transition probability matrix for each trajectory, which is inconvenient for classification. Furthermore, the approximate inference of the BP-HMM is based on sampling methods, which usually takes a long time to converge. To develop an efficient nonparametric sequential model that can capture cross-class shared information for trajectory recognition, we propose a novel variational BP-HMM model, in which the hidden states can be shared among different classes and each class chooses its own hidden states and maintains a unified transition probability matrix. In addition, we derive a variational inference method for the proposed model, which is more efficient than sampling-based methods. Experimental results on a synthetic dataset and two real-world datasets show that compared with the sampled BP-HMM and other related models, the variational BP-HMM has better performance in trajectory recognition.
隐马尔可夫模型(HMM)是轨迹识别中的一个重要模型。由于HMM中隐藏状态的数量很重要且难以确定,因此人们提出了许多非参数方法,如分层狄利克雷过程HMM和贝塔过程HMM(BP-HMM)来自动确定它。在这些方法中,采样BP-HMM对不同类别之间的共享信息进行建模,已被证明在多个轨迹识别场景中是有效的。然而,现有的BP-HMM为每个轨迹维护一个状态转移概率矩阵,这对于分类来说不方便。此外,BP-HMM的近似推断基于采样方法,通常需要很长时间才能收敛。为了开发一种能够捕获跨类别共享信息以进行轨迹识别的高效非参数序列模型,我们提出了一种新颖的变分BP-HMM模型,其中隐藏状态可以在不同类别之间共享,并且每个类别选择自己的隐藏状态并维护一个统一的转移概率矩阵。此外,我们为所提出的模型推导了一种变分推断方法,该方法比基于采样的方法更有效。在一个合成数据集和两个真实世界数据集上的实验结果表明,与采样BP-HMM和其他相关模型相比,变分BP-HMM在轨迹识别中具有更好的性能。