IEEE Trans Image Process. 2014 Dec;23(12):5187-97. doi: 10.1109/TIP.2014.2362652. Epub 2014 Oct 9.
Video shot boundary detection (SBD) is the first step of video analysis, summarization, indexing, and retrieval. In SBD process, videos are segmented into basic units called shots. In this paper, a new SBD method is proposed using color, edge, texture, and motion strength as vector of features (feature vector). Features are extracted by projecting the frames on selected basis vectors of Walsh-Hadamard transform (WHT) kernel and WHT matrix. After extracting the features, based on the significance of the features, weights are calculated. The weighted features are combined to form a single continuity signal, used as input for Procedure Based shot transition Identification process (PBI). Using the procedure, shot transitions are classified into abrupt and gradual transitions. Experimental results are examined using large-scale test sets provided by the TRECVID 2007, which has evaluated hard cut and gradual transition detection. To evaluate the robustness of the proposed method, the system evaluation is performed. The proposed method yields F1-Score of 97.4% for cut, 78% for gradual, and 96.1% for overall transitions. We have also evaluated the proposed feature vector with support vector machine classifier. The results show that WHT-based features can perform well than the other existing methods. In addition to this, few more video sequences are taken from the Openvideo project and the performance of the proposed method is compared with the recent existing SBD method.
视频镜头边界检测(SBD)是视频分析、摘要、索引和检索的第一步。在 SBD 过程中,视频被分割成称为镜头的基本单元。在本文中,提出了一种新的 SBD 方法,该方法使用颜色、边缘、纹理和运动强度作为特征向量(特征向量)。通过将帧投影到沃尔什-哈达玛变换(WHT)核和 WHT 矩阵的选定基向量上提取特征。提取特征后,根据特征的重要性计算权重。加权特征被组合成单个连续信号,用作基于过程的镜头过渡识别过程(PBI)的输入。使用该过程,将镜头过渡分类为突然过渡和渐变过渡。使用 TRECVID 2007 提供的大型测试集检查实验结果,该测试集评估了硬切和渐变过渡检测。为了评估所提出方法的鲁棒性,进行了系统评估。所提出的方法在硬切、渐变和整体过渡方面的 F1 得分为 97.4%、78%和 96.1%。我们还使用支持向量机分类器评估了所提出的特征向量。结果表明,基于 WHT 的特征可以比其他现有方法表现更好。除此之外,还从 Openvideo 项目中获取了更多的视频序列,并将所提出的方法的性能与最近的现有 SBD 方法进行了比较。