Suppr超能文献

基于 Walsh-Hadamard 变换核的特征向量用于镜头边界检测。

Walsh-Hadamard transform kernel-based feature vector for shot boundary detection.

出版信息

IEEE Trans Image Process. 2014 Dec;23(12):5187-97. doi: 10.1109/TIP.2014.2362652. Epub 2014 Oct 9.

Abstract

Video shot boundary detection (SBD) is the first step of video analysis, summarization, indexing, and retrieval. In SBD process, videos are segmented into basic units called shots. In this paper, a new SBD method is proposed using color, edge, texture, and motion strength as vector of features (feature vector). Features are extracted by projecting the frames on selected basis vectors of Walsh-Hadamard transform (WHT) kernel and WHT matrix. After extracting the features, based on the significance of the features, weights are calculated. The weighted features are combined to form a single continuity signal, used as input for Procedure Based shot transition Identification process (PBI). Using the procedure, shot transitions are classified into abrupt and gradual transitions. Experimental results are examined using large-scale test sets provided by the TRECVID 2007, which has evaluated hard cut and gradual transition detection. To evaluate the robustness of the proposed method, the system evaluation is performed. The proposed method yields F1-Score of 97.4% for cut, 78% for gradual, and 96.1% for overall transitions. We have also evaluated the proposed feature vector with support vector machine classifier. The results show that WHT-based features can perform well than the other existing methods. In addition to this, few more video sequences are taken from the Openvideo project and the performance of the proposed method is compared with the recent existing SBD method.

摘要

视频镜头边界检测(SBD)是视频分析、摘要、索引和检索的第一步。在 SBD 过程中,视频被分割成称为镜头的基本单元。在本文中,提出了一种新的 SBD 方法,该方法使用颜色、边缘、纹理和运动强度作为特征向量(特征向量)。通过将帧投影到沃尔什-哈达玛变换(WHT)核和 WHT 矩阵的选定基向量上提取特征。提取特征后,根据特征的重要性计算权重。加权特征被组合成单个连续信号,用作基于过程的镜头过渡识别过程(PBI)的输入。使用该过程,将镜头过渡分类为突然过渡和渐变过渡。使用 TRECVID 2007 提供的大型测试集检查实验结果,该测试集评估了硬切和渐变过渡检测。为了评估所提出方法的鲁棒性,进行了系统评估。所提出的方法在硬切、渐变和整体过渡方面的 F1 得分为 97.4%、78%和 96.1%。我们还使用支持向量机分类器评估了所提出的特征向量。结果表明,基于 WHT 的特征可以比其他现有方法表现更好。除此之外,还从 Openvideo 项目中获取了更多的视频序列,并将所提出的方法的性能与最近的现有 SBD 方法进行了比较。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验