Computer Science ›› 2016, Vol. 43 ›› Issue (6): 289-293.doi: 10.11896/j.issn.1002-137X.2016.06.057

Previous Articles     Next Articles

Method of Key Frames Extraction Based on Double-threshold Values Sliding Window Sub-shot Segmentation and Fully Connected Graph

ZHONG Xian, YANG Guang and LU Yan-sheng   

  • Online:2018-12-01 Published:2018-12-01

Abstract: With the development of multimedia technology,multimedia information is becoming more and more common in our life and work.How to efficiently retrieve the useful information in massive amounts of video information is becoming a more and more serious problem.In order to solve the above problems,this paper presented a method of key frames extraction from key frames based on double-threshold sliding window sub shot segmentation and fully connected graph.Firstly,it uses the double-threshold-based shot segmentation method, and gets the mutation boundary and the gradient boundary of a shot by setting double-threshold sliding window in order to divide the shot.Then,it uses the sub-shot segmentation method based on sliding window that adds a sliding window to the video frame sequence,and divides the shot again according to the frame differences at the range of a certain window.Finally,it uses key frame extraction method based on sub-shot segmentation,which regards the sub-shot as a fully connected graph.In this graph,the vertex is treated as a frame,the edge is treated as the frame difference so as to extract the key frames.The experimental results show that the method proposed in this paper has higher average accuracy and a less average number of key frames compared to baselines.Therefore,we can use this method to extract the key frames of video efficiently.

Key words: Sub shot segmentation,Key frame extraction,Double threshold values sliding window,Fully connected graph

[1] Dai Ke-xue,Li Qiang,Li Guo-hui.Video Mining Research [J].Computer Science,2010,37(10):11-15(in Chinese) 代科学,李强,李国辉.视频挖掘研究进展[J].计算机科学,2010,37(10):11-15
[2] Wei Wei,You Jing,Liu Feng-yu,et al.Semantic video retrieval Review [J] Computer Science,2006,33(2):1-7(in Chinese) 魏维,游静,刘凤玉,等.语义视频检索综述[J].计算机科学,2006,33(2):1-7
[3] Qu Zhong,Gao Teng-fei,Zhang Qing-qing.An improved video key frame extraction algorithm [J].Computer Science,2012,39 (8):300-303(in Chinese) 瞿中,高腾飞,张庆庆.一种改进的视频关键帧提取算法研究[J].计算机科学,2012,39(8):300-303
[4] Nagasaka A,Tanaka Y.Automatic video indexing and full-video search for object appearances [C]∥Proceedings of the IFIP TC2/WG2.6 2nd Working Conference on Visual Database Systems II.1992:113-127
[5] Ardizzone E,La Cascia M.Automatic video database indexingand retrieval [J].Multimedia Tools and Applications,1997,4(1):29-56
[6] Zhang H J,Wu J,Zhong D,et al.An integrated system for content-based video retrieval and browsing [J].Pattern Recognition,1997,0(4):643-658
[7] Zeng Wei,Xue Xiang-yang.Review retrieve video informationbased on the motion characteristics[J].Computer Science,2004,31 (2):135-138(in Chinese) 曾玮,薛向阳.基于运动特征的视频信息检索综述[J].计算机科学,2004,31(2):135-138
[8] Liu T,Zhang H J,Qi F.A novel video key-frame-extraction algorithm based on perceived motion energy model [J].IEEE Transactions on Circuits and Systems for Video Technology,2003,13(10):1006-1013
[9] Ma Y,Chang Y,Yuan H.Key-frame extraction based on motion acceleration[J].Optical Engineering,2008,7(9):957-966
[10] Wolf W.Key frame selection by motion analysis[C]∥Confe-rence Proceedings of IEEE International Conference on Acoustics,Speech,and Signal Processing(ICASSP96).1996,2:1228-1231
[11] Divakaran A,Radhakrishnan R,Peker K A.Video summarization using descriptors of motion activity:A motion activity based approach to key-frame extraction from video shots [J].Journal of Electronic Imaging,2001,0(4):909-916
[12] Hui Wen,Zhao Hai-ying,Lin Chuang,et al.Video forensics research based on content [J].Computer Science,2012,39 (1):27-31(in Chinese) 惠雯,赵海英,林闯,等.基于内容的视频取证研究[J].计算机科学,2012,39(1):27-31
[13] Chang H S,Sull S,Lee S U.Efficient video indexing scheme for content-based retrieval [J].IEEE Transactions on Circuits and Systems for Video Technology,1999,9(8):1269-1279
[14] Zhao L,Qi W,Li S Z,et al.Key-frame extraction and shot retrieval using nearest feature line (NFL)[C]∥Proceedings of the 2000 ACM workshops on Multimedia.2000:217-220
[15] Hanjalic A,Zhang H J.An integrated scheme for automated vi-deo abstraction based on unsupervised cluster-validity analysis [J].IEEE Transactions on Circuits and Systems for Video Technology,1999,9(8):1280-1289
[16] Yang S,Lin X.Key frame extraction using unsupervised clustering based on a statistical model [J].Tsinghua Science & Technology,2005,0(2):169-173
[17] Doucet A,Godsill S,Andrieu C.On sequential Monte Carlo sampling methods for Bayesian filtering[J].Statistics and Computing,2000,0(3):197-208
[18] Lo C C,Wang S J.Video segmentation using a histogram-based fuzzy c-means clustering algorithm[J].Computer Standards & Interfaces,2001,3(5):429-438
[19] Zhang H J,Kankanhalli A,Smoliar S W.Automatic partitioning of full-motion video [J].Multimedia Systems,1993,1(1):10-28
[20] Liu D,Shyu M L,Chen C,et al.Within and between shot information utilization in video key frame extraction[J].Journal of Information & Knowledge Management,2011,0(03):247-259
[21] Pan R,Tian Y,Wang Z.Key-frame extraction based on clustering [C]∥IEEE International Conference on Progress in Informatics and Computing(PIC).2010,2:867-871
[22] Yang Y,Cui Z,Wu J,et al.Traffic Video Segmentation and Key Frame Extraction Using Improved Global K-Means Clustering[C]∥IEEE International Symposium on Information Science and Engineering(ISISE).2010:521-525
[23] Pan L,Wu X,Shu X.Key Frame Extraction Based on Sub-Shot Segmentation and Entropy Computing[C]∥IEEE Chinese Conference on Pattern Recognition(CCPR).2009:1-5

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!