Computer Science ›› 2018, Vol. 45 ›› Issue (6): 270-274.doi: 10.11896/j.issn.1002-137X.2018.06.048

• Graphics, Image & Pattern Recognition • Previous Articles     Next Articles

Whole Frame Loss Concealment Method for Stereo Video Basedon Disparity Consistence

LIU Jing-hua, CHEN Jing   

  1. College of Information Science & Engineering,Huaqiao University,Xiamen,Fujian 361021,China;
    Xiamen Key Laboratory of Mobile Multimedia Communications,Xiamen,Fujian 361021,China
  • Received:2017-04-17 Online:2018-06-15 Published:2018-07-24

Abstract: A whole frame loss concealment method for stereoscopic video was proposed in this paper.It consists of two parts.Firstly,based on the consistency of object motions in neighboring views,the frame difference between the current and previous frame in the correctly received view is projected onto the view of lost frame via the estimated disparities.Then,the lost frame is recovered from the projected frame difference and its previous frame.Secondly,according to the characteristics of holes,two alternative methods are adaptively performed to effectively fill the holes.Experimental results show that the proposed frame loss concealment method for stereoscopic video can effectively restore the lost frame at the decoder and outperforms several existing methods.

Key words: Disparity estimation, Error concealment, Frame loss concealment, Stereoscopic video

CLC Number: 

  • TN919.8
[1]WANG Y,WENGER S,WEN J T,et al.Error resilient video coding techniques [J].IEEE Signal Processing Magazine,2000,17(4):61-82.
[2]ZHOU Y,YU M,JIANG G Y,et al.Right-view error concealment for stereoscopic video transmission [J].Journal of Optoelectronics·Laser,2011,22(4):600-606.(in Chinese)
周洋,郁梅,蒋刚毅,等.面向立体视频传输的右视点图像错误隐藏[J].光电子·激光,2011,22(4):600-606.
[3]GUO J C,ZHAO J J.Stereoscopic error concealment based on motion characteristic analysis [J].Journal of Electronics & Information Technology,2012,34(12):2809-2815.(in Chinese)
郭继昌,赵俊杰.基于运动特性分析的立体视频差错掩盖[J].电子与信息学报,2012,34(12):2809-2815.
[4]ZHOU Y,JIANG G Y,YU M,et al.Region-based error concealment of right-view frames for stereoscopic video transmission [J].Computers and Electrical Engineering,2012,38(2):217-230.
[5]YANG S,ZHAO Y,WANG S,et al.Error concealment for stereoscopic video using illumination compensation[J].IEEE Transactions on Consumer Electronics,2011,57(4):1907-1914.
[6]SUN H,LIU P L,WANG J,et al.An efficient frame loss error concealment scheme based on tentative projection for H.264/AVC [C]//Advances in Multimedia Information Processing(PCM 2010).2011:394-404.
[7]BILEN C,AKSAY A,AKAR G B.Motion and disparity aided stereoscopic full frame loss concealment method [C]//Signal Processing and Communications Applications.IEEE,2007:1-4.
[8]PANG L J,YU M,YI W J,et al.Relativity analysis-based error concealment algorithm for entire frame loss of stereo video [C]//International Conference on Signal Processing.2006:16-20.
[9]CHUNG T Y,SULL S,KIM C S.Frame Loss concealment for stereoscopic video plus depth sequences [J].IEEE Transactions on Consumer Electronics,2011,57(3):1336-1344.
[10]CHUNG T Y,SULL S,KIM C S.Frame loss concealment for stereoscopic video based on inter-view similarity of motion and intensity difference [C]//IEEE International Conference on Ima-ge Processing.2010:441-444.
[11]LIN T L,CHANG T,HUANG G X,et al.Improved interview video error concealment on whole frame packet loss [J].Journal of Visual Communication and Image Representation,2014,25(8):1811-1822.
[12]YAN K,YU M,PENG Z J,et al.A new low-complexity error concealment method for stereo video communication[J].Journal of Optoelectronices Laser,2015,26(11):2200-2208.
[13]GONZALES C,WOODS R E.Digital Image Processing(3rd Ed)[M].NewJersey,Addison-Wesley,2007:741-742.
[14]XIA Y Q,YANG J Y.Two level stereo match approach based on maximum-window [J].Computer Science,2006,33(3):208-211.(in Chinese)
夏永泉,杨静宇.基于最大窗口的二次立体匹配方法[J].计算机科学,2006,33(3):208-211.
[15]JVT reference software home page [OL].http://iphome.hhi.de/suehring/tml.
[16]ZHOU Y,XIANG W,WANG G K.Frame loss concealment for multiview video transmission over wireless multimedia sensor networks [J].IEEE Sensors Journal,2015,15(3):1892-1901.
[1] REN Yun, CHENG Fu-lin and LI Hong-song. Disparity Estimation Algorithm Based on Frequency Sensitive Three-dimensional Self-organizing Map [J]. Computer Science, 2017, 44(Z11): 225-227.
[2] WANG Xiao-dong,WANG Teng-fei,HU Bin-bin,JIANG Gang-yi and ZHANG Lian-jun. Frame-level Stereoscopic Video Transmission Distortion Model at Encoder [J]. Computer Science, 2014, 41(10): 160-163.
[3] QIU Jin-bo,FENG Bin,DENG Hui-ping,YU Li,ZHU Guang-xi. Intra Macro Block Refresh Approach for Wireless Video Transmission [J]. Computer Science, 2011, 38(6): 114-117.
[4] PAN Feng, MA Li-ni, DU Xiao-yu (Department of Computer Science, Beijing University of Information Science and Technology, Beijing 100085, China). [J]. Computer Science, 2008, 35(9): 252-254.
[5] XIA Yong-Quan , YANG Jing-Yu (Department of Computer Science & Technology, NJUST, Nanjing 210094). [J]. Computer Science, 2006, 33(3): 208-211.
[6] GAO Peng,  CHEN Yong-En (Department of Electronic and Information Engineering ,Tong,ji University , Shanghai 200092). [J]. Computer Science, 2006, 33(3): 84-86.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!