一种基于平面运动视差不变性的立体视频整帧丢失重建技术

doi:10.11896/j.issn.1002-137X.2018.06.048

计算机科学 ›› 2018, Vol. 45 ›› Issue (6): 270-274.doi: 10.11896/j.issn.1002-137X.2018.06.048

一种基于平面运动视差不变性的立体视频整帧丢失重建技术

刘菁华, 陈婧

华侨大学信息科学与工程学院福建厦门361021;
厦门市移动多媒体通信重点实验室福建厦门361021

收稿日期:2017-04-17 出版日期:2018-06-15 发布日期:2018-07-24
作者简介:刘菁华(1980-),女,硕士,讲师,主要研究方向为多媒体信息处理与融合,E-mail:jinghualiu1215@yahoo.com.hk;陈婧(1980-),女,博士,副教授,主要研究方向为图像及视频信号处理,E-mail:chenjing8005@hqu.edu.cn(通信作者)
基金资助:
本文受福建省自然科学基金青年项目(2017J05103),华侨大学高层次人才资助项目(16BS709)资助

Whole Frame Loss Concealment Method for Stereo Video Basedon Disparity Consistence

LIU Jing-hua, CHEN Jing

College of Information Science & Engineering,Huaqiao University,Xiamen,Fujian 361021,China;
Xiamen Key Laboratory of Mobile Multimedia Communications,Xiamen,Fujian 361021,China

Received:2017-04-17 Online:2018-06-15 Published:2018-07-24

摘要/Abstract

摘要： 针对立体视频单个视点中的整帧丢失问题,提出基于平面运动视差不变性的差错隐藏方案。该方案主要包括两个部分:1)利用两个视点的运动一致性,根据视差定位目标位置,把正确接收视点的当前帧与前一帧的帧差投影到丢失帧所在视点,作为当前帧与前一帧的帧差,再由帧差及前一帧的像素值重建丢失的帧;2)根据空洞特征自适应地选择基于邻域的方法或基于运动向量的方法进行空洞填补。实验结果表明,所提算法能够高质量地重建丢失的帧,其重建质量优于现有算法。

关键词: 差错隐藏, 丢失帧重建, 立体视频, 视差估计

Abstract: A whole frame loss concealment method for stereoscopic video was proposed in this paper.It consists of two parts.Firstly,based on the consistency of object motions in neighboring views,the frame difference between the current and previous frame in the correctly received view is projected onto the view of lost frame via the estimated disparities.Then,the lost frame is recovered from the projected frame difference and its previous frame.Secondly,according to the characteristics of holes,two alternative methods are adaptively performed to effectively fill the holes.Experimental results show that the proposed frame loss concealment method for stereoscopic video can effectively restore the lost frame at the decoder and outperforms several existing methods.

Key words: Disparity estimation, Error concealment, Frame loss concealment, Stereoscopic video

中图分类号:

TN919.8

刘菁华, 陈婧. 一种基于平面运动视差不变性的立体视频整帧丢失重建技术[J]. 计算机科学, 2018, 45(6): 270-274. https://doi.org/10.11896/j.issn.1002-137X.2018.06.048

LIU Jing-hua, CHEN Jing. Whole Frame Loss Concealment Method for Stereo Video Basedon Disparity Consistence[J]. Computer Science, 2018, 45(6): 270-274. https://doi.org/10.11896/j.issn.1002-137X.2018.06.048

参考文献

[1]WANG Y,WENGER S,WEN J T,et al.Error resilient video coding techniques [J].IEEE Signal Processing Magazine,2000,17(4):61-82.
[2]ZHOU Y,YU M,JIANG G Y,et al.Right-view error concealment for stereoscopic video transmission [J].Journal of Optoelectronics·Laser,2011,22(4):600-606.(in Chinese)
周洋,郁梅,蒋刚毅,等.面向立体视频传输的右视点图像错误隐藏[J].光电子·激光,2011,22(4):600-606.
[3]GUO J C,ZHAO J J.Stereoscopic error concealment based on motion characteristic analysis [J].Journal of Electronics & Information Technology,2012,34(12):2809-2815.(in Chinese)
郭继昌,赵俊杰.基于运动特性分析的立体视频差错掩盖[J].电子与信息学报,2012,34(12):2809-2815.
[4]ZHOU Y,JIANG G Y,YU M,et al.Region-based error concealment of right-view frames for stereoscopic video transmission [J].Computers and Electrical Engineering,2012,38(2):217-230.
[5]YANG S,ZHAO Y,WANG S,et al.Error concealment for stereoscopic video using illumination compensation[J].IEEE Transactions on Consumer Electronics,2011,57(4):1907-1914.
[6]SUN H,LIU P L,WANG J,et al.An efficient frame loss error concealment scheme based on tentative projection for H.264/AVC [C]//Advances in Multimedia Information Processing(PCM 2010).2011:394-404.
[7]BILEN C,AKSAY A,AKAR G B.Motion and disparity aided stereoscopic full frame loss concealment method [C]//Signal Processing and Communications Applications.IEEE,2007:1-4.
[8]PANG L J,YU M,YI W J,et al.Relativity analysis-based error concealment algorithm for entire frame loss of stereo video [C]//International Conference on Signal Processing.2006:16-20.
[9]CHUNG T Y,SULL S,KIM C S.Frame Loss concealment for stereoscopic video plus depth sequences [J].IEEE Transactions on Consumer Electronics,2011,57(3):1336-1344.
[10]CHUNG T Y,SULL S,KIM C S.Frame loss concealment for stereoscopic video based on inter-view similarity of motion and intensity difference [C]//IEEE International Conference on Ima-ge Processing.2010:441-444.
[11]LIN T L,CHANG T,HUANG G X,et al.Improved interview video error concealment on whole frame packet loss [J].Journal of Visual Communication and Image Representation,2014,25(8):1811-1822.
[12]YAN K,YU M,PENG Z J,et al.A new low-complexity error concealment method for stereo video communication[J].Journal of Optoelectronices Laser,2015,26(11):2200-2208.
[13]GONZALES C,WOODS R E.Digital Image Processing(3rd Ed)[M].NewJersey,Addison-Wesley,2007:741-742.
[14]XIA Y Q,YANG J Y.Two level stereo match approach based on maximum-window [J].Computer Science,2006,33(3):208-211.(in Chinese)
夏永泉,杨静宇.基于最大窗口的二次立体匹配方法[J].计算机科学,2006,33(3):208-211.
[15]JVT reference software home page [OL].http://iphome.hhi.de/suehring/tml.
[16]ZHOU Y,XIANG W,WANG G K.Frame loss concealment for multiview video transmission over wireless multimedia sensor networks [J].IEEE Sensors Journal,2015,15(3):1892-1901.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

一种基于平面运动视差不变性的立体视频整帧丢失重建技术

Whole Frame Loss Concealment Method for Stereo Video Basedon Disparity Consistence

PDF (PC)

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 5

Metrics

本文评价

推荐阅读 0

[1]	任云,程福林,黎洪松. 基于频率敏感三维自组织映射的视差估计算法 Disparity Estimation Algorithm Based on Frequency Sensitive Three-dimensional Self-organizing Map 计算机科学, 2017, 44(Z11): 225-227. https://doi.org/10.11896/j.issn.1002-137X.2017.11A.047
[2]	王晓东,王腾飞,胡彬彬,蒋刚毅,章联军. 编码端帧级立体视频传输失真模型 Frame-level Stereoscopic Video Transmission Distortion Model at Encoder 计算机科学, 2014, 41(10): 160-163. https://doi.org/10.11896/j.issn.1002-137X.2014.10.036
[3]	潘峰马力妮杜小钰. 基于视差估计算法的多视点视频预测方案计算机科学, 2008, 35(9): 252-254.
[4]	夏永泉杨静宇. 基于最大窗口的二次立体匹配方法计算机科学, 2006, 33(3): 208-211.
[5]	胡飞朱光喜朱耀庭. Internet视频通信差错隐藏技术研究计算机科学, 2002, 29(4): 124-127.