计算机科学 ›› 2019, Vol. 46 ›› Issue (3): 154-158.doi: 10.11896/j.issn.1002-137X.2019.03.023

• 2018 中国多媒体大会 • 上一篇    下一篇

基于场景切变和内容特征检测的去隔行算法

朱小涛,李燕平,黄媛,黄倩   

  1. 河海大学计算机与信息学院 南京 211100
  • 收稿日期:2018-07-16 修回日期:2018-09-19 出版日期:2019-03-15 发布日期:2019-03-22
  • 通讯作者: 黄倩(1981-),男,博士,副研究员,CCF高级会员,主要研究方向为多媒体计算、大数据分析、机器人教育等,E-mail:huangqian@hhu.edu.cn(通信作者)。
  • 作者简介:朱小涛(1991-),女,硕士,主要研究方向为视频处理,E-mail:1695669216@qq.com;李燕平(1993-),女,硕士生,CCF学生会员,主要研究方向为视频处理、机器学习;黄媛(1994-),女,硕士生,CCF学生会员,主要研究方向为视频处理、机器学习.
  • 基金资助:
    国家重点研发计划(2018YFC0407905),江苏省重点研发计划(BE2016904),国家自然科学基金(61502145,61300122),中央高校基本科研业务费专项资金(2017B42214)资助

Deinterlacing Algorithm Based on Scene Change and Content Characteristics Detection

ZHU Xiao-tao, LI Yan-ping, HUANG Yuan, HUANG Qian   

  1. (College of Computer and Information,Hohai University,Nanjing 211100,China)
  • Received:2018-07-16 Revised:2018-09-19 Online:2019-03-15 Published:2019-03-22

摘要: 基于对运动补偿去隔行算法的分析,提出了基于场景切变检测和内容特征检测的去隔行算法。该算法首先进行场景切变检测和视频内容特征检测,其次基于场景切变检测的结果进行优化的运动估计,然后对图像块进行局部区域划分,最后根据划分结果自适应选取不同的插值方式。实验结果表明,该算法不仅能够以较低的算法复杂度提升图像的垂直分辨率,而且对于不同视频内容的隔行视频序列,都能得到高质量的逐行序列。

关键词: 场景切变, 内容特征检测, 去隔行

Abstract: This paper proposed a deinterlacing algorithm based on scene change and content characteristics detection.Firstly,scene changes and video content characteristics were detected.Secondly,optimized motion estimation was performed based on scene change detection results.Thirdly,the image blocks were locally partitioned and different interpolation methods were applied.Experimental results show that the algorithm can not only improve the vertical image resolution with lower algorithm complexity,but also obtain high-quality progressive sequences for interlaced video sequences of different video content.

Key words: Content characteristics detection, Deinterlacing, Scene change

中图分类号: 

  • TP391
[1]YANG L,XU W P.A novel adaptive de-interlacing algorithm based on motion compensation [J].Microelectronics & Compu-ter,2002,19(9):4-6.(in Chinese)
杨柳,徐维朴.一种新型基于运动补偿的自适应去隔行算法[J].微电子学与计算机,2002,19(9):4-6.
[2]HUANG Q,GAO W,ZHAO D,et al.An Efficient and Robust Adaptive Deinterlacing Technique [J].IEEE Transactions on Consumer Electronics,2006,52(3):888-895.
[3]MOHAMMADI H M,LANGLOIS P,SAVARIA Y.A Five-
field Motion Compensated Deinterlacing Method Based on Vertical Motion [J].IEEE Transactions on Consumer Electronics,2007,53(3):1117-1124.
[4]HUANG Q,ZHAO D,MA S,et al.Deinterlacing Using Hierarchical Motion Analysis [J].IEEE Transactions on Circuits and Systems for Video Technology,2010,20(5):673-686.
[5]MOHAMMADI H M,SAVARIA Y,LANGLOIS J M P.En-
hanced Motion Compensated Deinterlacing Algorithm [J].IET Image Processing,2013,6(8):1041-1048.
[6]LEE G G,LIN H Y,WANG M J,et al.A High-Quality Spatial-temporal Content-adaptive Deinterlacing Algorithm[C]∥Proceedings of IEEE International Symposium on Circuits and Systems.New York:IEEE Press,2008:2594-2597.
[7]GAO X,GU J,LI J.De-interlacing Algorithms Based on Motion Compensation [J].IEEE Transactions on Consumer Electro-nics,2005,51(2):589-599.
[8]PARK S J,JEON G,JEONG J.Deinterlacing Algorithm Using Edge Direction From Analysis of the DCT Coefficient Distribution [J].IEEE Transactions on Consumer Electronics,2009,55(3):1674-1681.
[9]CHO H J,LEE Y S,OH S H,et al.A Voting-based Intra Deinterlacing Method for Directional Error Correction [J].IEEE Transactions on Consumer Electronics,2010,56(3):1713-1721.
[10]ZHANG H,WANG R,LIU W,et al.Fusion-Based Edge-sensitive Interpolation Method for Deinterlacing [J].Multimedia Tools and Applications,2015,74(18):7643-7659.
[11]WANG J,JEON G,JEONG J.De-Interlacing Algorithm Using Weighted Least Squares [J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(1):39-48.
[12]JEON G,KANG S H,LEE J K.A Robust Fuzzy-bilateral Filtering Method and Its Application to Video Deinterlacing [J].Journal of Real-Time Image Processing,2016,11(1):223-233.
[13]KWON O,SOHN K,LEE C.Deinterlacing Using Directional In-
terpolation and Motion Compensation [J].IEEE Transactions on Consumer Electronics,2003,49(1):198-203.
[14]LIN S F,CHANG Y L,CHEN L G.Motion adaptive de-interlacing by horizontal motion detection and enhanced ELA proces-sing[C]∥Proceedings of IEEE International Symposium on Circuits and Systems.New York:IEEE Press,2003:II-696-II-699.
[15]ZHANG X,WANG D.An Efficient Motion Adaptive Deinterlacing Algorithm Using Improved Edge-based Line Average Interpolation[C]∥Proceedings of IEEE International Conference on Signal Processing.New York:IEEE Press,2016:659-662.
[16]WANG J,WU Z,WU J.Efficient Adaptive Deinterlacing Algorithm Using Bilateral Filter[C]∥MATEC Web of Conferences.Les Ulis Cedex A:EDP Sciences,2016.
[17]LEE K,LEE C.High Quality Deinterlacing Uusing Content
Adaptive Vertical Temporal Filtering [J].IEEE Transactions on Consumer Electronics,2010,56(4):2469-2474.
[18]WANG A,JEONG J.Deinterlacing Using Multi Direction Detection with Fixed Adaptive Tap Interpolation Filter[C]∥Proceedings of IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.New York:IEEE Press,2012:1-5.
[19]ZHU X,HUANG Q,YE F,et al.Motion-compensated deinterlacing based on scene change detection[C]∥Proceedings of Pacific-Rim Conference on Multimedia.Berlin:Springer-Verlag,2017:397-406.
[20]JANG S M,PARK J H,HONG S H.Deinterlacing method
based on edge direction refinement using weighted median filter[C]∥Proceedings of IEEE International Conference on Signal and Image Processing Applications.New York:IEEE Press,2009:227-230.
[1] 陈志强, 韩萌, 李慕航, 武红鑫, 张喜龙.
数据流概念漂移处理方法研究综述
Survey of Concept Drift Handling Methods in Data Streams
计算机科学, 2022, 49(9): 14-32. https://doi.org/10.11896/jsjkx.210700112
[2] 王明, 武文芳, 王大玲, 冯时, 张一飞.
生成链接树:一种高数据真实性的反事实解释生成方法
Generative Link Tree:A Counterfactual Explanation Generation Approach with High Data Fidelity
计算机科学, 2022, 49(9): 33-40. https://doi.org/10.11896/jsjkx.220300158
[3] 张佳, 董守斌.
基于评论方面级用户偏好迁移的跨领域推荐算法
Cross-domain Recommendation Based on Review Aspect-level User Preference Transfer
计算机科学, 2022, 49(9): 41-47. https://doi.org/10.11896/jsjkx.220200131
[4] 周芳泉, 成卫青.
基于全局增强图神经网络的序列推荐
Sequence Recommendation Based on Global Enhanced Graph Neural Network
计算机科学, 2022, 49(9): 55-63. https://doi.org/10.11896/jsjkx.210700085
[5] 宋杰, 梁美玉, 薛哲, 杜军平, 寇菲菲.
基于无监督集群级的科技论文异质图节点表示学习方法
Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level
计算机科学, 2022, 49(9): 64-69. https://doi.org/10.11896/jsjkx.220500196
[6] 柴慧敏, 张勇, 方敏.
基于特征相似度聚类的空中目标分群方法
Aerial Target Grouping Method Based on Feature Similarity Clustering
计算机科学, 2022, 49(9): 70-75. https://doi.org/10.11896/jsjkx.210800203
[7] 郑文萍, 刘美麟, 杨贵.
一种基于节点稳定性和邻域相似性的社区发现算法
Community Detection Algorithm Based on Node Stability and Neighbor Similarity
计算机科学, 2022, 49(9): 83-91. https://doi.org/10.11896/jsjkx.220400146
[8] 吕晓锋, 赵书良, 高恒达, 武永亮, 张宝奇.
基于异质信息网的短文本特征扩充方法
Short Texts Feautre Enrichment Method Based on Heterogeneous Information Network
计算机科学, 2022, 49(9): 92-100. https://doi.org/10.11896/jsjkx.210700241
[9] 徐天慧, 郭强, 张彩明.
基于全变分比分隔距离的时序数据异常检测
Time Series Data Anomaly Detection Based on Total Variation Ratio Separation Distance
计算机科学, 2022, 49(9): 101-110. https://doi.org/10.11896/jsjkx.210600174
[10] 聂秀山, 潘嘉男, 谭智方, 刘新放, 郭杰, 尹义龙.
基于自然语言的视频片段定位综述
Overview of Natural Language Video Localization
计算机科学, 2022, 49(9): 111-122. https://doi.org/10.11896/jsjkx.220500130
[11] 曹晓雯, 梁美玉, 鲁康康.
基于细粒度语义推理的跨媒体双路对抗哈希学习模型
Fine-grained Semantic Reasoning Based Cross-media Dual-way Adversarial Hashing Learning Model
计算机科学, 2022, 49(9): 123-131. https://doi.org/10.11896/jsjkx.220600011
[12] 周旭, 钱胜胜, 李章明, 方全, 徐常胜.
基于对偶变分多模态注意力网络的不完备社会事件分类方法
Dual Variational Multi-modal Attention Network for Incomplete Social Event Classification
计算机科学, 2022, 49(9): 132-138. https://doi.org/10.11896/jsjkx.220600022
[13] 戴禹, 许林峰.
基于文本行匹配的跨图文本阅读方法
Cross-image Text Reading Method Based on Text Line Matching
计算机科学, 2022, 49(9): 139-145. https://doi.org/10.11896/jsjkx.220600032
[14] 曲倩文, 车啸平, 曲晨鑫, 李瑾如.
基于信息感知的虚拟现实用户临场感研究
Study on Information Perception Based User Presence in Virtual Reality
计算机科学, 2022, 49(9): 146-154. https://doi.org/10.11896/jsjkx.220500200
[15] 周乐员, 张剑华, 袁甜甜, 陈胜勇.
多层注意力机制融合的序列到序列中国连续手语识别和翻译
Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion
计算机科学, 2022, 49(9): 155-161. https://doi.org/10.11896/jsjkx.210800026
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!