Computer Science ›› 2019, Vol. 46 ›› Issue (9): 277-283.doi: 10.11896/j.issn.1002-137X.2019.09.042

• Graphics,Image & Pattern Recognition • Previous Articles     Next Articles

Edge-preserving Filtering Method Based on Convolutional Neural Networks

SHI Xiao-hong1,2,3, HUANG Qin-kai4, MIAO Jia-xin5, SU Zhuo4,5   

  1. (School of Mathematics and Information Science,Guangzhou University,Guangzhou 510006,China)1;
    (Institute of Computing Science and Technology,Guangzhou University,Guangzhou 510006,China)2;
    (Guangdong Provincial Engineering and Technology Research Center for Mathematical Education Software,Guangzhou 510006,China)3;
    (School of Data and Computer Science,Sun Yat-sen University,Guangzhou 510006,China)4;
    (National Engineering Research Center of Digital Life,Sun Yat-sen University,Guangzhou 510006,China)5
  • Received:2018-08-30 Online:2019-09-15 Published:2019-09-02

Abstract: Edge-preserving filtering is a significant basic theory research in the fields of computer vision and image processing.As subsequent operation of pre-processing,edge-preserving filtering has great influence on final results of image processing.Different with traditional filtering,edge-preserving filtering focuses not only on smooth,but also on image edge details.Convolutional neural networks (CNNs) have been applied into a variety of research fields with great success.In this paper,CNN was introduced into edge-preserving filtering.Taking advantages of CNN’s excellent extensibility and flexibility,this paper constructed a deep convolutional neural network (DCNN).With three types of cascading network layers,DCNN iteratively updates its parameters by back propagation,produces a residual image and realizes a DCNN-based edge-preserving filtering.Besides,a gradient CNN model (GCNN) was constructed.The gradient of color images is learnt,edge-preserving smoothing operation is conducted for gradient images by three layers of convolution,and edge-preserving filtering gradient images are obtained.Subsequently,the input image is used to guide the filtering gradient image for reconstructing and obtaining color filtering image.Finally,experiments were made to evaluate the proposed methods and the proposed methods were compared with popular edge-preserving filtering methods subjectively and objectively.DCNN not only achieves the same visual effects as other methods,but also has big advantages in processing time,which demonstrates that DCNN can effectively and efficiently imitate various filtering methods through training on large amount of data.For GCNN,in terms of visual effects,its output conforms to the input in the color style globally.In terms of image similarity evaluation,it also outperforms other methods.This verifies that GCNN can address the problems of color shift and gradient inversion,as well as improve the filtering efficiency.

Key words: Convolutional neural networks, Edge-preserving, Filtering, Smoothing

CLC Number: 

  • TP391
[1]FARBMAN Z,FATTAL R,LISCHINSKI D.Edge-preservingdecompositions for multi-scale tone and detail manipulation [J].ACM Transactions on Graphics (TOG),2008,27(3):1-10.
[2]PARIS S,HASINOFF S W,KAUTZ J.Local Laplacian filters:edge-aware image processing with a Laplacian pyramid [J].ACM Transactions on Graphics (TOG),2015,58(3):81-91.
[3]GASTAL E S L,OLIVEIRA M M.Domain transform for edge-aware image and video processing[J].ACM Transactions on Graphics (TOG),2011,30(4):Article No.69.
[4]PARIS S,DURAND F.A fast approximation of the bilateral filter using a signal processing approach [J].International Journal of Computer Vision,2009,81(1):24-52.
[5]XU L,LU C,XU Y,et al.Image smoothing via L0 gradient mini-mization [J].ACM Transactions on Graphics (TOG),2011,30(6):174.
[6]TOMASI C,MANDUCHI R.Bilateral filtering for gray and co-lor images [C]//1998 IEEE Sixth International Conference on Computer Vision (ICCV’98).Piscataway,NJ:IEEE,1998:839-846.
[7]PORIKLI F.Constant time O (1) bilateral filtering [C]//2008 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’08).Piscataway,NJ:IEEE,2008:1-8.
[8]YANG Q,TAN K,AHUJA N.Real-time O (1) bilateral filtering [C]//2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’09).Piscataway,NJ:IEEE,2009:557-564.
[9]HE K,SUN J,TANG X.Guided image filtering [C]//European Conference on Computer Vision (ECCV’10).New York,NY:Springer,2010:1-14.
[10]PERONA P,MALIK J.Scale-space and edge detection using anisotropic diffusion [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1990,12(7):629-639.
[11]XU L,YAN Q,XIA Y,et al.Structure extraction from texture via relative total variation [J].ACM Transactions on Graphics,2012,31(6):Article No.139.
[12]DONG C,LOY C C,HE K et al.Image super-resolution using deep convolutional networks [J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,38(2):295-307.
[13]XIE J,XU L,CHEN E.Image denoising and inpainting withdeep neural networks [C]//25th International Conference on Neural Information Processing Systems.Red Hook,NY:Curran Associates,Inc.,2012:341-349.
[14]LIU S,PAN J,YANG M.Learning recursive filters for low-level vision via a hybrid neural network [C]//European Conference on Computer Vision (ECCV’16).New York,NY:Springer,2016:560-576.
[15]LI Y,HUANG J,AHUJA N,et al.Deep joint image filtering[C]//European Conference on Computer Vision (ECCV’16).New York,NY:Springer,2016:154-169.
[16]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition [C]//International Conference on Learning Representations 2015 (ICLR2015).San Die-go,CA,2015.
[17]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’15).Piscataway,NJ:IEEE,2015:1-9.
[18]XU L,REN J,YAN Q,et al.Deep edge-aware filters [C]//International Conference on Machine Learning.2015:1669-1678.
[19]ZHANG Q,SHEN X,XU L et al.Rolling guidance filter [C]//European Conference on Computer Vision (ECCV’14).New York,NY:Springer,2014:815-830.
[20]KARACAN L,ERDEM E,ERDEM A.Structure-preserving ima-ge smoothing via region covariances [J].ACM Transactions on Graphics,2013,32(6):Article No.176.
[21]HAM B,CHO M,PONCE J.Robust image filtering using joint static and dynamic guidance [C]//2015 IEEE Conference on Computer Vision and Pattern Recognition(CVPR’15).Piscata-way,NJ:IEEE,2015:4823-4831.
[1] CHENG Zhang-tao, ZHONG Ting, ZHANG Sheng-ming, ZHOU Fan. Survey of Recommender Systems Based on Graph Learning [J]. Computer Science, 2022, 49(9): 1-13.
[2] WANG Guan-yu, ZHONG Ting, FENG Yu, ZHOU Fan. Collaborative Filtering Recommendation Method Based on Vector Quantization Coding [J]. Computer Science, 2022, 49(9): 48-54.
[3] TANG Qing-hua, WANG Mei, TANG Chao-chen, LIU Xin, LIANG Wen. PDR Indoor Positioning Method Based on M2M Encounter Region [J]. Computer Science, 2022, 49(9): 283-287.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] TAN Ying-ying, WANG Jun-li, ZHANG Chao-bo. Review of Text Classification Methods Based on Graph Convolutional Network [J]. Computer Science, 2022, 49(8): 205-216.
[6] SUN Xiao-han, ZHANG Li. Collaborative Filtering Recommendation Algorithm Based on Rating Region Subspace [J]. Computer Science, 2022, 49(7): 50-56.
[7] CAI Xiao-juan, TAN Wen-an. Improved Collaborative Filtering Algorithm Combining Similarity and Trust [J]. Computer Science, 2022, 49(6A): 238-241.
[8] HE Yi-chen, MAO Yi-jun, XIE Xian-fen, GU Wan-rong. Matrix Transformation and Factorization Based on Graph Partitioning by Vertex Separator for Recommendation [J]. Computer Science, 2022, 49(6A): 272-279.
[9] HUANG Guo-xing, YANG Ze-ming, LU Wei-dang, PENG Hong, WANG Jing-wen. Solve Data Envelopment Analysis Problems with Particle Filter [J]. Computer Science, 2022, 49(6A): 159-164.
[10] WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[11] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[12] GUO Liang, YANG Xing-yao, YU Jiong, HAN Chen, HUANG Zhong-hao. Hybrid Recommender System Based on Attention Mechanisms and Gating Network [J]. Computer Science, 2022, 49(6): 158-164.
[13] FENG Lei, ZHU Deng-ming, LI Zhao-xin, WANG Zhao-qi. Sparse Point Cloud Filtering Algorithm Based on Mask [J]. Computer Science, 2022, 49(5): 25-32.
[14] HU Zhi-hao, PAN Zu-lie. Testcase Filtering Method Based on QRNN for Network Protocol Fuzzing [J]. Computer Science, 2022, 49(5): 318-324.
[15] SHI Dian-xi, LIU Cong, SHE Fu-jiang, ZHANG Yong-jun. Cooperation Localization Method Based on Location Confidence of Multi-UAV in GPS-deniedEnvironment [J]. Computer Science, 2022, 49(4): 302-311.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!