Computer Science ›› 2023, Vol. 50 ›› Issue (1): 98-104.doi: 10.11896/jsjkx.211100149

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Onboard Rock Detection Algorithm Based on Spiking Neural Network

MA Weiqi, YUAN Jiabin, ZHA Keke, FAN Lili   

  1. School of Computer Science and Technology,Nanjing University of Aeronautics and Astronautics,Nanjing 211106,China
  • Received:2021-11-14 Revised:2022-07-02 Online:2023-01-15 Published:2023-01-09
  • About author:MA Weiqi,born in 1997,postgraduate.Her main research interests include spiking neural network,machine learning,deep space autonomous technology,etc.
    YUAN Jiabin,born in 1968,Ph.D,professor,doctoral supervisor,is a member ofChina Computer Federation.His main research interests include cryptography,high-performance computing,quantum computing,deep space autonomous technology,intelligent information processing and autonomous navigation,etc.
  • Supported by:
    National Natural Science Foundation of China(62076127).

Abstract: The detection of rocky obstacles onboard in the deep space environment is an important prerequisite to ensure the safe detection of the planetary rover.Due to the storage capacity and data processing capabilities of space-borne computing equipment,large-scale and complex calculations are not suitable for the remote and deep space environment.In addition,traditional rock detection algorithms have problems such as high complexity and excessive energy consumption.Therefore,this paper proposes the Spiking-Unet,which is a multi-class semantic segmentation algorithm and uses deep spiking neural network to achieve effective detection of rocks onboard.Firstly,because of class imbalance in the rock images,constructing the lovasz_CE loss function to train the Unet network model.Secondly,mapping the parameters obtaining from the Unet network model to the Spiking-Unet network based on the parameter scaling method.Thirdly,using the S-softmax function based on the pulse firing frequency to rea-lize the pixel-level classification of rock images.The proposed algorithm is tested on the public datasets Artificial Lunar Landscape.Experimental results show that the Spiking-Unet can reduce Flopsto about 1/1 000 of the original and reduce energy consuptionto about 1/600 of the original when the accuracy is similar with the Unet model with the same topology.

Key words: Deep space exploration, Spiking neural network, Rock detection, Image segmentation, Semantic segmentation

CLC Number: 

  • TP389.1
[1]CASTANO R,ESTLIN T,GAINES D,et al.Onboard autonomous rover science[C]//2007 IEEE Aerospace Conference.IEEE,2007:1-13.
[2]BURLM C,THOMPSON D R.Rockster:Onboard rock segmentation through edge regrouping[J].Journal of Aerospace Information Systems,2016,13(8):329-342.
[3]CASTANO R,JUDD M,ESTLIN T,et al.Current results from a rover science data analysis system[C]//2005 IEEE Aerospace Conference.IEEE,2005:356-365.
[4]COMANICIU D,MEER P.Mean shift:A robust approach to-ward feature space analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2002,24(5):603-619.
[5]FELZENSZWALB P F,HUTTENLOCHER D P.Efficientgraph-based image segmentation[J].International Journal of Computer Vision,2004,59(2):167-181.
[6]SHI J,MALIK J.Normalized cuts and image segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(8):888-905.
[7]ACHANTA R,SHAJI A,SMITH K,et al.SLIC superpixelscompared to state-of-the-art superpixel methods[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(11):2274-2282.
[8]GONG X,LIU J.Rock detection via superpixel graph cuts[C]//2012 19th IEEE International Conference on Image Processing.IEEE,2012:2149-2152.
[9]DUNLOP H,THOMPSON D R,WETTERGREEN D.Multi-scale features for detection and segmentation of rocks inmars images[C]//2007 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2007:1-7.
[10]BOYKOV Y,KOLMOGOROV V.An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(9):1124-1137.
[11]MAASS W.Networks of spiking neurons:The third generation of neural network models[J].Neural Networks,1997,10(9):1659-1671.
[12]MAASS W,BISHOP C M.Pulsed neural networks[M]//Massachusetts:MIT Press.1999:55-81.
[13]MEFTAH B,LEZORAY O,BENYETTOU A.Segmentationand edge detection based on spiking neural network model [J].Neural Processing Letters,2010,32(2):131-146.
[14]MEFTAH B,LEZORAY O,LECLUSE M,et al.Cell microscopic segmentation with spiking neuron networks[C]//International Conference on Artificial Neural Networks.Berlin:Springer,2010:117-126.
[15]BUHMANN J,LANGE T,RAMACHER U.Image segmentation by networks of spiking neurons [J].Neural Computation.2005,17(5):1010-1031.
[16]WU Q X,MCGINNITY T M,MAGUIRE L,et al.Colour image segmentation based on a spiking neural network model inspired by the visual system[C]//International Conference on Intelligent Computing.Berlin:Springer,2010:49-57.
[17]KERR D,COLEMAN S,MCGINNITY M,et al.Biologically inspired edge detection[C]//2011 11th International Conference on Intelligent Systems Design and Applications.IEEE,2011:802-807.
[18]BERMAN M,TRIKI A R,BLASCHKO M B.The Lovasz-Softmax Loss:A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks[C]//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR).IEEE,2018.
[19]CAO Y,CHEN Y,KHOSLA D.Spiking deep convolutional neural networks for energy-efficient object recognition[J].International Journal of Computer Vision,2015,113(1):54-66.
[20]IZHIKEVICH E M.Which model to use for cortical spikingneurons?[J].IEEE Transactions on Neural Networks,2004,15(5):1063-1070.
[21]LIU Y H,WANG X J.Spike-frequency adaptation of a genera-lized leaky integrate-and-fire model neuron[J].Journal of Computational Neuroscience,2001,10(1):25-45.
[22]GUO S,WANG L,CHEN B,et al.An overhead-free max-pooling method for snn[J].IEEE Embedded Systems Letters,2019,12(1):21-24.
[23]HOROWITZ M.1.1 computing's energy problem(and what we can do about it)[C]//2014 IEEE International Solid-State Circuits Conference Digest of Technical Papers(ISSCC).IEEE,2014:10-14.
[24]CHAURASIA A,CULURCIELLO E.Linknet:Exploiting encoder representations for efficient semantic segmentation[C]//2017 IEEE Visual Communications and Image Processing(VCIP).IEEE,2017:1-4.
[25]ZHAO H,SHI J,QI X,et al.Pyramid scene parsing network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2881-2890.
[26]LIN T Y,DOLLÁR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:2117-2125.
[27]RONNEBERGER O,FISCHER P,BROX T.U-net:Convolu-tional networks for biomedical image segmentation[C]//International Conference on Medical Image Computing and Compu-ter-assisted Intervention.Cham:Springer,2015:234-241.
[1] HUANG Zenan, LIU Xiaojie, ZHAO Chenhui, DENG Yabin, GUO Donghui. Spiking Neural Network Model for Brain-like Computing and Progress of Its Learning Algorithm [J]. Computer Science, 2023, 50(1): 229-242.
[2] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[3] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
[4] QI Ying, CHAI Yan-mei. High-resolution Remote Sensing Sea Ice Image Segmentation Based on Combination of ImprovedSLIC Algorithm and Clustering Algorithm [J]. Computer Science, 2022, 49(11A): 211200100-6.
[5] JIN Yu-jie, CHU Xu, WANG Ya-sha, ZHAO Jun-feng. Variational Domain Adaptation Driven Semantic Segmentation of Urban Scenes [J]. Computer Science, 2022, 49(11): 126-133.
[6] ZHANG Fu-chang, ZHONG Guo-qiang, MAO Yu-xu. Neural Architecture Search for Light-weight Medical Image Segmentation Network [J]. Computer Science, 2022, 49(10): 183-190.
[7] ZHU Yi-fan, WANG Hai-tao, LI Ke, WU He-jun. Crack U-Net:Towards High Quality Pavement Crack Detection [J]. Computer Science, 2022, 49(1): 204-211.
[8] YE Zhong-yu, WU Meng-lin. Choroidal Neovascularization Segmentation Combining Temporal Supervision and Attention Mechanism [J]. Computer Science, 2021, 48(8): 118-124.
[9] JIN Hai-yan, PENG Jing, ZHOU Ting, XIAO Zhao-lin. Binocular Image Segmentation Based on Graph Cuts Multi-feature Selection [J]. Computer Science, 2021, 48(8): 150-156.
[10] WANG Shi-yun, YANG Fan. Remote Sensing Image Semantic Segmentation Method Based on U-Net Feature Fusion Optimization Strategy [J]. Computer Science, 2021, 48(8): 162-168.
[11] XU Hua-jie, ZHANG Chen-qiang, SU Guo-shao. Accurate Segmentation Method of Aerial Photography Buildings Based on Deep Convolutional Residual Network [J]. Computer Science, 2021, 48(8): 169-174.
[12] YANG Xiu-zhang, WU Shuai, XIA Huan, YU Xiao-min. Research on Shui Characters Extraction and Recognition Based on Adaptive Image Enhancement Technology [J]. Computer Science, 2021, 48(6A): 74-79.
[13] ZHAN Rui, LEI Yin-jie, CHEN Xun-min, YE Shu-han. Street Scene Change Detection Based on Multiple Difference Features Network [J]. Computer Science, 2021, 48(2): 142-147.
[14] CAO Lin, YU Wei-wei. Adaptive Window Binocular Stereo Matching Algorithm Based on Image Segmentation [J]. Computer Science, 2021, 48(11A): 314-318.
[15] GU Xing-jian, ZHU Jian-feng, REN Shou-gang, XIONG Ying-jun, XU Huan-liang. Multi-scale U Network Realizes Segmentation and Recognition of Tomato Leaf Disease [J]. Computer Science, 2021, 48(11A): 360-366.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!