Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 220900007-7.doi: 10.11896/jsjkx.220900007

• Network & Communication • Previous Articles     Next Articles

Modulation Signal Recognition Based on Multimodal Fusion and Deep Learning

YANG Xiaomeng1,2, ZHANG Tao1, ZHUANG Jianjun2, QIAO Xiaoqiang1, DU Yihang1   

  1. 1 The 63rd Research Institute,National University of Defense Technology,Nanjing 210007,China
    2 School of Electronics and Information Engineering,Nanjing University of Information Science and Technology,Nanjing 210044,China
  • Published:2023-11-09
  • About author:YANG Xiaomeng,born in 1996,postgraduate.His main research interests include modulation recognition and deep learning.
    ZHANG Tao,born in 1988,Ph.D,associate researcher.His main research interests include wireless sensornetworks,machine learning and physical layer security.
  • Supported by:
    National Natural Science Foundation of China(61801496,61801497) and Strengthening Program Area Foundation of China (2019-JCJQ-JJ-221).

Abstract: Aiming at the problem that most of the existing modulation classification algorithms ignore the complementarity between different features and feature fusion,this paper proposes a method of feature fusion using deep learning model.This method attempts to fuse the temporal and spatial features of modulated signals to obtain more distinct recognition features.First,the A/P signal and I/Q signal of the modulation signal are obtained.Then,the convolution long-term and short-term memory module and the complex dense residual convolution module are built to extract the temporal features of A/P signal and the spatial features of I/Q signal respectively,and fuse them to obtain the fusion complementary recognition features.Finally,the recognition features are input into the classification network to obtain the recognition results.Experimental results show that based on the open source data set,when the signal-to-noise ratio is greater than 5 dB,the recognition rate reaches 93.25%,and the recognition accuracy is 3%~11% higher than that based on single feature recognition.The actual collected data is used for classification and recognition,which further proves the effectiveness of the proposed feature extraction model and fusion strategy.

Key words: Automatic modulation classification, Multimodal fusion, Deep learning

CLC Number: 

  • TN911.7
[1]ZENG Y,ZHANG M,HAN F,et al.Spectrum Analysis andConvolutional Neural Network for Automatic Modulation Re-cognition[J].IEEE Wireless Communication Letters,2019,8(3):929-932.
[2]WANG Y,LIU M,YANG J,et al.Data-Driven Deep Learning for Automatic Modulation Recognition in Cognitive Radios[J].IEEE Transactions on Vehicular Technology,2019,68(4):4074-4077.
[3]HAZZA A,SHOAIB M,ALSHEBEILI S A,et al.An overview of feature-based methods for digital modulation classification[C]//2013 1st InternationalConference on Communications,Signal Processing,and their Applications(ICCSPA).IEEE,2013:1-6.
[4]ZENG C Z,JIA X.Modulation recognition method of communication signals based on correlation characteristics[C]//IEEE International Conference on Signal Processing.IEEE,2015:1-5.
[5]ZHANG X,GE T,CHEN Z.Automatic Modulation Recognition of Communication Signals Based on Instantaneous Statistical Characteristics and SVM Classifier[C]//IEEE Asia-Pacific Conference on Antennas and Propagation.2018:344-346.
[6]SWAMI A,SADLER B M.Hierarchical digital modulation classification using cumulants[J].IEEE Trans Commun,2000,48(3):416-429.
[7]WU X,ZHANG J,HOU C,et al.Signal Modulation Recognition based on Convolutional Autoencoder and Time-Frequency Ana-lysis[C]//2021 8th International Conference on Dependable Systems and Their Applications(DSA).2021:664-668.
[8]PENG S L,JIANG H Y,WANG H X,et al.Modulation classifi-cation based on signal constellation diagrams and deep learning[J].IEEE Transactions on Neural Networks and Learning Systems,2018,30(3):718-727.
[9]YU X,LI L,YIN J,et al.Modulation Pattern Recognition ofNon-cooperative Underwater Acoustic Communication Signals Based on LSTM Network[C]//2019 IEEE International Conference on Signal,Information and Data Processing(ICSIDP).IEEE,2019.
[10]WANG Y.Kernel Cross-Modal Factor Analysis for Information Fusion With Application to Bimodal Emotion Recognition[J].IEEE Transactions on Multimedia,2012,14(3):597-607.
[11]LIU W,ZHENG W L,LU B L.Emotion Recognition UsingMultimodal Deep Learning[C]//Neural Information Proces-sing:23rd International Conference(ICONIP 2016).2016:521-529.
[12]SIMONYAN K,ZISSERMAN A.Two-stream convolutionalnetworks for action recognition in videos[C]//Advances in Neural Information Processing Systems.2014:568-576.
[1] ZHAO Mingmin, YANG Qiuhui, HONG Mei, CAI Chuang. Smart Contract Fuzzing Based on Deep Learning and Information Feedback [J]. Computer Science, 2023, 50(9): 117-122.
[2] LI Haiming, ZHU Zhiheng, LIU Lei, GUO Chenkai. Multi-task Graph-embedding Deep Prediction Model for Mobile App Rating Recommendation [J]. Computer Science, 2023, 50(9): 160-167.
[3] HUANG Hanqiang, XING Yunbing, SHEN Jianfei, FAN Feiyi. Sign Language Animation Splicing Model Based on LpTransformer Network [J]. Computer Science, 2023, 50(9): 184-191.
[4] ZHU Ye, HAO Yingguang, WANG Hongyu. Deep Learning Based Salient Object Detection in Infrared Video [J]. Computer Science, 2023, 50(9): 227-234.
[5] ZHANG Yian, YANG Ying, REN Gang, WANG Gang. Study on Multimodal Online Reviews Helpfulness Prediction Based on Attention Mechanism [J]. Computer Science, 2023, 50(8): 37-44.
[6] SONG Xinyang, YAN Zhiyuan, SUN Muyi, DAI Linlin, LI Qi, SUN Zhenan. Review of Talking Face Generation [J]. Computer Science, 2023, 50(8): 68-78.
[7] WANG Xu, WU Yanxia, ZHANG Xue, HONG Ruize, LI Guangsheng. Survey of Rotating Object Detection Research in Computer Vision [J]. Computer Science, 2023, 50(8): 79-92.
[8] ZHOU Ziyi, XIONG Hailing. Image Captioning Optimization Strategy Based on Deep Learning [J]. Computer Science, 2023, 50(8): 99-110.
[9] ZHANG Xiao, DONG Hongbin. Lightweight Multi-view Stereo Integrating Coarse Cost Volume and Bilateral Grid [J]. Computer Science, 2023, 50(8): 125-132.
[10] WANG Yu, WANG Zuchao, PAN Rui. Survey of DGA Domain Name Detection Based on Character Feature [J]. Computer Science, 2023, 50(8): 251-259.
[11] WANG Mingxia, XIONG Yun. Disease Diagnosis Prediction Algorithm Based on Contrastive Learning [J]. Computer Science, 2023, 50(7): 46-52.
[12] SHEN Zhehui, WANG Kailai, KONG Xiangjie. Exploring Station Spatio-Temporal Mobility Pattern:A Short and Long-term Traffic Prediction Framework [J]. Computer Science, 2023, 50(7): 98-106.
[13] HUO Weile, JING Tao, REN Shuang. Review of 3D Object Detection for Autonomous Driving [J]. Computer Science, 2023, 50(7): 107-118.
[14] ZHOU Bo, JIANG Peifeng, DUAN Chang, LUO Yuetong. Study on Single Background Object Detection Oriented Improved-RetinaNet Model and Its Application [J]. Computer Science, 2023, 50(7): 137-142.
[15] MAO Huihui, ZHAO Xiaole, DU Shengdong, TENG Fei, LI Tianrui. Short-term Subway Passenger Flow Forecasting Based on Graphical Embedding of Temporal Knowledge [J]. Computer Science, 2023, 50(7): 213-220.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!