Computer Science ›› 2019, Vol. 46 ›› Issue (12): 306-312.doi: 10.11896/jsjkx.191200500C

• Interdiscipline & Frontier • Previous Articles     Next Articles

Semi-supervised Scene Recognition Method Based on Multi-mode Fusion

SHEN Hong1,2,3, LIU Jun-fa1,2,3, CHEN Yi-qiang1,2,3, JIANG Xin-long1,2,3, HUANG Zheng-yu2,3   

  1. (University of Chinese Academy of Sciences,Beijing 100190,China)1;
    (Research Center for Ubiquitous Computing Systems,Institute of Computing Technology,Chinese Academyof Sciences,Beijing 100190,China)2;
    (Beijing Key Laboratory of Mobile Computing and Pervasive Device,Chinese Academy of Sciences,Beijing 100190,China)3
  • Received:2019-01-11 Online:2019-12-15 Published:2019-12-17

Abstract: Scene recognition is an important part of pervasive computing.It aims to provide users with accurate persona-lized service and improve service quality by identifying the location of the smartphone users.In the actual environment,there are two problems in accurate scene recognition.Firstly,based on single mode sensor data or wireless signal data,classification effect is not good enough ,and its generalization is not enough.Secondly,scene recognition accuracy depends on a large number of labeled data,resulting in high cost.In view of these problems,a semi-supervised scene recognition method based on multi-mode fusion was proposed.The menthod makes full use of the complementary information of Wi-Fi,Bluetooth and sensors to improve the accuracy of recognition.Compared with the recognition based on single mode data,fusion feature can increase the static scene classification accuracy by 10%.In this paper,a semi-supervised learning method was constructed to solve the problem of high data acquisition cost in dynamic scene,and the classification accuracy is over 90% by reducing half of the labeled data.The results show that introducing semi-supervised lear-ning method based on the complementary advantages of Wi-Fi,Bluetooth and sensors information can reduce data collecting cost and improve scene recognition accuracy to some extent,and thus highly increase its recognition accuracy and universality.

Key words: Bluetooth, Multi-mode fusion, Scene recognition, Semi-supervised learning, Wi-Fi

CLC Number: 

  • TP311
[1]KAPITSAKI G M,PREZERAKOS G N,TSELIKAS N D, et al.Context-aware service engineering:A survey[J].Journal of Systems & Software,2009,82(8):1285-1297.
[2]CHEN Z Y.Mining individual behavior pattern based on significant locations and spatial trajectories[C]//IEEE International Conference on Pervasive Computing and Communications Workshops.Lugano:IEEE,2012:540-541.
[3]CHEN Z,ZHOU J,CHEN Y,et al.Combing multiple linear regression and manifold regularization for indoor positioning from unique radio signal[C]//Pervasive Computing.Taibei:IEEE,2009:611-614.
[4]CHEN Y Q,CHEN Z Y,LIU J F,et al.Surrounding context and episode awareness using dynamic Bluetooth data[C]//ACM Conference on Ubiquitous Computing.For Worth:ACM,2012:629-630.
[5]YE S Y,ZHANG W Z,QI T L,et al.A Sensor and User Beha- vior Data Analysis Based Method of Mobile Learning Situation Perception[J].Journal of Computer Research and Development,2016,52(12):2721-2728.(in Chinese)
[6]RUAN J J,LUO D,LUO H Y.Indoor and outdoor scene recognition algorithm based on support vector machine multi-classifier[J].Journal of Computer Application,2015,35(11):3135-3138.(in Chinese)
[7]YOUSSEF M A,AGRAWALA A,SHANKAR A U.WLAN Location Determination via Clustering and Probability Distributions[C]//IEEE International Conference on Pervasive Computing and Communications.IEEE,2003:143-150.
[8]KRUMM J,HARIHARAN R.TempIO:Inside/Outside Classification with Temperature[C]//Second International Workshop on Man-Machine Symbiotic Systems.Kyoto,2004.
[9]BI S C,YUAN K,CHEN J L,et al.A method of user’s scene recognition based on WIFI portrait:CN 201610373922.6.2016.(in Chinese)
毕树超,袁凯,陈津来,等.一种基于WIFI画像识别用户所在场景的方法:CN 201610373922.6.2016
[10]LIU Z W,XU F Y,WANG Z X.A new multi-user indoor location algorithm based on difference distance-loss model with parameter fitting[J].Chinese Journal of Radio Science,2008,23(6):1090-1094.(in Chinese)
[11]MILETTE G,STROUD A.Professional Android Sensor Programming[M].Wrox Press Ltd,2012.
[12]ZHU X M,LI S R,LI Z B.WKNN Indoor Positioning Method Based on Distribution Overlap of Rssi[J].Journal of Xuzhou Institude of Technology(Natural Sciences Edition),2017,32(3):48-52.(in Chinese)
[13]HUANG G B,ZHU Q Y,SIEW C K.Extreme learning ma- chine:a new learning scheme of feedforward neural networks[C]//IEEE International Joint Conference on Neural Networks.Budapest:IEEE,2005:985-990.
[14]BANERJEE K S.Generalized Inverse of Matrices and Its Applications[J].Technometrics,1971,15(1):197-197.
[15]CVETKOVIC D M,DOOB M,SACHS H.Spectra of graphs:theory and application[J].Math Hungar,1995,6(2):191-195.
[16]CHERKASSKY V.The Nature Of Statistical Learning Theory [J].IEEE Transactions on Neural Networks,1997,8(6):1564-1564.
[17]JERIBI A.Spectral Graph Theory[M]//Spectral graph theory.Springer,1997:212.
[18]XU R,JIANG F,YAO H X.Overview of manifold learning [J].Journal of Intelligent Systems,2006,1(1):44-51.(in Chinese)
[19]BELKIN M,MATVEEVA I,NIYOGI P.Regularization and Semi-supervised Learning on Large Graphs[C]//International Conference on Computational Learning Theory.Berlin:Sprin-ger,2004.
[20]BELKIN M,NIYOGI P,SINDHWANI V.Manifold Regularization:A Geometric Framework for Learning from Labeled and Unlabeled Examples[J].Journal of Machine Learning Research,2006,7(1):2399-2434.
[1] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[2] HOU Xia-ye, CHEN Hai-yan, ZHANG Bing, YUAN Li-gang, JIA Yi-zhen. Active Metric Learning Based on Support Vector Machines [J]. Computer Science, 2022, 49(6A): 113-118.
[3] WANG Yu-fei, CHEN Wen. Tri-training Algorithm Based on DECORATE Ensemble Learning and Credibility Assessment [J]. Computer Science, 2022, 49(6): 127-133.
[4] XU Hua-jie, QIN Yuan-zhuo, YANG Yang. Scene Recognition Method Based on Multi-level Feature Fusion and Attention Module [J]. Computer Science, 2022, 49(4): 209-214.
[5] XU Hua-jie, CHEN Yu, YANG Yang, QIN Yuan-zhuo. Semi-supervised Learning Method Based on Automated Mixed Sample Data Augmentation Techniques [J]. Computer Science, 2022, 49(3): 288-293.
[6] LIU Xin, YUAN Jia-bin, WANG Tian-xing. Interior Human Action Recognition Method Based on Prior Knowledge of Scene [J]. Computer Science, 2022, 49(1): 225-232.
[7] KONG Jin-sheng, LI Jing-xin, DUAN Peng-song, CAO Yang-jie. Survey of Human Identification Algorithms Based on Wi-Fi Signal [J]. Computer Science, 2021, 48(10): 246-257.
[8] JIANG Ze-tao, QIN Jia-qi, HU Shuo. Multi-spectral Scene Recognition Method Based on Multi-way Convolution Neural Network [J]. Computer Science, 2019, 46(9): 265-270.
[9] WU Zhen-yu, LI Yun-lei, WU Fan. Semi-supervised Support Tensor Based on Tucker Decomposition [J]. Computer Science, 2019, 46(9): 195-200.
[10] QIN Yue, DING Shi-fei. Survey of Semi-supervised Clustering [J]. Computer Science, 2019, 46(9): 15-21.
[11] LI Sen-sen, HUANG Yi-cai, YU Bin. Bluetooth Key Agreement Scheme with Zero Secret Storage in Slave Device [J]. Computer Science, 2019, 46(4): 151-157.
[12] YU Yi-ran, CHANG Jun, WU Liu-fan, ZHANG Yong-hong. Training-free Human Respiration Sensing Based on Wi-Fi Signal [J]. Computer Science, 2019, 46(11): 304-308.
[13] YU Ying, CHEN Ke, SHOU Li-dan, CHEN Gang, WU Xiao-fan. Sentiment Analysis of User Comments Based on Extraction of Key Words and Key Sentences [J]. Computer Science, 2019, 46(10): 19-26.
[14] LIU Xiao, WANG Xiao-guo. Probabilistic Graphical Model Based Approach for Bank Telecommunication Fraud Detection [J]. Computer Science, 2018, 45(7): 122-128.
[15] CAI Yi, ZHU Xiu-fang, SUN Zhang-li and CHEN A-jiao. Semi-supervised and Ensemble Learning:A Review [J]. Computer Science, 2017, 44(Z6): 7-13.
Full text



No Suggested Reading articles found!