计算机科学 ›› 2020, Vol. 47 ›› Issue (10): 9-18.doi: 10.11896/jsjkx.200300138
所属专题: 群智感知计算; 物联网技术 虚拟专题
陈超1, 赵春蕾1, 张春祥1, 罗辉2
CHEN Chao1, ZHAO Chun-lei1, ZHANG Chun-xiang1, LUO Hui2
摘要: 近年来,随着科技的快速发展,智能移动设备已经成为人们生活的一部分。智能移动设备的普及为实现声呐感知理论的应用做好了充分的物理支持。声呐信号在传播时受到传播空间和生命活动的调制,因此携带着丰富的生命状态和空间信息。智能手机的普及、通讯技术的成熟以及声学信号的创新型应用,使得声呐感知设备可以实现低成本细粒度的感知收集和计算。利用声学信号在声呐感知技术中无需额外特制硬件的支撑,以及其特有的隐蔽性和高精度等优点,通过提取声学信号的有效特征信息,就可对周边空间信息进行定位计算。文中详细阐述了声学信号在空间定位感知使用技术领域中的已有研究,并对主要技术的基本原理进行了总结,最后分析了声学信号在移动感知应用技术中存在的问题以及未来的发展趋势。
中图分类号:
[1]CAI L,CHEN H.TouchLogger: inferring keystrokes on touch screen from smartphone motion[C]//Proc eedings of the 6th USENIX Conference on Hot Topics in Security.USENIX Association,2011:9-9. [2]EMILIANO M,ALEXANDER V,SUHRID B,et al.Tapprints:your finger taps have fingerprints[C]//Proceedings of the 10th International Conference on Mobile Systems.2012:323-336. [3]GUIXIN Y,ZHAN Y T,DING Y F,et al.Cracking Androidpattern lock in five attempts[C]//The Network and Distributed System Security Symposium.Internet Society,2017. [4]SONG J,GÁBOR S,PECE F,et al.Inair Gestures Around Unmodified Mobile Devices[C]//Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology.2014:319-329. [5]ZHANG C,TABOR J,ZHANG J,et al.Extending Mobile Interaction Through Near-Field Visible Light Sensing[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015. [6]LI M,MENG Y,LIU J,et al.When CSI Meets Public WiFi:Inferring Your Mobile Phone Password via WiFi Signals[C]//Proceedings of the 2016 ACM SIGSAC Conference on Computer and Commun ications Security.2016:1068-1079. [7]JIE Z,XIAOLONG Z,ZHANYONG T,et al.Privacy Leakage in Mobile Sensing:Your Unlock Passwords Can Be Leaked through Wireless Hotspot Functionality[J].Mobile Information Systems,2016(2):1-14. [8]RODRÍGUEZ V A,TRINIDAD A,GARCÍA B J R,et al.Extended high-frequency (9-20 kHz) audio- metry reference thresholds in 645 healthy subjects[J].International Journal of Audiology,2014,53(8):531-545. [9]BUCKLEY K M,GRIFFITHS L J.Broad-band signalsubs- pace spatial-spectrum (BASS-ALE) estimation[J].IEEE Transactions on Acoustics Speech & Signal Processing,1988,36(7):953-964. [10]LYU Y,LIU J Y,GAO S G,et al.Study on robust adaptive beamforming based on acoustic vector sensor array[C]//Oceans.IEEE,2017:1-4. [11]AVOKH A,ABUTALEBI H R.Speech enhancement using linearly constrained adaptive constant directivity beam-formers[J].Applied Acoustics,2010,71(3):262-268. [12]LEI Z,YANG K,DUAN R,et al.Localization of low-frequency coherent sound sources with compressive beamforming-based passive synthetic aperture[J].The Journal of the Acoustical Society of America,2015,137(4):EL255-EL260. [13] COLLOBERT M,FÉRAUD R,TOURNEUR G L,et al.LISTE- N:a system for locating and tracking individual spea- kers[C]//Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.IEEE,1996:283-288. [14]GUSTAFSSON T,RAO B D.Source Localization in Re- verberant Environments:Modeling and Statistical Analysis[C]//IEEE Transactions on Speech and Audio Processing.2003:791-803. [15]DUAN L P.Research on three-dimensional sound source localization of 4-microphone array based on TDOA algorithm [D].Lanzhou:Lanzhou University of Technology,2014. [16]LIU Y F.Research on sound source localization based on microphone array[D].Hangzhou:Hangzhou University of Electronic Science and Technology,2018. [17]ZHANG M,YANG P ,TIAN C,et al.SoundWrite:Text Input on Surfaces through Mobile Acoustic Sensing[C]//International Workshop on Experiences with the Design & Implementation of Smart Objects.ACM,2015:13-17. [18]LUO G,CHEN M S,LI P,et al.SoundWrite II:Ambientacoustic sensing for noise tolerant device-free gesture recognition[C]//Proceedings of the International Conference on Parallel and Distributed Systems.2017:121-126. [19]CAO S,YANG P,LI X,et al.iPand:Accurate Gesture Input with Smart Acoustic Sensing on Hand[C]//2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-3. [20] NANDAKUMAR R ,GOLLAKOTA S ,WATSON N .Contact- less Sleep Apnea Detection on Smartphones[C]//the 13th Annual International Conference.ACM,2015:22-24. [21]TUNG Y C,SHIN K G.EchoTag:Accurate Infrastructure-Free Indoor Location Tagging with Smartphones[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015:525-536. [22]PENG C,SHEN G,ZHANG Y,et al.BeepBeep:A high accuracy acoustic ranging system using COTS mobile devices[C]//Proceedings of the 5th International Conference on Embedded Networked Sensor Systems.2007:1-14. [23] ZHANG Z,CHU D,CHEN X,et al.SwordFight:Enabling a New Class of Phone-to-Phone Action Games on Commodity Phones[C]//Proceedings of the 10th International Conference on Mobile Systems,Applications,and Services.ACM,2012:1-14. [24]GUPTA S,MORRIS D,PATEL S,et al.SoundWave:using the doppler effect to sense gestures[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.ACM,2012:1911-1914. [25]MD T,SIDHANT G,MAYANK G,et al.Doplink:Using the doppler effect for multi-device interaction.[C]//Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing.2013:583-586. [26]CHEN K Y,ASHBROOK D,GOEL M,et al.AirLink:sharing files between multiple devices using in-air gestures[C]//Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing.ACM,2014:565-569. [27]WANG W,LIU A X,SUN K.Device-free gesture tra- cking using acoustic signals[C]//Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking.ACM,2016:82-94. [28]ZHOU M,WANG Q,YANG J,et al.PatternListener:Cracking Android pattern lock using acoustic signals [C]//Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security.2018:1775-1787. [29] NANDAKUMAR R,IYER V,TAN D,et al.FingerIO:Usi- ng Active Sonar for Fine-Grained Finger Tracking[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.2016:1515-1525. [30]SUN K,ZHAO T,WANG W,et al.VSkin:Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking.2018:591-605. [31]KUN Q,CHEN S W,FU X,et al.Acousticcar-diogram:Monitoring Heartbeats using Acoustic Signals on Smart Devices[C]//Proceedings of the IEEE Conference on Computer Commuications.2018:1574-1582. [32]COHEN L.Time-frequency analysis:theory and applications[M].Prentice-Hall,1995. [33]XU Z C,WU K J,HU P.Ultrasonicwaves based gesture recognition method for smartphone platform[J].Computer Enginee-ring and Applications,2018(2):239-245. [34]YANG Q F,TANG H,ZHAO X B,et al.Dolphin:Ultra- sonic-Based Gesture Recognition on Smartphone Platform[C]//Proceedings of the 2014 IEEE 17th International Conference on Computational Science and Engineering (CSE).IEEE,2014:1461-1468. [35]LI X Y,DAI H J,CUI L Z,et al.SonicOperator:Ultr- asonic gesturerecognition with deep neural network on mobiles[C]//Proceedings of the 2017 IEEE SmartWorld,Ubiquitous Intelligence & Computing,Advanced & Trusted Computed,Scalable Computing & Communications,Cloud & Big Data Computing,Internet of People and Smart City Innovation (SmartWorld /SCA- LCOM/UIC/ATC/CBDCom/IOP/SCI) .2017:1-7. [36]HUANG N E,SHEN Z,LONG S R,et al.The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J].In Proceedings of the Royal Society of London A:Mathematical,Physical and EngineeringSciences,1998,454(1971):903-995. [37]LEUNG X,TANFORD S,JIANG L.Is a picture really worth a thousand words?[J].Journal of Hospitality and Tourism Technology,2017,8(1):19-38. [38]XU X ,YU J ,CHEN Y ,et al.Leveraging Acoustic Signals for Vehicle Steering Tracking with Smart- phones[J].IEEE Transactions on Mobile Computing,2020,19(4):865-879. [39]CASTILLO-ESCARIO Y ,FERRER-LLUIS I ,MONTSER-RAT J M ,et al.Entropy Analysis of Acoustic Signals Recorded With a Smartphone for Detecting Apneas and Hypopneas:A Comparison With a Commercial System for Home Sleep Apnea Diagnosis[J].IEEE Access,2019(99):1-1. [40]LING K,DAI H,LIU Y,et al.UltraGesture:Finegra- ined gesture sensing and recognition[C]//Proceedings of the 2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-9. [41]CHENG P,BAGCI I E,ROEDIG U,et al.SonarSnoop:Active acoustic side-channel attacks[C]//Proceedings of the International Journal of Information Security.2018:1-16. |
[1] | 周彦, 陈少昌, 吴可, 宁明强, 陈宏昆, 张鹏. SCTD1.0:声呐常见目标检测数据集 SCTD 1.0:Sonar Common Target Detection Dataset 计算机科学, 2021, 48(11A): 334-339. https://doi.org/10.11896/jsjkx.210100138 |
[2] | 刘林芽, 吴送英, 左志远, 曹子文. 基于YOLOv3算法的山区铁路边坡落石检测方法研究 Research on Rockfall Detection Method of Mountain Railway Slope Based on YOLOv3 Algorithm 计算机科学, 2021, 48(11A): 290-294. https://doi.org/10.11896/jsjkx.201200113 |
[3] | 王晓, 邹泽伟, 李勃勃, 王静. 基于多特征融合的彩色图像声呐目标检测 Target Detection in Colorful Imaging Sonar Based on Multi-feature Fusion 计算机科学, 2019, 46(6A): 177-181. |
[4] | 李孟君, 黎文伟. 基于视觉特性的手机屏幕亮度自适应调节算法 Adaptive Adjustment Algorithm of Mobile Phone Screen Brightness Based on Visual Characteristics 计算机科学, 2019, 46(2): 255-260. https://doi.org/10.11896/j.issn.1002-137X.2019.02.039 |
[5] | 古晓艳,夏志强. 基于二维码的高校教学设备管理系统的设计与实现 Design and Implementation of Teaching Equipment Management System Based on Two-dimensional Code 计算机科学, 2017, 44(Z6): 523-525. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.116 |
[6] | 吴继杰,曹天杰,翟靖轩. BlindLock:一种有效防范污迹攻击的图案锁系统 BlindLock:An Effective Pattern Lock System Against Smudge Attack 计算机科学, 2015, 42(Z11): 364-367. |
[7] | 彭 乐 金 聪. 适用于Android智能手机的灰度均值水印算法 Digital Watermarking Algorithm for Android Smart Phones 计算机科学, 2015, 42(7): 85-90. https://doi.org/10.11896/j.issn.1002-137X.2015.07.018 |
[8] | 谌国风,孔俊俊,郭耀,陈向群. 一种智能手机上下文信息获取的代价模型及其应用 Context Retrieval Cost Model on Smartphones and its Application 计算机科学, 2014, 41(11): 132-136. https://doi.org/10.11896/j.issn.1002-137X.2014.11.026 |
[9] | 杨曜,郭斌,於志文. 一种基于背景声音识别的移动社会活动推荐系统 Mobile Social Activity Recommendation System Based on Background Sound Recognition 计算机科学, 2014, 41(10): 62-66. https://doi.org/10.11896/j.issn.1002-137X.2014.10.014 |
[10] | 丁扬,李石坚,叶志强,潘纲. Scudware Mobile:支持可穿戴设备间数据及服务协同的移动中间件 Scudware Mobile:Mobile Middleware for Collaboration of Data and Services between Wearable Devices 计算机科学, 2014, 41(10): 57-61. https://doi.org/10.11896/j.issn.1002-137X.2014.10.013 |
[11] | 汪仲伟,孙广中. LiveData—基于智能手机传感器的用户数据采集系统 LiveData—A Data Collecting System Based on Sensors in Smart Phones 计算机科学, 2014, 41(10): 27-30. https://doi.org/10.11896/j.issn.1002-137X.2014.10.006 |
[12] | 唐 敏. 基于Android平台的通讯帮手的设计与开发 Designing and Developing the Communication Helper Based on Android 计算机科学, 2012, 39(Z6): 573-576. |
[13] | 孙 源,陈 靖. 智能手机的移动增强现实技术研究 Mobile Augmented Reality Technology Applied on Mobile Phone Platform 计算机科学, 2012, 39(Z6): 493-498. |
[14] | . 基于智能手机的视频共享系统的设计与实现 计算机科学, 2008, 35(7): 244-246. |
[15] | . 一种噪声和畸变混沌信号的滤波策略-Ⅱ:自适应解调 计算机科学, 2006, 33(10): 71-73. |
|