计算机科学 ›› 2020, Vol. 47 ›› Issue (10): 9-18.doi: 10.11896/jsjkx.200300138

所属专题: 群智感知计算 物联网技术 虚拟专题

• 群智感知计算 • 上一篇    下一篇

物联网声呐感知研究综述

陈超1, 赵春蕾1, 张春祥1, 罗辉2   

  1. 1 天津理工大学计算机科学与工程学院 天津300384
    2 解放军信息工程大学电子技术学院 郑州450002
  • 收稿日期:2020-03-23 修回日期:2020-07-29 出版日期:2020-10-15 发布日期:2020-10-16
  • 通讯作者: 赵春蕾(zcltjut@gmail.com)
  • 作者简介:476052121@qq.com
  • 基金资助:
    天津市自然科学青年基金(18JCQNJC69900)

Review of IoT Sonar Perception

CHEN Chao1, ZHAO Chun-lei1, ZHANG Chun-xiang1, LUO Hui2   

  1. 1 School of Computer Science and Engineering,Tianjin University of Technology,Tianjin 300384,China
    2 School of Electronic Technology,PLA Information Engineering University,Zhengzhou 450002,China
  • Received:2020-03-23 Revised:2020-07-29 Online:2020-10-15 Published:2020-10-16
  • About author:CHEN Chao,born in 1991,master student,is a member of China ComputerFederation.His main research interests include audio perceptual and so on.
    ZHAO Chun-lei,born in 1979,Ph.D,associate professor,is a member of China Computer Federation.Her main research interests include cyber security and so on.
  • Supported by:
    Tianjin Natural Science Youth Fund (18JCQNJC69900)

摘要: 近年来,随着科技的快速发展,智能移动设备已经成为人们生活的一部分。智能移动设备的普及为实现声呐感知理论的应用做好了充分的物理支持。声呐信号在传播时受到传播空间和生命活动的调制,因此携带着丰富的生命状态和空间信息。智能手机的普及、通讯技术的成熟以及声学信号的创新型应用,使得声呐感知设备可以实现低成本细粒度的感知收集和计算。利用声学信号在声呐感知技术中无需额外特制硬件的支撑,以及其特有的隐蔽性和高精度等优点,通过提取声学信号的有效特征信息,就可对周边空间信息进行定位计算。文中详细阐述了声学信号在空间定位感知使用技术领域中的已有研究,并对主要技术的基本原理进行了总结,最后分析了声学信号在移动感知应用技术中存在的问题以及未来的发展趋势。

关键词: 超声波信号, 解调, 声呐, 声音阵列, 智能手机

Abstract: In recent years,with the rapid development of technology,smart mobile devices have become a part of people’s lives.The popularity of smart mobile devices provides sufficient physical support for the realization of sonar perception theory.When the sonar signal is propagated,it is modulated by the propagation space and life activities,so it carries a wealth of life state and space information.The popularity of smartphones,the maturity of communication technology,and the innovative use of acoustic signals have enabled sonar sensing devices to achieve low-cost,fine-grained sensing collection and calculation.Utilizing acoustic signals in sonar sensing technology does not require the support of special hardware.With the unique concealment and its typical feature of high accuracy,the acoustic signals can calculate the surrounding space information.This article elaborates on the research history of acoustic signals in the field of spatial positioning and sensing technology,summarizes the basic principles of the main technologies,and finally analyzes the problems and future development trends of acoustic signals in mobile sensing application technology.

Key words: Demodulation, Smart phone, Sonar, Ultrasonic signal, Voice array

中图分类号: 

  • TP393
[1]CAI L,CHEN H.TouchLogger: inferring keystrokes on touch screen from smartphone motion[C]//Proc eedings of the 6th USENIX Conference on Hot Topics in Security.USENIX Association,2011:9-9.
[2]EMILIANO M,ALEXANDER V,SUHRID B,et al.Tapprints:your finger taps have fingerprints[C]//Proceedings of the 10th International Conference on Mobile Systems.2012:323-336.
[3]GUIXIN Y,ZHAN Y T,DING Y F,et al.Cracking Androidpattern lock in five attempts[C]//The Network and Distributed System Security Symposium.Internet Society,2017.
[4]SONG J,GÁBOR S,PECE F,et al.Inair Gestures Around Unmodified Mobile Devices[C]//Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology.2014:319-329.
[5]ZHANG C,TABOR J,ZHANG J,et al.Extending Mobile Interaction Through Near-Field Visible Light Sensing[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015.
[6]LI M,MENG Y,LIU J,et al.When CSI Meets Public WiFi:Inferring Your Mobile Phone Password via WiFi Signals[C]//Proceedings of the 2016 ACM SIGSAC Conference on Computer and Commun ications Security.2016:1068-1079.
[7]JIE Z,XIAOLONG Z,ZHANYONG T,et al.Privacy Leakage in Mobile Sensing:Your Unlock Passwords Can Be Leaked through Wireless Hotspot Functionality[J].Mobile Information Systems,2016(2):1-14.
[8]RODRÍGUEZ V A,TRINIDAD A,GARCÍA B J R,et al.Extended high-frequency (9-20 kHz) audio- metry reference thresholds in 645 healthy subjects[J].International Journal of Audiology,2014,53(8):531-545.
[9]BUCKLEY K M,GRIFFITHS L J.Broad-band signalsubs- pace spatial-spectrum (BASS-ALE) estimation[J].IEEE Transactions on Acoustics Speech & Signal Processing,1988,36(7):953-964.
[10]LYU Y,LIU J Y,GAO S G,et al.Study on robust adaptive beamforming based on acoustic vector sensor array[C]//Oceans.IEEE,2017:1-4.
[11]AVOKH A,ABUTALEBI H R.Speech enhancement using linearly constrained adaptive constant directivity beam-formers[J].Applied Acoustics,2010,71(3):262-268.
[12]LEI Z,YANG K,DUAN R,et al.Localization of low-frequency coherent sound sources with compressive beamforming-based passive synthetic aperture[J].The Journal of the Acoustical Society of America,2015,137(4):EL255-EL260.
[13] COLLOBERT M,FÉRAUD R,TOURNEUR G L,et al.LISTE- N:a system for locating and tracking individual spea- kers[C]//Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.IEEE,1996:283-288.
[14]GUSTAFSSON T,RAO B D.Source Localization in Re- verberant Environments:Modeling and Statistical Analysis[C]//IEEE Transactions on Speech and Audio Processing.2003:791-803.
[15]DUAN L P.Research on three-dimensional sound source localization of 4-microphone array based on TDOA algorithm [D].Lanzhou:Lanzhou University of Technology,2014.
[16]LIU Y F.Research on sound source localization based on microphone array[D].Hangzhou:Hangzhou University of Electronic Science and Technology,2018.
[17]ZHANG M,YANG P ,TIAN C,et al.SoundWrite:Text Input on Surfaces through Mobile Acoustic Sensing[C]//International Workshop on Experiences with the Design & Implementation of Smart Objects.ACM,2015:13-17.
[18]LUO G,CHEN M S,LI P,et al.SoundWrite II:Ambientacoustic sensing for noise tolerant device-free gesture recognition[C]//Proceedings of the International Conference on Parallel and Distributed Systems.2017:121-126.
[19]CAO S,YANG P,LI X,et al.iPand:Accurate Gesture Input with Smart Acoustic Sensing on Hand[C]//2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-3.
[20] NANDAKUMAR R ,GOLLAKOTA S ,WATSON N .Contact- less Sleep Apnea Detection on Smartphones[C]//the 13th Annual International Conference.ACM,2015:22-24.
[21]TUNG Y C,SHIN K G.EchoTag:Accurate Infrastructure-Free Indoor Location Tagging with Smartphones[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015:525-536.
[22]PENG C,SHEN G,ZHANG Y,et al.BeepBeep:A high accuracy acoustic ranging system using COTS mobile devices[C]//Proceedings of the 5th International Conference on Embedded Networked Sensor Systems.2007:1-14.
[23] ZHANG Z,CHU D,CHEN X,et al.SwordFight:Enabling a New Class of Phone-to-Phone Action Games on Commodity Phones[C]//Proceedings of the 10th International Conference on Mobile Systems,Applications,and Services.ACM,2012:1-14.
[24]GUPTA S,MORRIS D,PATEL S,et al.SoundWave:using the doppler effect to sense gestures[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.ACM,2012:1911-1914.
[25]MD T,SIDHANT G,MAYANK G,et al.Doplink:Using the doppler effect for multi-device interaction.[C]//Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing.2013:583-586.
[26]CHEN K Y,ASHBROOK D,GOEL M,et al.AirLink:sharing files between multiple devices using in-air gestures[C]//Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing.ACM,2014:565-569.
[27]WANG W,LIU A X,SUN K.Device-free gesture tra- cking using acoustic signals[C]//Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking.ACM,2016:82-94.
[28]ZHOU M,WANG Q,YANG J,et al.PatternListener:Cracking Android pattern lock using acoustic signals [C]//Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security.2018:1775-1787.
[29] NANDAKUMAR R,IYER V,TAN D,et al.FingerIO:Usi- ng Active Sonar for Fine-Grained Finger Tracking[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.2016:1515-1525.
[30]SUN K,ZHAO T,WANG W,et al.VSkin:Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking.2018:591-605.
[31]KUN Q,CHEN S W,FU X,et al.Acousticcar-diogram:Monitoring Heartbeats using Acoustic Signals on Smart Devices[C]//Proceedings of the IEEE Conference on Computer Commuications.2018:1574-1582.
[32]COHEN L.Time-frequency analysis:theory and applications[M].Prentice-Hall,1995.
[33]XU Z C,WU K J,HU P.Ultrasonicwaves based gesture recognition method for smartphone platform[J].Computer Enginee-ring and Applications,2018(2):239-245.
[34]YANG Q F,TANG H,ZHAO X B,et al.Dolphin:Ultra- sonic-Based Gesture Recognition on Smartphone Platform[C]//Proceedings of the 2014 IEEE 17th International Conference on
Computational Science and Engineering (CSE).IEEE,2014:1461-1468.
[35]LI X Y,DAI H J,CUI L Z,et al.SonicOperator:Ultr- asonic gesturerecognition with deep neural network on mobiles[C]//Proceedings of the 2017 IEEE SmartWorld,Ubiquitous Intelligence & Computing,Advanced & Trusted Computed,Scalable Computing & Communications,Cloud & Big Data Computing,Internet of People and Smart City Innovation (SmartWorld /SCA- LCOM/UIC/ATC/CBDCom/IOP/SCI) .2017:1-7.
[36]HUANG N E,SHEN Z,LONG S R,et al.The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J].In Proceedings of the Royal Society of London A:Mathematical,Physical and EngineeringSciences,1998,454(1971):903-995.
[37]LEUNG X,TANFORD S,JIANG L.Is a picture really worth a thousand words?[J].Journal of Hospitality and Tourism Technology,2017,8(1):19-38.
[38]XU X ,YU J ,CHEN Y ,et al.Leveraging Acoustic Signals for Vehicle Steering Tracking with Smart- phones[J].IEEE Transactions on Mobile Computing,2020,19(4):865-879.
[39]CASTILLO-ESCARIO Y ,FERRER-LLUIS I ,MONTSER-RAT J M ,et al.Entropy Analysis of Acoustic Signals Recorded With a Smartphone for Detecting Apneas and Hypopneas:A Comparison With a Commercial System for Home Sleep Apnea Diagnosis[J].IEEE Access,2019(99):1-1.
[40]LING K,DAI H,LIU Y,et al.UltraGesture:Finegra- ined gesture sensing and recognition[C]//Proceedings of the 2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-9.
[41]CHENG P,BAGCI I E,ROEDIG U,et al.SonarSnoop:Active acoustic side-channel attacks[C]//Proceedings of the International Journal of Information Security.2018:1-16.
[1] 周彦, 陈少昌, 吴可, 宁明强, 陈宏昆, 张鹏.
SCTD1.0:声呐常见目标检测数据集
SCTD 1.0:Sonar Common Target Detection Dataset
计算机科学, 2021, 48(11A): 334-339. https://doi.org/10.11896/jsjkx.210100138
[2] 刘林芽, 吴送英, 左志远, 曹子文.
基于YOLOv3算法的山区铁路边坡落石检测方法研究
Research on Rockfall Detection Method of Mountain Railway Slope Based on YOLOv3 Algorithm
计算机科学, 2021, 48(11A): 290-294. https://doi.org/10.11896/jsjkx.201200113
[3] 王晓, 邹泽伟, 李勃勃, 王静.
基于多特征融合的彩色图像声呐目标检测
Target Detection in Colorful Imaging Sonar Based on Multi-feature Fusion
计算机科学, 2019, 46(6A): 177-181.
[4] 李孟君, 黎文伟.
基于视觉特性的手机屏幕亮度自适应调节算法
Adaptive Adjustment Algorithm of Mobile Phone Screen Brightness Based on Visual Characteristics
计算机科学, 2019, 46(2): 255-260. https://doi.org/10.11896/j.issn.1002-137X.2019.02.039
[5] 古晓艳,夏志强.
基于二维码的高校教学设备管理系统的设计与实现
Design and Implementation of Teaching Equipment Management System Based on Two-dimensional Code
计算机科学, 2017, 44(Z6): 523-525. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.116
[6] 吴继杰,曹天杰,翟靖轩.
BlindLock:一种有效防范污迹攻击的图案锁系统
BlindLock:An Effective Pattern Lock System Against Smudge Attack
计算机科学, 2015, 42(Z11): 364-367.
[7] 彭 乐 金 聪.
适用于Android智能手机的灰度均值水印算法
Digital Watermarking Algorithm for Android Smart Phones
计算机科学, 2015, 42(7): 85-90. https://doi.org/10.11896/j.issn.1002-137X.2015.07.018
[8] 谌国风,孔俊俊,郭耀,陈向群.
一种智能手机上下文信息获取的代价模型及其应用
Context Retrieval Cost Model on Smartphones and its Application
计算机科学, 2014, 41(11): 132-136. https://doi.org/10.11896/j.issn.1002-137X.2014.11.026
[9] 杨曜,郭斌,於志文.
一种基于背景声音识别的移动社会活动推荐系统
Mobile Social Activity Recommendation System Based on Background Sound Recognition
计算机科学, 2014, 41(10): 62-66. https://doi.org/10.11896/j.issn.1002-137X.2014.10.014
[10] 丁扬,李石坚,叶志强,潘纲.
Scudware Mobile:支持可穿戴设备间数据及服务协同的移动中间件
Scudware Mobile:Mobile Middleware for Collaboration of Data and Services between Wearable Devices
计算机科学, 2014, 41(10): 57-61. https://doi.org/10.11896/j.issn.1002-137X.2014.10.013
[11] 汪仲伟,孙广中.
LiveData—基于智能手机传感器的用户数据采集系统
LiveData—A Data Collecting System Based on Sensors in Smart Phones
计算机科学, 2014, 41(10): 27-30. https://doi.org/10.11896/j.issn.1002-137X.2014.10.006
[12] 唐 敏.
基于Android平台的通讯帮手的设计与开发
Designing and Developing the Communication Helper Based on Android
计算机科学, 2012, 39(Z6): 573-576.
[13] 孙 源,陈 靖.
智能手机的移动增强现实技术研究
Mobile Augmented Reality Technology Applied on Mobile Phone Platform
计算机科学, 2012, 39(Z6): 493-498.
[14] .
基于智能手机的视频共享系统的设计与实现

计算机科学, 2008, 35(7): 244-246.
[15] .
一种噪声和畸变混沌信号的滤波策略-Ⅱ:自适应解调

计算机科学, 2006, 33(10): 71-73.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!