Computer Science

Computer Science ›› 2020, Vol. 47 ›› Issue (10): 9-18.doi: 10.11896/jsjkx.200300138

Special Issue: Mobile Crowd Sensing and Computing; Internet of Things

• Mobile Crowd Sensing and Computing • Previous Articles     Next Articles

Review of IoT Sonar Perception

CHEN Chao1, ZHAO Chun-lei1, ZHANG Chun-xiang1, LUO Hui2   

  1. 1 School of Computer Science and Engineering,Tianjin University of Technology,Tianjin 300384,China
    2 School of Electronic Technology,PLA Information Engineering University,Zhengzhou 450002,China
  • Received:2020-03-23 Revised:2020-07-29 Online:2020-10-15 Published:2020-10-16
  • About author:CHEN Chao,born in 1991,master student,is a member of China ComputerFederation.His main research interests include audio perceptual and so on.
    ZHAO Chun-lei,born in 1979,Ph.D,associate professor,is a member of China Computer Federation.Her main research interests include cyber security and so on.
  • Supported by:
    Tianjin Natural Science Youth Fund (18JCQNJC69900)

PDF (PC)

2065

Abstract: In recent years,with the rapid development of technology,smart mobile devices have become a part of people’s lives.The popularity of smart mobile devices provides sufficient physical support for the realization of sonar perception theory.When the sonar signal is propagated,it is modulated by the propagation space and life activities,so it carries a wealth of life state and space information.The popularity of smartphones,the maturity of communication technology,and the innovative use of acoustic signals have enabled sonar sensing devices to achieve low-cost,fine-grained sensing collection and calculation.Utilizing acoustic signals in sonar sensing technology does not require the support of special hardware.With the unique concealment and its typical feature of high accuracy,the acoustic signals can calculate the surrounding space information.This article elaborates on the research history of acoustic signals in the field of spatial positioning and sensing technology,summarizes the basic principles of the main technologies,and finally analyzes the problems and future development trends of acoustic signals in mobile sensing application technology.

Key words: Demodulation, Smart phone, Sonar, Ultrasonic signal, Voice array

CLC Number: 

  • TP393
[1]CAI L,CHEN H.TouchLogger: inferring keystrokes on touch screen from smartphone motion[C]//Proc eedings of the 6th USENIX Conference on Hot Topics in Security.USENIX Association,2011:9-9.
[2]EMILIANO M,ALEXANDER V,SUHRID B,et al.Tapprints:your finger taps have fingerprints[C]//Proceedings of the 10th International Conference on Mobile Systems.2012:323-336.
[3]GUIXIN Y,ZHAN Y T,DING Y F,et al.Cracking Androidpattern lock in five attempts[C]//The Network and Distributed System Security Symposium.Internet Society,2017.
[4]SONG J,GÁBOR S,PECE F,et al.Inair Gestures Around Unmodified Mobile Devices[C]//Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology.2014:319-329.
[5]ZHANG C,TABOR J,ZHANG J,et al.Extending Mobile Interaction Through Near-Field Visible Light Sensing[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015.
[6]LI M,MENG Y,LIU J,et al.When CSI Meets Public WiFi:Inferring Your Mobile Phone Password via WiFi Signals[C]//Proceedings of the 2016 ACM SIGSAC Conference on Computer and Commun ications Security.2016:1068-1079.
[7]JIE Z,XIAOLONG Z,ZHANYONG T,et al.Privacy Leakage in Mobile Sensing:Your Unlock Passwords Can Be Leaked through Wireless Hotspot Functionality[J].Mobile Information Systems,2016(2):1-14.
[8]RODRÍGUEZ V A,TRINIDAD A,GARCÍA B J R,et al.Extended high-frequency (9-20 kHz) audio- metry reference thresholds in 645 healthy subjects[J].International Journal of Audiology,2014,53(8):531-545.
[9]BUCKLEY K M,GRIFFITHS L J.Broad-band signalsubs- pace spatial-spectrum (BASS-ALE) estimation[J].IEEE Transactions on Acoustics Speech & Signal Processing,1988,36(7):953-964.
[10]LYU Y,LIU J Y,GAO S G,et al.Study on robust adaptive beamforming based on acoustic vector sensor array[C]//Oceans.IEEE,2017:1-4.
[11]AVOKH A,ABUTALEBI H R.Speech enhancement using linearly constrained adaptive constant directivity beam-formers[J].Applied Acoustics,2010,71(3):262-268.
[12]LEI Z,YANG K,DUAN R,et al.Localization of low-frequency coherent sound sources with compressive beamforming-based passive synthetic aperture[J].The Journal of the Acoustical Society of America,2015,137(4):EL255-EL260.
[13] COLLOBERT M,FÉRAUD R,TOURNEUR G L,et al.LISTE- N:a system for locating and tracking individual spea- kers[C]//Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.IEEE,1996:283-288.
[14]GUSTAFSSON T,RAO B D.Source Localization in Re- verberant Environments:Modeling and Statistical Analysis[C]//IEEE Transactions on Speech and Audio Processing.2003:791-803.
[15]DUAN L P.Research on three-dimensional sound source localization of 4-microphone array based on TDOA algorithm [D].Lanzhou:Lanzhou University of Technology,2014.
[16]LIU Y F.Research on sound source localization based on microphone array[D].Hangzhou:Hangzhou University of Electronic Science and Technology,2018.
[17]ZHANG M,YANG P ,TIAN C,et al.SoundWrite:Text Input on Surfaces through Mobile Acoustic Sensing[C]//International Workshop on Experiences with the Design & Implementation of Smart Objects.ACM,2015:13-17.
[18]LUO G,CHEN M S,LI P,et al.SoundWrite II:Ambientacoustic sensing for noise tolerant device-free gesture recognition[C]//Proceedings of the International Conference on Parallel and Distributed Systems.2017:121-126.
[19]CAO S,YANG P,LI X,et al.iPand:Accurate Gesture Input with Smart Acoustic Sensing on Hand[C]//2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-3.
[20] NANDAKUMAR R ,GOLLAKOTA S ,WATSON N .Contact- less Sleep Apnea Detection on Smartphones[C]//the 13th Annual International Conference.ACM,2015:22-24.
[21]TUNG Y C,SHIN K G.EchoTag:Accurate Infrastructure-Free Indoor Location Tagging with Smartphones[C]//Proceedings of the 21st Annual International Conference on Mobile Computing and Networking.2015:525-536.
[22]PENG C,SHEN G,ZHANG Y,et al.BeepBeep:A high accuracy acoustic ranging system using COTS mobile devices[C]//Proceedings of the 5th International Conference on Embedded Networked Sensor Systems.2007:1-14.
[23] ZHANG Z,CHU D,CHEN X,et al.SwordFight:Enabling a New Class of Phone-to-Phone Action Games on Commodity Phones[C]//Proceedings of the 10th International Conference on Mobile Systems,Applications,and Services.ACM,2012:1-14.
[24]GUPTA S,MORRIS D,PATEL S,et al.SoundWave:using the doppler effect to sense gestures[C]//Proceedings of the SIGCHI Conference on Human Factors in Computing Systems.ACM,2012:1911-1914.
[25]MD T,SIDHANT G,MAYANK G,et al.Doplink:Using the doppler effect for multi-device interaction.[C]//Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing.2013:583-586.
[26]CHEN K Y,ASHBROOK D,GOEL M,et al.AirLink:sharing files between multiple devices using in-air gestures[C]//Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing.ACM,2014:565-569.
[27]WANG W,LIU A X,SUN K.Device-free gesture tra- cking using acoustic signals[C]//Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking.ACM,2016:82-94.
[28]ZHOU M,WANG Q,YANG J,et al.PatternListener:Cracking Android pattern lock using acoustic signals [C]//Proceedings of the 2018 ACM SIGSAC Conference on Computer and Communications Security.2018:1775-1787.
[29] NANDAKUMAR R,IYER V,TAN D,et al.FingerIO:Usi- ng Active Sonar for Fine-Grained Finger Tracking[C]//Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.2016:1515-1525.
[30]SUN K,ZHAO T,WANG W,et al.VSkin:Sensing Touch Gestures on Surfaces of Mobile Devices Using Acoustic Signals[C]//Proceedings of the 24th Annual International Conference on Mobile Computing and Networking.2018:591-605.
[31]KUN Q,CHEN S W,FU X,et al.Acousticcar-diogram:Monitoring Heartbeats using Acoustic Signals on Smart Devices[C]//Proceedings of the IEEE Conference on Computer Commuications.2018:1574-1582.
[32]COHEN L.Time-frequency analysis:theory and applications[M].Prentice-Hall,1995.
[33]XU Z C,WU K J,HU P.Ultrasonicwaves based gesture recognition method for smartphone platform[J].Computer Enginee-ring and Applications,2018(2):239-245.
[34]YANG Q F,TANG H,ZHAO X B,et al.Dolphin:Ultra- sonic-Based Gesture Recognition on Smartphone Platform[C]//Proceedings of the 2014 IEEE 17th International Conference on
Computational Science and Engineering (CSE).IEEE,2014:1461-1468.
[35]LI X Y,DAI H J,CUI L Z,et al.SonicOperator:Ultr- asonic gesturerecognition with deep neural network on mobiles[C]//Proceedings of the 2017 IEEE SmartWorld,Ubiquitous Intelligence & Computing,Advanced & Trusted Computed,Scalable Computing & Communications,Cloud & Big Data Computing,Internet of People and Smart City Innovation (SmartWorld /SCA- LCOM/UIC/ATC/CBDCom/IOP/SCI) .2017:1-7.
[36]HUANG N E,SHEN Z,LONG S R,et al.The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J].In Proceedings of the Royal Society of London A:Mathematical,Physical and EngineeringSciences,1998,454(1971):903-995.
[37]LEUNG X,TANFORD S,JIANG L.Is a picture really worth a thousand words?[J].Journal of Hospitality and Tourism Technology,2017,8(1):19-38.
[38]XU X ,YU J ,CHEN Y ,et al.Leveraging Acoustic Signals for Vehicle Steering Tracking with Smart- phones[J].IEEE Transactions on Mobile Computing,2020,19(4):865-879.
[39]CASTILLO-ESCARIO Y ,FERRER-LLUIS I ,MONTSER-RAT J M ,et al.Entropy Analysis of Acoustic Signals Recorded With a Smartphone for Detecting Apneas and Hypopneas:A Comparison With a Commercial System for Home Sleep Apnea Diagnosis[J].IEEE Access,2019(99):1-1.
[40]LING K,DAI H,LIU Y,et al.UltraGesture:Finegra- ined gesture sensing and recognition[C]//Proceedings of the 2018 15th Annual IEEE International Conference on Sensing,Communication,and Networking (SECON).2018:1-9.
[41]CHENG P,BAGCI I E,ROEDIG U,et al.SonarSnoop:Active acoustic side-channel attacks[C]//Proceedings of the International Journal of Information Security.2018:1-16.
[1] LIU Lin-ya, WU Song-ying, ZUO Zhi-yuan, CAO Zi-wen. Research on Rockfall Detection Method of Mountain Railway Slope Based on YOLOv3 Algorithm [J]. Computer Science, 2021, 48(11A): 290-294.
[2] ZHOU Yan, CHEN Shao-chang, WU Ke, NING Ming-qiang, CHEN Hong-kun, ZHANG Peng. SCTD 1.0:Sonar Common Target Detection Dataset [J]. Computer Science, 2021, 48(11A): 334-339.
[3] WANG Xiao, ZOU Ze-wei, LI Bo-bo, WANG Jing. Target Detection in Colorful Imaging Sonar Based on Multi-feature Fusion [J]. Computer Science, 2019, 46(6A): 177-181.
[4] GU Xiao-yan and XIA Zhi-qiang. Design and Implementation of Teaching Equipment Management System Based on Two-dimensional Code [J]. Computer Science, 2017, 44(Z6): 523-525.
[5] PENG Le JIN Cong. Digital Watermarking Algorithm for Android Smart Phones [J]. Computer Science, 2015, 42(7): 85-90.
[6] YANG Yao,GUO Bin and YU Zhi-wen. Mobile Social Activity Recommendation System Based on Background Sound Recognition [J]. Computer Science, 2014, 41(10): 62-66.
[7] WANG Zhong-wei and SUN Guang-zhong. LiveData—A Data Collecting System Based on Sensors in Smart Phones [J]. Computer Science, 2014, 41(10): 27-30.
[8] . Designing and Developing the Communication Helper Based on Android [J]. Computer Science, 2012, 39(Z6): 573-576.
[9] . [J]. Computer Science, 2008, 35(7): 244-246.
[10] . [J]. Computer Science, 2006, 33(10): 71-73.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.