Computer Science

Computer Science ›› 2021, Vol. 48 ›› Issue (6A): 638-643.doi: 10.11896/jsjkx.201000010

• Interdiscipline & Application • Previous Articles     Next Articles

Emotion Recognition System Based on Distributed Edge Computing

QIAN Tian-tian1, ZHANG Fan2   

  1. 1 Nanjing Tech University,Nanjing 210000,China
    2 IBM Watson Group,Massachusetls,Boston 02101-02117,USA
  • Online:2021-06-10 Published:2021-06-17
  • About author:QIAN Tian-tian,born in 1996,postgraduate.Her main research interests include edge computing and facial expression recognition.
    ZHANG Fan,born in 1983,Ph.D,professor.His main research interests include cloud computing,big-data processing and artificial intelligence.

PDF (PC)

907

Abstract: In recent years,the combination of edge computing and artificial intelligence has become more and more popular.Facial action unit (AU) detection recognizes facial expressions by analyzing cues about the movement of certain atomic muscles in the local facial area.According to the detection of facial feature points,we can calculate the values of AU,and then use classification algorithms for emotion recognition.However,in the actual production process,due to the tremendous network overhead of transferring the facial action unit feature data,it poses new challenges of this system being deployed in a distributed manner while running in production.Therefore,we design a lightweight edge computing based distributed system using Raspberry Pi tailed for this need,and optimize the data transfer and components deployment.In the vicinity,the front-end and back-end processing modes are separated to reduce round-trip delay,thereby completing complex computing tasks and providing high-reliability,large-scale connection services.

Key words: Distributed computing, Eedge computing, Emotion recognition, Facial action unit, Raspberry Pi

CLC Number: 

  • TP183
[1] BALTRUSAITI T,MAHMOUD M,ROBINSON P.Cross-dataset learning and person-specific normalisation for automatic action unit detection[C]//2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).IEEE,2015,6:1-6.
[2] ZADEH A,BALTRUSAITIS T,MORENCY L P.Convolutional experts network for facial landmark detection[C]//Proceedings of the International Conference on Computer Vision & Pattern Recognition (CVPRW),Faces-in-the-wild Work-shop/Challenge,2017,3(5):11.
[3] MERKEL D.Docker:lightweight linux containers for consistent development and deployment[J].Linux Journal,2014,2014(239):2.
[4] LUCEY P,COHN J F,KANADE T,et al.The Extended Cohn-Kanade Dataset (CK+)_A complete dataset for action unit and emotion-specified expression[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).2010:94-101.
[5] PETER R,RANA E K.Computation of emotions in man and machines[J].Philosophical Transactions of the Royal Society of London,2009,364(1535):3441-3447.
[6] MATSUYAMA Y,BHARDWAJ A,ZHAO R,et al.Socially-aware animated intelligent personal assistant agent[C]//Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue.2016:224-227.
[7] MCDUFF D,EL KALIOUBY R,DEMIRDJIAN D,et al.Predicting online media effectiveness based on smile responses gathered over the internet[C]//FG.2013.
[8] GIRARD M,COHN J F,MAHOOR M H,et al.Social risk and depression:Evidence from manual and automatic facial expression analysis[C]//IEEE International Conference & Workshops on Automatic Face & Gesture Recognition.2013.
[9] EKMAN R.What the face reveals:Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS)[M].Oxford University Press,USA,1997.
[10] HAGER J C.A comparison of units for visually measuring facial actions[J].Behavior Research Methods Instruments & Computers,1985,17(4):450-468.
[11] WANG T,ZHANG G,LIU A,et al.A Secure IoT Service Architecture with an Efficient Balance Dynamics Based on Cloud and Edge Computing[J].IEEE Internet of Things Journal,2019,6(3):4831-4843.
[12] ZHOU Z,CHEN X,LI E,et al.Edge intelligence:Paving the last mile of artificial intelligence with edge computing[J].Proceedings of the IEEE,2019,107(8):1738-1762.
[13] ZHANG X,WANG Y,LU S,et al.Openei:An open framework for edge intelligence[J].CoRR,abs/1906.01864,2019.
[14] YI S,LI C,LI Q.A survey of fog computing:concepts,applications and issues[C]//Proceedings of the 2015 Workshop on Mobile Big Data.ACM,2015:37-42.
[15] ZHANG H,LIU B,SUSANTO H,et al.Incentive mechanismfor proximity-based Mobile Crowd Service systems[C]//IEEE INFOCOM 2016-the 35th IEEE International Conference on Computer Communications.2016:1-5.
[16] OTTENWALDER B,KOLDEHOFE B,ROTHERMEL K,et al.Migcep:Operator Migration for Mobility Driven Distributed Complex Event Processing[C]//Proc.of ACM DEBS.2013:183-194.
[17] ABE Y,GEAMBASU R,JOSHI K,et al.vTube:efficientstreaming of virtual appliances over lastmile networks[C]//Proc.of the 4th annual Symposium on Cloud Computing.ACM,2013.
[18] HA K,CHEN Z,HU W,et al.Towards wearable cognitive assistance[C]//Proc.of ACM MobiSys.2014.
[19] WANG S,URGAONKAR R,ZAFER M,et al.Dynamic service migration in mobile edge-clouds[C]//2015 IFIP Networking Conference (IFIP Networking).IEEE,2015:1-9.
[20] WANG X,HAN Y,WANG C,et al.In-Edge AI:Intelligentizing Mobile Edge Computing,Caching and Communication by Federated Learning[J].IEEE Network,2019,33(5):156-165.
[21] WANG T,LUO H,ZHENG X,et al.Crowd sourcing mecha-nism for trust evaluation in cpcs based on intelligent mobile edge computing[J].ACM Transactions on Intelligent Systems and Technology (TIST),2019,10(6):62.
[22] MICHAEL J,LYONS S,AKEMASTU M,et al.GYOBA.Coding Facial Expressions with Gabor Wavelets[C]//3rd IEEE International Conference on Automatic Face and Gesture Recognition.1998:200-205.
[23] SAGONAS C,TZIMIROPOULOS G,ZAFEIRIOU S,et al.300facesin-the-wild challenge:The first facial landmark localization challenge[C]//Proceedings of the IEEE International Conference on Computer Vision Workshops.2013:397-403.
[24] SAGONAS C,TZIMIROPOULOS G,ZAFEIRIOU S,et al.Asemi-automatic methodology for facial landmark annotation[C]//Proceedings of the IEE Conference on Computer Vision and Pattern Recognition Workshops (CVPR-W).Workshop on Analysis and Modeling of Faces and Gestures.2013.
[25] ZHU X,RAMANAN D.Face detection,pose estimation,andland-mark localization in the wild[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2012:2879-2886.
[26] SAGONAS C,TZIMIROPOULOS G,ZAFEIRIOU S,et al.300facesinthewild challenge:The first facial landmark localization challenge[C]//ICCV.2013.
[27] BELHUMEUR P N,JACOBS D W,KRIEGMAN D J,et al.Localizing parts of faces using a consensus of exemplars[C]//VPR.2011.
[28] LE V,BRANDT J,LIN Z,et al.Interactive facial feature localization[C]//Computer Vision-ECCV 2012.Springer,2012:679-692.
[29] ZAFEIRIOU S.The menpo facial landmark localisation chal-lenge[C]//Computer Vision and Pattern Recognition Workshops (CVPRW).2017.
[30] SCOCA V,ARAL A,BRANDIC I,et al.Scheduling Latency-Sensitive Applications in Edge Computing[C]//Closer.2018:158-168.
[1] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[2] GAO Yue, FU Xiang-ling, OUYANG Tian-xiong, CHEN Song-ling, YAN Chen-wei. EEG Emotion Recognition Based on Spatiotemporal Self-Adaptive Graph ConvolutionalNeural Network [J]. Computer Science, 2022, 49(4): 30-36.
[3] WANG Ru-bin, LI Rui-yuan, HE Hua-jun, LIU Tong, LI Tian-rui. Distributed Distance Join Algorithm for Massive Spatial Data [J]. Computer Science, 2022, 49(1): 95-100.
[4] YUAN Chen-yu, XIE Zai-peng, ZHU Xiao-rui, QU Zhi-hao, XU Yuan-yuan. Convolutional Optimization Algorithm Based on Distributed Coding [J]. Computer Science, 2021, 48(2): 47-54.
[5] CHAI Bing, LI Dong-dong, WANG Zhe, GAO Da-qi. EEG Emotion Recognition Based on Frequency and Channel Convolutional Attention [J]. Computer Science, 2021, 48(12): 312-318.
[6] ZHENG Chun-jun, WANG Chun-li, JIA Ning. Survey of Acoustic Feature Extraction in Speech Tasks [J]. Computer Science, 2020, 47(5): 110-119.
[7] LI Bo-jia, ZHANG Yang-sen, CHEN Ruo-yu. Method for Generating Massive Data with Assignable Distribution [J]. Computer Science, 2019, 46(8): 56-63.
[8] WU Liang-qing, ZHANG Dong, LI Shou-shan, CHEN Ying. Multi-modal Emotion Recognition Approach Based on Multi-task Learning [J]. Computer Science, 2019, 46(11): 284-290.
[9] YIN Hao, XU Jian, LI Shou-shan, ZHOU Guo-dong. Emotion Recognition on Microblog Based on Character and Word Features [J]. Computer Science, 2018, 45(11A): 105-109.
[10] ZHU Kun, HUANG Rui-zhang and ZHANG Na-na. Efficient Frequent Patterns Mining Algorithm Based on MapReduce Model [J]. Computer Science, 2017, 44(7): 31-37.
[11] HUANG Lei, LI Shou-shan and ZHOU Guo-dong. Emotion Recognition of Chinese Microblogs with Syntactic Information [J]. Computer Science, 2017, 44(2): 244-249.
[12] ZHU Kai-long, LU Yu-liang and YANG Bin. Study on Invulnerability of Router-level Internet Based on MapReduce [J]. Computer Science, 2017, 44(11): 168-174.
[13] HE Ming, WU Xiao-fei, CHANG Meng-meng and REN Wan-peng. Distributed Collaborative Filtering Recommendation Based on User Co-occurrence Matrix Multiplier [J]. Computer Science, 2016, 43(Z11): 428-435.
[14] YIN Xiao-bo and LUO En. Relaxed Optimal Balanced Streaming Graph Partitioning Algorithm [J]. Computer Science, 2016, 43(4): 231-234.
[15] JIN Qin, CHEN Shi-zhe, LI Xi-rong, YANG Gang and XU Jie-ping. Speech Emotion Recognition Based on Acoustic Features [J]. Computer Science, 2015, 42(9): 24-28.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.