Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (1): 194-203.doi: 10.11896/jsjkx.201100107

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality

CHEN Le1, GAO Ling1,2, REN Jie3, DANG Xin1, WANG Yi-hao1, CAO Rui1, ZHENG Jie1, WANG Hai1   

  1. 1 School of Information Science and Technology,Northwest University,State-Province Joint Engineering and Research Center of Advanced Networking and Intelligent Information Services,Xi'an 710127,China
    2 College of Computer Science State-Province,Xi'an Polytechnic University,Joint Engineering and Research Center of Advanced Networking and Intelligent Information Services,Xi'an 710600,China
    3 School of Computer Science,Shaanxi Normal University,Xi'an 710119,China
  • Received:2020-11-16 Revised:2021-04-12 Online:2022-01-15 Published:2022-01-18
  • About author:CHEN Le,born in 1996,postgraduate.Her main research interests include mobile computing and deep learning.
    GAO Ling,born in 1964,Ph.D,professor,is a member of China Computer Federation.His main research interests include cyber security,network ma-nagement and embedded system.
  • Supported by:
    National Natural Science Foundation of China(61672552) and Science and Technology Program of Guangzhou,China(202002020045).

PDF (PC)

718

Abstract: With the development of the mobile augmented reality (MAR),users have higher requirements on video quality and response time on it.MAR applications offload computation-intensive tasks to the cloud or edge servers for processing.In order to provide users with high-quality rendering services,MAR needs to download massive amounts of data from cloud or edge servers.Due to the instability of network condition and the limitation of network bandwidth,data transmission will extend MAR application response time,which increases the energy consumption,and seriously affects the user experience.This paper proposes a bit-rate adaptive model based on gradient boosting regression (GBR).The model considers the different needs of users in different network conditions,analyzes the features of the 200 popular videos,finds the connection between the video features and the user requirements,and provides appropriate video bitrate configuration according to different needs,thus to achieve the goal of maintaining experience,reducing latency and saving energy.The results show that compared with the original rendered 1080p video,the proposed bitrate adaptive model can save 58% downloading time latency(19.13 ms) per frame while maintaining the user's viewing experience as much as possible.

Key words: Bitrate adaptive control, Gradient boosting regression, Mobile augmented reality, Performance optimization

CLC Number: 

  • TP391
[1]CHEN H X,DAI Y T,MENG H,et al.Understanding the cha-racteristics of mobile augmented reality applications[C]//2018 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS).Piscataway NJ:IEEE,2018:128-138.
[2]ZHOU Y Q,SUN B L,QI Y L,et al.Mobile AR/VR in 5Gbased on csonvergence of communication and computing[J].Telecommunications Science,2018,34(8):19-33.
[3]LIU G Q.Research on offloading strategy based on mobile edge computing[D].Harbin:Harbin Institute of Technology,2018.
[4]SHAUKAT N.Minimization of energy consumption for mobile edge computing-based augmented reality application[D].Beijing:Beijing University of Post and Telecommunication,2019.
[5]GALIH S,IANSYAH S,YUDISTIRA H.Location and orientation based augmented reality mobile application for enhancing heritage landmark history and information[J].Universal Journal of Electrical and Electronic Engineering,2019,6(2A):39-45.
[6]KICO I,LIAROKAPIS F.Investigating the learning process of folk dances using mobile augmented reality[J].Applied Sciences,2020,10(2):599.
[7]CHEN Y H,RAVINDRANATH L,DENG S,et al.Glimpse:Continuous,real-time object recognition on mobile devices[C]//Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems(Sensys).New York NY:ACM,2015:155-168.
[8]REN J,GAO L,YU J L,et al.Energy-efficient Deep Learning Task Scheduling Strategy for Edge Device[J].Chinese Journal of Computers,2020,43(3):440-452.
[9]LIU L Y,LI H Y,GRUTESER M.Edge assisted real-time object detection for mobile augmented reality[C]//Proc of the the 25th Annual International Conference on Mobile Computing and Networking(MobiCom'19).New York NY:ACM,2019:1-16.
[10]ZHANG W X,LIN S K,BIJARBOONEH F H.CloudAR:A Cloud-based Framework for Mobile Augmented Reality[C]//Proceedings of the on Thematic Workshops of ACM Multimedia(Workshops '17).2017:194-200.
[11]QIAN F,HAN B,XIAO Q Y.Flare:practical viewport-adaptive 360-degree video streaming for mobile devices[C]//:Proc of the 24th Annual International Conference on Mobile Computing and Networking(MobiCom'18).New York NY:ACM,India,2018:99-114.
[12]LENG Y,CHEN C C,SUN Q Y,et al.Energy-efficient videoprocessing for virtual reality[C]//Proceedings of the 46th International Symposium on Computer Architecture (ISCA).New York NY:ACM,2019:91-103.
[13]RUAN X K,CHEN H L,ZHU X D,et al.Deep decision:a mobile deep learning framework for edge video analytics[C]//INFOCOM,IEEE Conference on Computer Communications (INFOCOM).Piscataway NJ:IEEE,2018:1421-1429.
[14]ZHAO H,SHI J,QI X,et al.Pyramid scene parsing network[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2017:2881-2890.
[15]LI Y,SHI J,LIN D.Low-latency video semantic segmentation[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2018:5997-6005.
[16]GADDE R,JAMPANI V,GEHLER P V.Semantic video cnns through representation warping[C]//The IEEE Interational Conference on Computer Vision (ICCV).Piscataway NJ:IEEE,2017:4453-4462.
[17]ZHU X,XIONG Y,DAI J,et al.Deep feature flow for video re-cognition[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2017:2349-2358.
[18]LIU N,HAN J.Deep hierarchical saliency network for salient object detection[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2016:678-686.
[19]WANG L,LU H,RUAN X,et al.Deep networks for saliencydetection via local estimation and global search[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2015:3183-3192.
[20]ZHAO R,OUYANG W,LI H,et al.Saliency detection by multi-context deep learning[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2015:1265-1274.
[21]DONOSER M,URSCHLER M,HIRZER M,et al.Saliencydriven total variation segmentation[C]//The IEEE Interational Conference on Computer Vision(ICCV).Piscataway NJ:IEEE,2009:817-824.
[22]BAI X,WANG W,LIANG J.An active contour model based on region saliency for image segmentation[J].Journal of Computer Research and Development,2012:49(12):2686-2695.
[23]BORJI A,FRINTROP S,SIHITE D L,et al.Adaptive objecttracking by learning background context[C]//2012 IEEE Computer Society Conference on Computer Vision and Pattern Re-cognition Workshops.Piscataway NJ:IEEE,2012:23-30.
[24]GAO Y,WANG M,TAO D,et al.3-D object retrieval and re-cognition with hypergraph analysis[J].IEEE Transactions on Image Processing,2012,21(9):4290-4303.
[25]REN J,WANG X,FANG J.Proteus:network-aware web browsing on heterogeneous mobile systems[C]//Proc of the 14th International Conference on Emerging Networking Experiments and Technologies.New York NY:ACM,2018:379-392.
[26]REN J,YUAN L,NURMI P,et al.Camel:smart,adaptive energy optimization for mobile web interactions[C]//IEEE Confe-rence on Computer Communications (INFOCOM).Piscataway NJ:IEEE,2020:119-128.
[27]QIN Q,REN J,GAO L,et al.To compress,or not to compress:Characterizing deep learning model compression for embedded inference[C]//2018 IEEE Intl Symp on Parallel and Distributed Processing with Applications(ISPA).Piscataway NJ:IEEE,2019:729-736
[28]MARK B,ADRIAN C,GUN L.A survey of augmented reality[M].Boston,Amercia:Now Publishers Foundations and Trends,2015:126-146
[29]HOU Q I,CHEN M M,HU X,et al.Deeply supervised salient object detection with short connections [C]//The IEEEConfe-rence on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2017:3203-3212
[30]WAN S,YANG Z F.A new generation of efficient video coding H.265/HEVC:principle,standard and implementation[M].Beijing Publishing House of Electronics Industry,2014:2-15.
[31]BT R I.Methodology for the subjective assessment of videoquality in multimedia applications[S].Geneva:The InternationalTelecommunication Union (ITU),2007.
[32]SEVCIK L,BEHAN L,FRNDA J,et al.Prediction of subjective video quality based on objective assessment[C]//2018 26th Te-lecommunications Forum (TELFOR).Piscataway NJ:IEEE,2018:1-4.
[33]JEROME H F.Greedy Function approximation:a gradient boosting machine[J].Annals of Statistics,2001,29(5):1189-1232.
[34]LEO B.Bagging predictors[J].Machine Learning,1996(24):123-140
[35]FREUND Y,SCHAPIRE R E.A decision-theoretic generalization of on-line learning and an application to boosting[J].Journal of Computer and System Sciences,1997,55(1):119-139.
[36]BREIMAN L,FRIEDMAN J H,OLSHEN R A,et al.Classification and regression trees[J].International Biometric Society,1984,40(3):874-874.
[37]BLAU Y,MICHAELI T.The perception-distortion Tradeoff[C]//The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Piscataway NJ:IEEE,2018:6228-6237.
[38]ANISH M,RAJIV S,ALAN B.Making a “Completely Blind” Image Quality Analyzer[J].IEEE Signal Processing Letters,2013,20(3):209-212.
[39]MA C,YANG C,YANG X.Learning a No-Reference Quality Metric for Single-Image Super-Resolution[J].Computer Vision and Image Understanding,2016,158:1-16.
[1] CHEN Jun-wu, YU Hua-shan. Strategies for Improving Δ-stepping Algorithm on Scale-free Graphs [J]. Computer Science, 2022, 49(6A): 594-600.
[2] E Hai-hong, ZHANG Tian-yu, SONG Mei-na. Web-based Data Visualization Chart Rendering Optimization Method [J]. Computer Science, 2021, 48(3): 119-123.
[3] ZHANG Xiao, ZHANG Si-meng, SHI Jia, DONG Cong, LI Zhan-huai. Review on Performance Optimization of Ceph Distributed Storage System [J]. Computer Science, 2021, 48(2): 1-12.
[4] XU Jiang-feng and TAN Yu-long. Research on HBase Configuration Parameter Optimization Based on Machine Learning [J]. Computer Science, 2020, 47(6A): 474-479.
[5] ZHANG Peng-yi, SONG Jie. Research Advance on Efficiency Optimization of Blockchain Consensus Algorithms [J]. Computer Science, 2020, 47(12): 296-303.
[6] XU Chuan-fu,WANG Xi,LIU Shu,CHEN Shi-zhao,LIN Yu. Large-scale High-performance Lattice Boltzmann Multi-phase Flow Simulations Based on Python [J]. Computer Science, 2020, 47(1): 17-23.
[7] ZHANG Ling-hao, GUI Sheng-lin, MU Feng-jun, WANG Sheng. Clone Detection Algorithm for Binary Executable Code with Suffix Tree [J]. Computer Science, 2019, 46(10): 141-147.
[8] XU Qi-ze, HAN Wen-ting, CHEN Jun-shi, AN Hong. Optimization of Breadth-first Search Algorithm Based on Many-core Platform [J]. Computer Science, 2019, 46(1): 314-319.
[9] SHEN Xia-jiong, ZHANG Jun-tao, HAN Dao-jun. Short-term Traffic Flow Prediction Model Based on Gradient Boosting Regression Tree [J]. Computer Science, 2018, 45(6): 222-227.
[10] SUN Tao, ZHANG Jun-xing. Review of SDN Performance Optimization Technology [J]. Computer Science, 2018, 45(11A): 84-91.
[11] SUN Zhi-long, Edwin H-M Sha, ZHUGE Qing-feng, CHEN Xian-zhang and WU Kai-jie. Research on Data Consistency for In-memory File Systems [J]. Computer Science, 2017, 44(2): 222-227.
[12] NI You-cong, LI Song, YE Peng and DU Xin. Random Search Rule Based Performance Evolutionary Optimization Method at Software Architecture Level [J]. Computer Science, 2017, 44(11): 156-163.
[13] ZHAO Li-wei, CHEN Xian-zhang and ZHUGE Qing-feng. Performance Comparison of Join Operations on SIMFS and EXT4 [J]. Computer Science, 2016, 43(6): 184-187.
[14] KE Ye-qing, MA Zhi-rou, WU Hai-jiang and LIU Jie. SmartHR:A Resume Query and Management System Based on Semantic Web [J]. Computer Science, 2015, 42(12): 56-59.
[15] DU Xin, WANG Chun-yan, NI You-cong, YE Peng and XIAO Ru-liang. Rule-based Performance Optimization Model at Software Architecture Level [J]. Computer Science, 2015, 42(10): 189-192.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.