%A LI Jie, LING Xing-hong, FU Yu-chen, LIU Quan %T Asynchronous Advantage Actor-Critic Algorithm with Visual Attention Mechanism %0 Journal Article %D 2019 %J Computer Science %R 10.11896/j.issn.1002-137X.2019.05.026 %P 169-174 %V 46 %N 5 %U {https://www.jsjkx.com/CN/abstract/article_18177.shtml} %8 %X Asynchronous deep reinforcement learning (ADRL) can greatly reduce the training time required for learning models by adopting the multiple threading techniques.However,as an exemplary algorithm of ADRL,asynchronous advantage actor-critic (A3C) algorithm fails to completely utilize some valuable regional information,leading to unsatisfactory performance for model training.Aiming at the above problem,this paper proposed an asynchronous advantage actor-critic model with visual attention mechanism (VAM-A3C).AM-A3C integrates visual attention mechanism with traditional asynchronous advantage actor-critic algorithms.By calculating the visual importance value of each area point in the whole image compared with the traditional Cofi algorithm,and obtaining the context vector of the attention mechanism via regression function and weighting function,Agent can focus on smaller but more valuable image areas to accelerate network model decoding and to learn the approximate optimal strategy more efficiently.Experimental results show the superior performance of VAM-A3C in some decision-making tasks based on visual perception compared with the traditional asynchronous deep reinforcement learning algorithm.