Abstract: At present,deep learning is a research hotspot based on image traffic sign detection and recognition proces-sing,and has achieved remarkable results.Aiming at the problem of traffic sign detection and recognition based on car-video,this paper proposed a real-time detection and recognition algorithm for traffic signs based on Spatiotemporal-CNN (ST-CNN).It constructs a Spatiotemporal model (STM) based on the spatiotemporal relationship between frames of image sequences,and combines the STM with Convolutional Neural Network (CNN).The experimental results show that the algorithm can detect,screen,track and identify the same traffic sign in the video image sequence.It can effectively reduce CNN data input and system resource consumption,and improve computational efficiency,while ensuring high accuracy.It satisfies the real-time requirements of traffic sign detection and recognition in video.The algorithm takes an average of 26.82 milliseconds per frame and the recognition accuracy reaches 96.94%.

Key words: Multi-scale convolutional neural network, Real-time, Spatiotemporal model, Traffic sign