Computer Science ›› 2023, Vol. 50 ›› Issue (3): 181-190.doi: 10.11896/jsjkx.220300062

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Shooting Event Detection of Free Kick in Soccer Video Based on Rule Reasoning

HUA Xiaofeng1, FENG Na1, YU Junqing1,2, HE Yunfeng1   

  1. 1 School of Computer Science and Technology,Huazhong University of Science and Technology,Wuhan 430074,China
    2 Network and Computing Center of Huazhong University of Science and Technology,Wuhan 430074,China
  • Received:2022-03-07 Revised:2022-05-21 Online:2023-03-15 Published:2023-03-15
  • About author:HUA Xiaofeng,born in 1996,postgra-duate.Her main research interest is soccer video event detection.
    YU Junqing,born in 1975,Ph.D,professor,Ph.D supervisor.His main research interests include content-based video analysis,indexing and retrieval,multi-core computing and stream compilation,video emotion computing,network security and big data processing.

Abstract: Soccer video event detection is of great significance to video retrieval.However,there are fewer events in soccer videos,and these events mainly occur in the far-view shot,which makes it difficult to capture key players and key actions,making soccer event detection more difficult.In recent years,methods based on deep learning have made some progress in soccer video event detection,but the learning ability of the high-level semantic of the event is still insufficient and the detection results need to be further improved.Therefore,how to improve the accuracy of soccer video event detection is an urgent problem to be solved.Taking the shooting event of free kick(free-kick shot event) as the research object,an event detection model combining soccer rules and deep learning is proposed.To have a deeper understanding of the inherent characteristics of the free-kick shot event,the event rules are manually summarized and verified on the public soccer dataset,and the corresponding application scenarios are also proposed.For the problem of too few events in soccer videos,rule-based initial localization algorithm is proposed to preprocess the videos.Through the combination and application of multiple rules,the location where the free-kick shot event may occur is initially located from the original video,which is used as the input of the deep learning model for further prediction.The proposed mo-del is compared with other models on the public soccer dataset.Experimental results show that the proposed model achieves the best results,with the accuracy rate of 78% and the recall rate of 81.25%.Compared with other models,the improvement in accuracy is particularly prominent.It can be seen that the free-kick shot event detection model that combines soccer rules and deep learning effectively improves the performance of free-kick shot event detection and provides a basic reference for further research on the detection of other events in soccer videos.

Key words: Soccer video, Free-kick shot, Event detection, Soccer rules, Deep learning

CLC Number: 

  • TP181
[1] YE Q,HUANG Q,GAO W,et al.Exciting event detection in broadcast soccer video with mid-level description and incremental learning[C]//Proceedings of the 13th Annual ACM International Conference on Multimedia.New York:ACM,2005:455-458.
[2] TONG X,LU H,LIU Q.A three-layer event detection framework and its application in soccer video[C]//Proceedings of the International Conference on Multimedia & Expo.Piscataway,NJ:IEEE,2004:1551-1554.
[3] WANG F,MA Y F,ZHANG H,et al.Dynamic bayesian network based event detection for soccer highlight extraction[C]//Proceedings of the 2004 International Conference on Image Processing.Singapore:IEEE,2004:633-636.
[4] XU H,FONG T H,CHUA T S.Fusion of Multiple Asyn-chronous Information Sources for Event Detection in Soccer Video[C]//Proceedings of the 2005 IEEE International Confe-rence on Multimedia and Expo.Piscataway,NJ:IEEE,2005:1242-1245.
[5] XIONG Z,RADHAKRISHNAN R,DIVAKARAN A,et al.Audio events detection based highlights extraction from baseball,golf and soccer games in a unified framework[C]//Proceedings of the 2003 International Conference on Multimedia and Expo.Piscataway,NJ:IEEE,2003:401-404.
[6] JIN G,TAO L,XU G.Hidden Markov Model Based Events Detection in Soccer Video[C]//Proceedings of the International Conference Image Analysis and Recognition.Berlin,German:Springer.2004:605-612.
[7] HAN Y,LIU G,CHOLLET G.Goal event detection in broadcast soccer videos by combining heuristic rules with unsupervised fuzzy c-means algorithm[C]//Proceedings of the 10th International Conference on Control,Automation,Robotics and Vision.Hanoi,Vietnam:IEEE,2008:888-891.
[8] XU M,MADDAGE N C,XU C,et al.Creating audio keywords for event detection in soccer video[C]//Proceedings of the 2003 International Conference on Multimedia and Expo.Piscataway,NJ:IEEE,2003:281-284.
[9] LIU H,HE T.Integrating Multiple Feature Fusion for Semantic Event Detection in Soccer Video[C]//Proceedings of the 2009 International Joint Conference on Artificial Intelligence.Hai-nan,China:IEEE,2009:128-131.
[10] HOSSEINI M S,EFTEKHARI-MOGHADAM A M.Fuzzyrule-based reasoning approach for event detection and annotation of broadcast soccer video [J].Applied Soft Computing,2013,13(2):846-866.
[11] PANDYA D S,ZAVERI M A.Frame based approach for automatic event boundary detection of soccer video using optical flow[C]//Proceedings of the 2017 IEEE International Conference on Signal and Image Processing Applications.Kuching,Malaysia:IEEE,2017:402-406.
[12] FAKHAR B,KANAN H R,BEHRAD A.Learning an event-oriented and discriminative dictionary based on an adaptive label-consistent K-SVD method for event detection in soccer videos [J].Journal of Visual Communication and Image Representation,2018,55:489-503.
[13] MORRA L,MANIGRASSO F,CANTO G,et al.Slicing and di-cing soccer:automatic detection of complex events from spatio-temporal data[C]//Proceedings of the International Conference on Image Analysis and Recognition.Cham:Springer,2020:107-121.
[14] GAO X,LIU X,YANG T,et al.Automatic Key Moment Extraction and Highlights Generation Based on Comprehensive Soccer Video Understanding[C]//Proceedings of the IEEE International Conference on Multimedia & Expo Workshops.London,UK:IEEE,2020:1-6.
[15] TOMEI M,BARALDI L,CALDERARA S,et al.RMS-Net:Regression and Masking for Soccer Event Spotting[C]//Procee-dings of the 25th International Conference on Pattern Recognition.Milan,Italy:IEEE,2021:7699-7706.
[16] CIOPPA A,DELIÈGE A,GIANCOLA S,et al.A Context-Aware Loss Function for Action Spotting in Soccer Videos[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.Seattle,WA,USA:IEEE,2020:13123-13133.
[17] JIANG H,LU Y,XUE J.Automatic Soccer Video Event Detection Based on a Deep Neural Network Combined CNN and RNN[C]//Proceedings of the 28th International Conference on Tools with Artificial Intelligence.San Jose,CA,USA:IEEE,2016:490-494.
[18] SONG C,RASMUSSEN C.Multi-camera Temporal Groupingfor Play/Break Event Detection in Soccer Games[C]//Procee-dings of the International Symposium on Visual Computing.Cham:Springer,2019:231-243.
[19] FENG N,SONG Z,YU J,et al.SSET:a dataset for shot segmentation,event detection,player tracking in soccer videos [J].Multimedia Tools and Applications,2020,79(39):28971-28992.
[20] WANG T,FENG N,YU J,et al.Shot Boundary DetectionThrough Multi-stage Deep Convolution Neural Network[C]//Proceedings of the International Conference on Multimedia Modeling.Cham:Springer,2019:456-468.
[21] SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition [J].arXiv:1409.1556,2014.
[22] TRAN D,BOURDEV L D,FERGUS R,et al.Learning Spatiotemporal Features with 3D Convolutional Networks[C]//Proceedings of the 2015 IEEE International Conference on Compu-ter Vision.Piscataway,NJ:IEEE,2015:4489-4497.
[23] WU L,YU J,HE Y,et al.Soccer video shot classification and playfield zone detection [J].Journal of Image and Graphics,2017,22(2):265-272.
[24] CHENG P,FENG J,MA H J,et al.Soccer Video Scene Classifi-cation Algorithms Based on C3D [J].Computer System Application,2019,28(12):158-164.
[25] SARKAR S,ALI S,CHAKRABARTI A.Shot Classification and Replay Detection in Broadcast Soccer Video[C]//Procee-dings of the Advanced Computing and Systems for Security.Singapore:Springer,2020:57-66.
[26] YU J,LEI A,HU Y.Soccer Video Event Detection Based on Deep Learning[C]//Proceedings of the International Confe-rence on Multimedia Modeling.Cham:Springer,2019:377-389.
[27] VANDERPLAETSE B,DUPONT S.Improved Soccer Action Spotting using both Audio and Video Streams[C]//Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.Seattle,WA,USA:IEEE,2020:3921-3931.
[1] DONG Yongfeng, HUANG Gang, XUE Wanruo, LI Linhao. Graph Attention Deep Knowledge Tracing Model Integrated with IRT [J]. Computer Science, 2023, 50(3): 173-180.
[2] MEI Pengcheng, YANG Jibin, ZHANG Qiang, HUANG Xiang. Sound Event Joint Estimation Method Based on Three-dimension Convolution [J]. Computer Science, 2023, 50(3): 191-198.
[3] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[4] LIU Hang, PU Yuanyuan, LYU Dahua, ZHAO Zhengpeng, XU Dan, QIAN Wenhua. Polarized Self-attention Constrains Color Overflow in Automatic Coloring of Image [J]. Computer Science, 2023, 50(3): 208-215.
[5] CHEN Liang, WANG Lu, LI Shengchun, LIU Changhong. Study on Visual Dashboard Generation Technology Based on Deep Learning [J]. Computer Science, 2023, 50(3): 238-245.
[6] ZHANG Yi, WU Qin. Crowd Counting Network Based on Feature Enhancement Loss and Foreground Attention [J]. Computer Science, 2023, 50(3): 246-253.
[7] YING Zonghao, WU Bin. Backdoor Attack on Deep Learning Models:A Survey [J]. Computer Science, 2023, 50(3): 333-350.
[8] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[9] WANG Pengyu, TAI Wenxin, LIU Fang, ZHONG Ting, LUO Xucheng, ZHOU Fan. Self-supervised Flight Trajectory Prediction Based on Data Augmentation [J]. Computer Science, 2023, 50(2): 130-137.
[10] GUO Nan, LI Jingyuan, REN Xi. Survey of Rigid Object Pose Estimation Algorithms Based on Deep Learning [J]. Computer Science, 2023, 50(2): 178-189.
[11] LI Junlin, OUYANG Zhi, DU Nisuo. Scene Text Detection with Improved Region Proposal Network [J]. Computer Science, 2023, 50(2): 201-208.
[12] HUA Jie, LIU Xueliang, ZHAO Ye. Few-shot Object Detection Based on Feature Fusion [J]. Computer Science, 2023, 50(2): 209-213.
[13] LIANG Jiali, HUA Baojian, SU Shaobo. Tensor Instruction Generation Optimization Fusing with Loop Partitioning [J]. Computer Science, 2023, 50(2): 374-383.
[14] CAI Xiao, CEHN Zhihua, SHENG Bin. SPT:Swin Pyramid Transformer for Object Detection of Remote Sensing [J]. Computer Science, 2023, 50(1): 105-113.
[15] WANG Bin, LIANG Yudong, LIU Zhe, ZHANG Chao, LI Deyu. Study on Unsupervised Image Dehazing and Low-light Image Enhancement Algorithms Based on Luminance Adjustment [J]. Computer Science, 2023, 50(1): 123-130.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!