Computer Science ›› 2021, Vol. 48 ›› Issue (5): 239-246.doi: 10.11896/jsjkx.201000171

• Artificial Intelligence • Previous Articles     Next Articles

Logical Reasoning Method Based on Temporal Relation Network

ZHANG Shu-nan1,2, CAO Feng1,2, GUO Qian1,2, QIAN Yu-hua1,2,3   

  1. 1 Institute of Big Data Science and Industry,Shanxi University,Taiyuan 030006,China
    2 School of Computer and Information Technology,Shanxi University,Taiyuan 030006,China
    3 Key Laboratory of Computational Intelligence and Chinese Information Processing of Ministry of Education,Shanxi University,Taiyuan 030006,China
  • Received:2020-10-28 Revised:2021-03-25 Online:2021-05-15 Published:2021-05-09
  • About author:ZHANG Shu-nan,born in 1996,postgraduate.Her main research interests include deep learning and visual logic learning.(15735105265@163.com)
    QIAN Yu-hua,born in 1976,Ph.D,professor,is a member of China Computer Federation.His main research interests include pattern recognition,feature selection,rough set theory,granular computing,and artifificial intelligence.
  • Supported by:
    National Natural Science Foundation of China(61672332,61802238,61603228,62006146,F060308),Program for the Outstanding Innovative Teams of Higher Learning Institutions of Shanxi,Key R&D Program(International Science and Technology Cooperation Project) of Shanxi Province,China(201903D421003),Program for the San Jin Young Scholars of Shanxi,Overseas Returnee Research Program of Shanxi Province(2017023,2018172,HGKY2019001) and Shanxi Province Science Foundation for Youths(201901D211171,201901D211169).

Abstract: Logical reasoning is the core of human intelligence and a challenging research topic in the field of artificial intelligence.Human IQ test is one of the common methods to measure the level of human IQ and logical reasoning ability.How to let the computer learn to have the logical reasoning ability similar to human is a very important research content,the purpose is to make the computer from a given image directly learn the logical reasoning mode without having to design a priori reasoning mode for the computer in advance.For this purpose,a new data set Fashion-IQ is proposed.Each sample of the data set contains seven input pictures and a label.The seven pictures are three question input pictures that contain one or more logics,and four option input pictures.The purpose is to let the machine learn to predict the next picture based on the logic contained in the three question input pictures,so as to select the correct option.In order to solve this problem,the temporal relationship model is proposed.For each option,the model first uses a convolutional neural network to extract the spatial features of the first three input pictures and option pictures,and then uses a relation network to combine these four spatial features in pairs.Then,it uses LSTM to extract the first three question input pictures combining the time series feature with the time series feature of this option,the time series feature and the combined space feature are combined to obtain the time series-space fusion feature.Finally,the first three input pictures and the temporal-spatial fusion features obtained from each option are further reasoned,and the softmax function is used for scoring.The option with the highest score is the correct answer.Experiments prove that the model has achieved a relatively high inference accuracy on this data set.

Key words: Inference pattern, IQ test, Logical reasoning, Temporal relation network, Temporal-spatial fusion features

CLC Number: 

  • TP181
[1]COLOM R,KARAMA S,JUNG R E,et al.Human intelligence and brain networks[J].Dialogues Clin Neuro,2010,12(4):489-501.
[2]ZHOU Z H.Abductive learning:towards bridging machinelearning and logical reasoning[J].Science China Information Sciences,2019,62(7):191-193.
[3]HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).2016:770-778.
[4]KAIMING H K,GEORGIA G,PIOTR D,et al.Mask R-CNN[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2020,42(2):386-397.
[5]STERN W.The Psychological Methods of Testing Intelligence[J].Psychological Clinic,1915,9(2):56-59.
[6]TAIGMAN Y,YANG M,RANZATO M,et al.Deepface:Clo-sing the gap to human-level performance in face verification[C]//IEEE Conference on Computer Vision & Pattern Recognition.2014:1701-1708.
[7]XIONG W,DROPPO J,HUANG X,et al.The Microsoft 2016 Conversational Speech Recognition System[C]//2017 IEEE International Conference on Acoustics,Speech and Signal Proces-sing (ICASSP).2017:5255-259.
[8]HOSHEN D,WERMAN M.Iq of neural networks[J].arXiv:1710.01692,2017.
[9]SANTORO A,RAPOSO D,BARRETT D G,et al.A simple neural network module for relational reasoning[C]//31st Conference on Neural Information Processing Systems.2017:4974-4983.
[10]RAVEN J C.Raven's progressive matrices[M].Western Psychological Services,1938.
[11]SNOW R E,KYLLONEN P C,MARSHALEK B.The topography of ability and learning correlations[J].Advances in the Psychology of Human Intelligence,1984,2(S 47):103.
[12]KUNDA M,MCGREGGOR K,GOEL A.Addressing the Ra-ven's Progressive Matrices Test of “General” Intelligence[C]//2009 AAAI Fall Symposium Series.2009.
[13]WANG H,TIAN F,GAO B,et al.Solving verbal comprehension questionsin iq test by knowledge-powered word embedding[J].arXiv:1505.07909,2015.
[14]HOSHEN Y,PELEG S.Visual Learning of Arithmetic Operations[C]//Proceedings of the AAAI Conference on Artificial Intelligence.2016:3733-3739.
[15]JOHNSON J,HARIHARAN B,LAURENS V D M,et al.Inferring and Executing Programs for Visual Reasoning[C]//2017 IEEE International Conference on Computer Vision.2017:2989-2998.
[16]XIAO H,RASUL K,VOLLGRAF R.Fashion-MNIST:a Novel Image Dataset for Benchmarking Machine Learning Algorithms[J].arXiv:1708.07747,2017.
[17]BARRETT D G T,HILL F,SANTORO A,et al.Measuring abstract reasoning in neural networks[C]//InternationalConfe-rence on Machine Learning.PMLR,2018:511-520.
[1] XIAO Zhi-hong, HAN Ye-tong, ZOU Yong-pan. Study on Activity Recognition Based on Multi-source Data and Logical Reasoning [J]. Computer Science, 2022, 49(6A): 397-406.
[2] WU Li-bo, HUANG Yu-fang. Logical Reasoning Based on DNA Strand Displacement [J]. Computer Science, 2022, 49(1): 259-263.
[3] ZHANG Yong-mei, GUO Sha, JI Yan, MA Li and ZHANG Rui. Spatial-Temporal Co-occurrence Pattern Mining Algorithm Based on Network [J]. Computer Science, 2018, 45(3): 223-230.
[4] JU An-kang, GUO Yuan-bo, ZHU Tai-ming and WANG Tong. Survey on Network Security Event Correlation Analysis Methods and Tools [J]. Computer Science, 2017, 44(2): 38-45.
[5] . Research on Component Behavior Fragment Extraction and Composition Based on Logical Reasoning [J]. Computer Science, 2012, 39(5): 120-123.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!