Computer Science ›› 2022, Vol. 49 ›› Issue (10): 176-182.doi: 10.11896/jsjkx.220500265

• Computer Graphics& Multimedia • Previous Articles     Next Articles

Study on 3D Motion-in-Depth Perception Based on Binocular Vision

LU Ping1, ZHANG Di2, XIAO Jun-feng3, BI Ke1   

  1. 1 School of Science,Beijing University of Posts and Telecommunications,Beijing 100876,China
    2 School of Data Science and Smart Media,Communication University of China,Beijing 100024,China
    3 School of Electronic Engineering,Beijing University of Posts and Telecommunications,Beijing 100876,China
  • Received:2022-05-30 Revised:2022-07-11 Online:2022-10-15 Published:2022-10-13
  • About author:LU Ping,born in 1999,postgraduate.Her main research interests include 3D stereo video motion perception and so on.
    ZHANG Di,born in 1988,Ph.D.Her main research interests include 3Dste-reo vision and virtual reality techno-logy.

Abstract: Obtaining stereoscopic information is one of the basic abilities of human beings to perceive the world.Through stereo vision,we can judge the shape,size,distance,relative position of objects,as well as the direction and speed of changes in object motion information.Among them,the perception information of moving objects plays an important role in stereo vision perception.The acquisition of motion visual information is not only the key ability of biological vision systems to survive in a dynamic world,but also an important means for artificial vision systems to efficiently process stereoscopic video.Therefore,in order to design a 3D depth motion perception model that conforms to the visual characteristics of human eyes,it is necessary to explicitly excavate the salient features of human perception of stereoscopic motion,so as to design experiments to explore.In this paper,motion stereo videos are designed as visual stimuli based on monocular and binocular cues,and subjective experiments are designed using the control variable method.The experiment explores two parts:the influence of the relative distance between the target and the reference sphere on the subjects’ perception ability,and the relationship between the actual movement direction of the target and the subjects’ perception direction.Experimental data is analyzed by using two behavioral measures:the percentage of successfully intercepted targets and the perceived bias.The conclusion shows that,firstly,the smaller the relative distance between the target and the reference,the higher the interception success rate.The target velocity and the reference’s motion radius affect the relative distance of the target and reference spheres.This indicates that the relative positional relationship between the target and the reference plays an important role in the human eye’s perception of moving objects.Motion perception has a certain relativity,and motion is easier to perceive at the position with reference point and the position close to the reference point.Second,we find that perceptions elicited by deep motion are more pronounced than those induced by lateral motion.The correct intercept rate of perceived depth direction is 42.67%~47.01% higher than that of lateral motion.This shows that the visual stimulation brought by deep motion is more obvious,and the perception ability of objects moving in different directions is asymmetric.However,when there is an interception error in the depth direction,the perceptual deviation is larger,and the deviation is about 0.1583~0.3665.This study explores the salient features of human perception of motion and provides insights into the observer’s process of motion perception in 3D environments.This study explores the significant characteristics of human motion perception,and provides a new subjective contrast standard to judge the perception effect of 3D motion perception model for the subsequent design of 3D motion perception model work,which makes the original stereo perception ability index more refined.

Key words: Human visual system, 3D video, Motion perception, Binocular parallax, Motion-in-Depth

CLC Number: 

  • TP391
[1]WHEATSTONE C.Contributions to the physiology of vision[J].Royal Society,1838,28:371-394.
[2]HMUEL A,GRINVALD A.Functional organization for direction of motion and its relationship to orientation maps in cat area 18[J].Journal of Neuroscience,1996,16(21):6945.
[3]POGGIO G F,MOTTER B C,SQUATRITO S,et al.Responses of neurons in visual cortex(V1 and V2) of the alert macaque to dynamic random-dot stereograms[J].Vision Research,1985,25(3):397-406.
[4]TANAKA K,SAITO H.Analysis of motion of the visual field by direction,expansion/contraction,and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey[J].Journal of Neurophysiology,1989,62(3):626-641.
[5]XU H,WALLISCH P,BRADLEY D C.Spiral motion selective neurons in area MSTd contribute to judgments of heading[J].Journal of Neurophysiology,2014,111(11):2332-2342.
[6]HUBEL D H,WIESEL T N.Receptive fields of single neurones in the cat's striate cortex[J].PhysiolLund.1959,148:547-591.
[7]HYSON M T,JULESZ B,FENDER D H.Eye movements and neural remapping during fusion of misaligned random-dot stereo-grams[J].Journal of the Optical Society of America,1983,73(12):1665-1673.
[8]DING J,LEVI D M.A unified model for binocular fusion and depth perception[J].Vision Research,2021,180(2):11-36.
[9]XIE M,NIEHORSTER D C,LAPPE M,et al.Roles of visual and non-visual information in the perception of scene-relative object motion during walking[J].Journal of Vision,2020,20(10):15.
[10]JULESZ B.Binocular depth perception of computer-generatedpatterns[J].Bell System Tech,1960,39:1125-1162.
[11]CORMACK LK,CZUBA TB,KNÖLL J,et al.Binocular Mechanisms of 3D Motion Processing[J].Annual Review of Vision Science,2017,3:297-318.
[12]KIM T,RYU K,SONG K,et al.Loop-Net:Joint Unsupervised Disparity and Optical Flow Estimation of Stereo Videos With Spatiotemporal Loop Consistency[J].IEEE Robotics and Automation Letters,2022,5(4):5597-5604.
[13]MALTZ M V,STUBBS K M,QUINLAN D J,et al.Familiar size affects the perceived size and distance of real objects even with binocular vision[J].Journal of Vision.2021,21(10):21.
[14]THOMPSON L,JI M,ROKERS B,et al.Contributions of bino-cular and monocular cues to motion-in-depth perception[J].Journal of Vision,2019,19(3):2.
[15]WHRITNER J A,CZUBA T B,CORMACK L K,et al.Spatiotemporal integration of isolated binocular three-dimensional motion cues[J].Journal of Vision,2021,21(10):2.
[16]PETER S,ANDREW G.Combining cues to judge distance and direction in an immersive virtual reality environment[J].Journal of Vision,2021,21(4):10.
[17]PENG Y,LEE H,SHU T,et al.Exploring biological motionperception in two-stream convolutional neural networks[J].Vision Research,2021,178:28-40.
[18]CHESSA M,SABATINI S P,SOLARI F.A systematic analysis of a V1-MT neural model for motion estimation[J].Neurocomputing,2016,173:1811-1823.
[19]CHESSA M,SOLARI F.A computational model for the neural representation and estimation of the binocular vector disparity from convergent stereo image pairs[J].International Journal of Neural Systems,2019,29(5):1-20.
[20]FULVIO J M,ROSEN M L,ROKERS B.Sensory uncertainty leads to systematic misperception of the direction of motion in depth[J].Attention Perception & Psychophysics,2015,77(5):1685-1696.
[21]WAN W F.Image Quality evaluation for human visual perception characteristics[D].Xi 'an:Xidian University,2020.
[22]FULVIO J M,MIAO H,ROKERS B.Head jitter enhancesthree-dimensional motion perception[J].Journal of Vision,2021,21(3):12.
[1] LU Ting, HOU Guo-jia, PAN Zhen-kuan, WANG Guo-dong. Underwater Image Quality Assessment Based on HVS [J]. Computer Science, 2022, 49(5): 98-104.
[2] LUO Xiao-lin and LUO Lei. Visual Saliency Based Multi-view Video Coding Algorithm [J]. Computer Science, 2016, 43(Z6): 171-174.
[3] HUA Dong and YU Hong-sheng. Digital Fusion Image Quality Objective Assessment Method Based on Visual Information Fidelity [J]. Computer Science, 2014, 41(Z6): 224-226.
[4] SANG Qing-bing,LIANG Di-lin,WU Xiao-jun and LI Chao-feng. Gradient Structural Similarity Image Assessment Index Based on Dilation [J]. Computer Science, 2014, 41(6): 287-290.
[5] LI Xing,ZHAO Yao,LIN Chun-yu and YAO Chao. Depth Map Coding Based on Wavelet Inter-subband Coefficients Prediction [J]. Computer Science, 2014, 41(10): 134-138.
[6] SONG Xing-guang, ZHANG Chun-tian, SU Yu-ting. Design of Adaptive Watermarking Algorithms for Video Signals Using Subjective Tests [J]. Computer Science, 2009, 36(8): 291-295.
[7] YANG Hong-jun,YANG Sheng,XIA Tai-wu. DCT Based Public Watermarking Algorithm with Visual Model [J]. Computer Science, 2009, 36(7): 281-283.
[8] . [J]. Computer Science, 2009, 36(6): 265-267.
[9] . [J]. Computer Science, 2009, 36(3): 226-231.
[10] CHEN Guang-xi ,CHENG Yah (College of Computing Sciences and Mathematics, Guilin University of Electronic Technology,Guilin 541004, China). [J]. Computer Science, 2008, 35(11): 214-216.
[11] . [J]. Computer Science, 2008, 35(11): 203-206.
[12] . [J]. Computer Science, 2008, 35(1): 250-254.
[13] . [J]. Computer Science, 2005, 32(9): 191-194.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!