计算机科学 ›› 2022, Vol. 49 ›› Issue (10): 176-182.doi: 10.11896/jsjkx.220500265

• 计算机图形学&多媒体 • 上一篇    下一篇

基于人眼双目视觉的3D深度运动感知特性研究

路平1, 张地2, 肖俊峰3, 毕科1   

  1. 1 北京邮电大学理学院 北京 100876
    2 中国传媒大学数据科学与智能媒体学院 北京 100024
    3 北京邮电大学电子工程学院 北京 100876
  • 收稿日期:2022-05-30 修回日期:2022-07-11 出版日期:2022-10-15 发布日期:2022-10-13
  • 通讯作者: 张地(dizhang@cuc.edu.cn)
  • 作者简介:(luping@bupt.edu.cn)

Study on 3D Motion-in-Depth Perception Based on Binocular Vision

LU Ping1, ZHANG Di2, XIAO Jun-feng3, BI Ke1   

  1. 1 School of Science,Beijing University of Posts and Telecommunications,Beijing 100876,China
    2 School of Data Science and Smart Media,Communication University of China,Beijing 100024,China
    3 School of Electronic Engineering,Beijing University of Posts and Telecommunications,Beijing 100876,China
  • Received:2022-05-30 Revised:2022-07-11 Online:2022-10-15 Published:2022-10-13
  • About author:LU Ping,born in 1999,postgraduate.Her main research interests include 3D stereo video motion perception and so on.
    ZHANG Di,born in 1988,Ph.D.Her main research interests include 3Dste-reo vision and virtual reality techno-logy.

摘要: 获取立体视觉信息是人们感知世界的基本能力之一,其中运动立体视觉信息的获取不仅是生物视觉系统在动态世界中生存的关键能力,也是人工视觉系统高效处理立体视频的重要手段。为了设计出贴合人眼视觉特性的3D深度运动感知模型,需要明确挖掘人类对立体运动感知的显著特征后再设计主观实验。文中根据单目和双目线索设计了立体运动视觉刺激视频,并采用控制变量的方法,分别探究了目标球体运动速度、参考球体旋转半径及被试正确感知的相互关系,并分析了目标运动方向与被试感知方向之间的关系。首先对实验条件进行探究,结果发现目标与参考的相对距离越小拦截成功率越高,该结果表明目标同参考之间的相对位置关系会影响被试的感知正确性。其次,采用了拦截成功百分比和感知偏差两个行为测量标准对被试感知能力进行分析,结果发现相比横向运动,深度运动正确感知的成功率超出约42.67%~47.01%。这表明不同运动方位的感知不对称,且深度运动带来的视觉刺激更明显。该研究探索了人类对运动感知的显著特征,并为后续设计3D运动感知模型提供了一种新的判断模型感知效果的主观对比标准,使原有立体感知能力的指标更加细化。

关键词: 人类视觉系统, 3D视频, 运动感知, 双目视差, 深度运动

Abstract: Obtaining stereoscopic information is one of the basic abilities of human beings to perceive the world.Through stereo vision,we can judge the shape,size,distance,relative position of objects,as well as the direction and speed of changes in object motion information.Among them,the perception information of moving objects plays an important role in stereo vision perception.The acquisition of motion visual information is not only the key ability of biological vision systems to survive in a dynamic world,but also an important means for artificial vision systems to efficiently process stereoscopic video.Therefore,in order to design a 3D depth motion perception model that conforms to the visual characteristics of human eyes,it is necessary to explicitly excavate the salient features of human perception of stereoscopic motion,so as to design experiments to explore.In this paper,motion stereo videos are designed as visual stimuli based on monocular and binocular cues,and subjective experiments are designed using the control variable method.The experiment explores two parts:the influence of the relative distance between the target and the reference sphere on the subjects’ perception ability,and the relationship between the actual movement direction of the target and the subjects’ perception direction.Experimental data is analyzed by using two behavioral measures:the percentage of successfully intercepted targets and the perceived bias.The conclusion shows that,firstly,the smaller the relative distance between the target and the reference,the higher the interception success rate.The target velocity and the reference’s motion radius affect the relative distance of the target and reference spheres.This indicates that the relative positional relationship between the target and the reference plays an important role in the human eye’s perception of moving objects.Motion perception has a certain relativity,and motion is easier to perceive at the position with reference point and the position close to the reference point.Second,we find that perceptions elicited by deep motion are more pronounced than those induced by lateral motion.The correct intercept rate of perceived depth direction is 42.67%~47.01% higher than that of lateral motion.This shows that the visual stimulation brought by deep motion is more obvious,and the perception ability of objects moving in different directions is asymmetric.However,when there is an interception error in the depth direction,the perceptual deviation is larger,and the deviation is about 0.1583~0.3665.This study explores the salient features of human perception of motion and provides insights into the observer’s process of motion perception in 3D environments.This study explores the significant characteristics of human motion perception,and provides a new subjective contrast standard to judge the perception effect of 3D motion perception model for the subsequent design of 3D motion perception model work,which makes the original stereo perception ability index more refined.

Key words: Human visual system, 3D video, Motion perception, Binocular parallax, Motion-in-Depth

中图分类号: 

  • TP391
[1]WHEATSTONE C.Contributions to the physiology of vision[J].Royal Society,1838,28:371-394.
[2]HMUEL A,GRINVALD A.Functional organization for direction of motion and its relationship to orientation maps in cat area 18[J].Journal of Neuroscience,1996,16(21):6945.
[3]POGGIO G F,MOTTER B C,SQUATRITO S,et al.Responses of neurons in visual cortex(V1 and V2) of the alert macaque to dynamic random-dot stereograms[J].Vision Research,1985,25(3):397-406.
[4]TANAKA K,SAITO H.Analysis of motion of the visual field by direction,expansion/contraction,and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey[J].Journal of Neurophysiology,1989,62(3):626-641.
[5]XU H,WALLISCH P,BRADLEY D C.Spiral motion selective neurons in area MSTd contribute to judgments of heading[J].Journal of Neurophysiology,2014,111(11):2332-2342.
[6]HUBEL D H,WIESEL T N.Receptive fields of single neurones in the cat's striate cortex[J].PhysiolLund.1959,148:547-591.
[7]HYSON M T,JULESZ B,FENDER D H.Eye movements and neural remapping during fusion of misaligned random-dot stereo-grams[J].Journal of the Optical Society of America,1983,73(12):1665-1673.
[8]DING J,LEVI D M.A unified model for binocular fusion and depth perception[J].Vision Research,2021,180(2):11-36.
[9]XIE M,NIEHORSTER D C,LAPPE M,et al.Roles of visual and non-visual information in the perception of scene-relative object motion during walking[J].Journal of Vision,2020,20(10):15.
[10]JULESZ B.Binocular depth perception of computer-generatedpatterns[J].Bell System Tech,1960,39:1125-1162.
[11]CORMACK LK,CZUBA TB,KNÖLL J,et al.Binocular Mechanisms of 3D Motion Processing[J].Annual Review of Vision Science,2017,3:297-318.
[12]KIM T,RYU K,SONG K,et al.Loop-Net:Joint Unsupervised Disparity and Optical Flow Estimation of Stereo Videos With Spatiotemporal Loop Consistency[J].IEEE Robotics and Automation Letters,2022,5(4):5597-5604.
[13]MALTZ M V,STUBBS K M,QUINLAN D J,et al.Familiar size affects the perceived size and distance of real objects even with binocular vision[J].Journal of Vision.2021,21(10):21.
[14]THOMPSON L,JI M,ROKERS B,et al.Contributions of bino-cular and monocular cues to motion-in-depth perception[J].Journal of Vision,2019,19(3):2.
[15]WHRITNER J A,CZUBA T B,CORMACK L K,et al.Spatiotemporal integration of isolated binocular three-dimensional motion cues[J].Journal of Vision,2021,21(10):2.
[16]PETER S,ANDREW G.Combining cues to judge distance and direction in an immersive virtual reality environment[J].Journal of Vision,2021,21(4):10.
[17]PENG Y,LEE H,SHU T,et al.Exploring biological motionperception in two-stream convolutional neural networks[J].Vision Research,2021,178:28-40.
[18]CHESSA M,SABATINI S P,SOLARI F.A systematic analysis of a V1-MT neural model for motion estimation[J].Neurocomputing,2016,173:1811-1823.
[19]CHESSA M,SOLARI F.A computational model for the neural representation and estimation of the binocular vector disparity from convergent stereo image pairs[J].International Journal of Neural Systems,2019,29(5):1-20.
[20]FULVIO J M,ROSEN M L,ROKERS B.Sensory uncertainty leads to systematic misperception of the direction of motion in depth[J].Attention Perception & Psychophysics,2015,77(5):1685-1696.
[21]WAN W F.Image Quality evaluation for human visual perception characteristics[D].Xi 'an:Xidian University,2020.
[22]FULVIO J M,MIAO H,ROKERS B.Head jitter enhancesthree-dimensional motion perception[J].Journal of Vision,2021,21(3):12.
[1] 鹿婷, 侯国家, 潘振宽, 王国栋.
基于HVS的水下图像质量评价
Underwater Image Quality Assessment Based on HVS
计算机科学, 2022, 49(5): 98-104. https://doi.org/10.11896/jsjkx.210100224
[2] 李娟, 周富强, 李作新, 李潇婕.
物流业几何尺寸智能化测量系统
Intelligent Geometry Size Measurement System for Logistics Industry
计算机科学, 2018, 45(8): 218-222. https://doi.org/10.11896/j.issn.1002-137X.2018.08.039
[3] 李幸,赵耀,林春雨,姚超.
基于小波子带系数预测的深度图像编码
Depth Map Coding Based on Wavelet Inter-subband Coefficients Prediction
计算机科学, 2014, 41(10): 134-138. https://doi.org/10.11896/j.issn.1002-137X.2014.10.031
[4] 王颖慧,刘万军.
基于MSB和HVS的空域信息隐藏算法的研究
Study of Spatial Information Hiding Algorithm Based on MSB and HVS
计算机科学, 2012, 39(9): 89-93.
[5] 刘红军,杨胜,夏太武.
一种基于视觉模型的DCT域公开水印算法
DCT Based Public Watermarking Algorithm with Visual Model
计算机科学, 2009, 36(7): 281-283. https://doi.org/10.11896/j.issn.1002-137X.2009.07.069
[6] 吉国力,倪晓明.
基于Haar小波变换高频特征的图像质量评价算法
Image Quality Assessment Algorithm Based on High Frequency Band of Haar Wavelet Transform
计算机科学, 2009, 36(10): 262-264.
[7] 高婷婷 廖晓峰 桑军.
一种基于混沌映射的抗剪切的数字水印算法

计算机科学, 2005, 32(1): 116-117.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!