计算机科学 ›› 2016, Vol. 43 ›› Issue (9): 1-10.doi: 10.11896/j.issn.1002-137X.2016.09.001

• 目次 •    下一篇

基于镜面成像技术的三维立体视觉测量与重构综述

郭伟青,汤一平,鲁少辉,陈麒   

  1. 浙江工业大学之江学院 杭州310024;浙江工业大学信息工程学院 杭州310023,浙江工业大学信息工程学院 杭州310023,浙江工业大学信息工程学院 杭州310023,浙江工业大学信息工程学院 杭州310023
  • 出版日期:2018-12-01 发布日期:2018-12-01
  • 基金资助:
    本文受国家自然科学基金(61070134)资助

Review of 3D Stereo Vision Measure and Reconstruction Based on Mirror Image

GUO Wei-qing, TANG Yi-ping, LU Shao-hui and CHEN Qi   

  • Online:2018-12-01 Published:2018-12-01

摘要: 利用镜面成像技术获取被测物体或场景的三维信息得到研究者越来越多的关注。光线与平面镜或曲面镜交互时产生镜面成像。平面镜的反射属性可以改善视觉效果,基于光路射线展开过程可应用于不同的平面镜成像系统,采用光路展开替代镜面交互应用于三维场景,得到虚拟三维空间,平面镜成像使得复杂的射线交互可以用一种虚拟的方式可视化,且坐标系统的变化容易跟踪。曲面镜成像通常不具有透视投影属性,根据曲面的曲率来改变空间显示。曲面镜常常导致折反射,故针对不同的三维立体视觉测量及重构需设计相应的几何恢复算法。从计算机图形学和计算机视觉的角度,分析了镜面成像的基本原理,对近年来较典型的基于镜面成像技术的三维测量与重构方法及最新研究进展进行综述。

关键词: 镜面成像,立体视觉,三维测量,三维重构

Abstract: The 3D information of the object or scene obtained by using the mirror image is getting more and more attention from many researchers.Mirror image occurs in the interaction between light and plane/curved mirror.The reflective properties of plane mirror image can improve our visual effects.Ray unfolding procedure can be used in different mirror image systems.Using ray unfolding instead of mirror interaction is applied in 3D scene,to get a virtual 3D space.Plane mirror image enables complex ray interactions to be visualized in a virtual way,and the changes of coordinate system are easy to be traced.Curved mirror image usually does not have the properties of perspective projection,and it changes the display space according to the curvature of the surface.Curved mirror often leads to refraction and reflection,hence it is necessary to design the corresponding algorithm of geometric restoration for different 3D stereo vision measure and reconstruction.Form the perspective of computer graphics and computer vision,this paper analyzed the basic principle of mirror image,reviewed the typical 3D measurement and reconstruction method based on mirror image technology in recent years and the latest research progress.

Key words: Mirror image,Stereo vision,3D measure,3D reconstruction

[1] Remondino F,El-Hakim S.Image-based 3D Modelling:A Review[J].The Photogrammetric Record, 2006,21(115):269-291
[2] Shu B,Qiu X J,Wang Z Q.Survey of Shape from Image[J].Journal of Computer Research and Development, 2010,47(3):549-560(in Chinese) 束搏,邱显杰,王兆其.基于图像的几何建模技术综述[J].计算机研究与发展,2010,47(3):549-560
[3] Smith W J.Modern Optical Engineering(4th EDN)[M].Mc-Graw Hill Professional,2008
[4] Reshetouski I,Manakov A,Seidel H P,et al.Three-Dimensional Kaleidoscopic Imaging[C]∥Proc.CVPR.2011:353-360
[5] Sossinsky A B.Geometries[M].American Mathematical Society,2012
[6] Wu H H P,Chang S H.Design of Stereoscopic Viewing System Based on a Compact Mirror and Dual Monitor[J].Optical Engineering,2010,49(2):193-213
[7] Gluckman J,Nayar S K.Rectified Catadioptric Stereo Sensors[C]∥Proc.CVPR.2000:380-387
[8] Gluckman J,Nayar S.Rectified Catadioptric Stereo Sensors[J].IEEE Trans.PAMI,2002,24(2):224-236
[9] Mitsumoto H,Tamura S,Okazaki K,et al.3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method[J].IEEE Trans.PAMI,1992,14:941-946
[10] Ihrke I,Stich T,Gottschlich H,et al.Fast Incident Light Field Acquisition and Rendering[J].WSCG,2008,16(1-3):25-32
[11] Murray D W.Recovering Range using Virtual Multi-CameraStereo[J].CVIU,1995,61(2):285-291
[12] Hu B.It’s All Done with Mirrors:Calibration-and-Correspondence-Free 3D Reconstruction[C]∥Proc.CRV.2009:148-154
[13] Levoy M,Chen B,Vaish V,et al.Synthetic Aperture Confocal Imaging[J].ACM TOG,2004,3:825-834
[14] Mukaigawa Y,Tagawa S,Kim J,et al.Hemispherical confocal imaging using turtleback reflector[C]∥ 10th Asian Conference on Computer Vision.2010:336-349
[15] Weyrich T,Peers P,Matusik W,et al.Fabricating Microgeometry for Custom Surface Reflectance[J].ACM TOG,2009,28(3):341-352
[16] Aggarwal M,Ahuja N.Split aperture imaging for high dynamic range[C]∥Proc.ICCV.2001:10-17
[17] Tan K H,Hua H,Ahuja N.Multiview Panoramic CamerasUsing Mirror Pyramids[J].IEEE Trans.PAMI,2004,26(7):941-946
[18] Tang Y P,Xia S J,Feng Y J,et al.Pearl online detecting and grading device based on monocular multi-view machine vision[J].Transactions of the Chinese Society for Agricultural Machinery,2014,45(1):288-292(in Chinese) 汤一平,夏少杰,冯亦军,等.基于单目多视角机器视觉的珍珠在线分类装置[J].农业机械学报,2014,45(1):288-292
[19] Harvey A R,Fletcher-Holmes D W,Gorman A.Spectral Imaging in a Snapshot[J]∥Proceedings of SPIE-The International Society for Optical Engineering,2005,3:540-545
[20] Gao L,Kester R T,Tkaczyk T S.Compact Image Slicing Spectrometer (ISS) for Hyper spectral Fluorescence Microscopy[J].Optics Express,2009,17(15):12293-12308
[21] Gorman A,Fletcher-Holmes D W,Harvey A R.Generalization of the Lyot Filter and its Application to Snapshot Spectral Imaging[J].Optics Express,2010,18(6):5602-5608
[22] Wetzstein G,Ihrke I,Lanman D,et al.Computational plenoptic imaging[J].Computer Graphics Forum,2011,30(8):2397-2426
[23] Zhou C,Nayar S.Computational Cameras:Convergence of Optics and Processing[J].IEEE Trans.IP,2011,20(12):3322-3340
[24] Lanman D,Crispell D,Taubin G.Surround Structured Lighting for Full Object Scanning[C]∥Proc.3DIM.2007:107-116
[25] Lanman D,Crispell D,Taubin G.Surround Structured Lighting:3-D Scanning with Orthographic Illumination[J].CVIU,2009,113:1107-1117
[26] Gluckman J,Nayar S K.Ego-Motion and Omnidirectional Ca-meras[C]∥Proc.ICCV.1998:999-1005
[27] Gluckman J,Nayar S K.Real-Time Omnidirectional and Panoramic Stereo[C]∥Proc.of Image Understanding Workshop.1998:299-303
[28] Nayar S.Catadioptric Omnidirectional Camera[C]∥ Proc.CVPR.1997:482-488
[29] Chahl J S,Srinivasan M V.Reflective Surfaces for Panoramic Imaging[J].Appl.Optics,1997,36(31):8275-8285
[30] Hicks R A,Bajcsy R.Catadioptric Sensors that ApproximateWide-angle Perspective Projections[C]∥Proc.CVPR .2000:1-7
[31] Hicks R A.Designing a Mirror to Realize a Given Projection[J].JOSA,2005,22(2):323-330
[32] Srinivasan M V.A New Class of Mirrors for Wide-Angle Imaging[C]∥Proc.OMNIVIS.2003:1-8
[33] Swaminathan R,Grossberg M D,Nayar S K.Designing Mirrors for Catadioptric Systems that Minimize Image Errors[C]∥Proc.OMNIVIS.2004:1-8
[34] Swaminathan R,Grossberg M D,Nayar S K.Framework for Designing Catadioptric Projection and Imaging Systems[C]∥Proc.OMNIVIS.2003:1-8
[35] Yi S,Ahuja N.An omnidirectional stereo vision system using a single camera[C]∥18th International Conference on Pattern Recognition(ICPR).IEEE,2006,4:861-865
[36] Kuthirummal S,Nayar S K.Multiview Radial Catadioptric Imaging for Scene Capture[J].ACM TOG,2006,25(3):916-923
[37] Unger J,Wenger A,Hawkins T,et al.Capturing and Rendering with Incident Light Fields[C]∥Proc.EGWR.2003:141-149
[38] Taguchi Y,Agrawal A,Veeraraghavan A,et al.Axial-Cones:Modeling Spherical Catadioptric Cameras for Wide-Angle Light Field Rendering[J].ACM Trans.Graph.,2010,29(6):7231-7238
[39] Lanman D,Crispell D,Wachs M,et al.Spherical CatadioptricArrays:Construction,Multi-View Geometry,and Calibration[C]∥Proc.3DPVT.2006:81-88
[40] Ding Y,Yu J,Sturm P.Multiperspective Stereo Matching andVolumetric Reconstruction[C]∥Proc.ICCV.2009:1827-1834
[41] Nayar S K.Sphereo:Determining Depth using Two SpecularSpheres and a Single Camera[C]∥SPIE Optics,Illumination,and Image Sensing for Machine Vision III.1988:245-254
[42] Lensch H P A,Kautz J,Goesele M,et al.Image-based Recon-struction of Spatial Appearance and Geometric Detail[J].ACM TOG,2003,22(2):234-257
[43] Nene S,Nayar S.Stereo with Mirrors[C]∥Proc.ICCV.1998:1087-1094
[44] Nayar S,Peri V.Folded Catadioptric Cameras[C]∥Proc.CVPR.1999:217-223
[45] Jang G,Kim S,Kweon I.Single Camera Catadioptric Stereo System[C]∥Proc.OMNIVIS.2005:1-8
[46] Lanman D,Wachs M,Taubin G,et al.Reconstructing a 3D Line from a Single Catadioptric Image[C]∥Proc.3DPVT.2006:1-8
[47] Su L,Zhu F.Design of a novel stereo vision navigation system for mobile robots[C]∥IEEE International Conference on Robotics and Biomimetics (ROBIO).IEEE,2005:611-614
[48] Luo C,Su L,Zhu F,et al.A versatile method for omnidirectional stereo camera calibration based on BP algorithm[M]∥Advances in Neural Networks-ISNN.Springer Berlin Heidelberg,2006:383-389
[49] Bimber O,Iwai D,Wetzstein G,et al.The Visual Computing of Projector-Camera Systems[J].CGF,2008,27(8):2219-2245
[50] Fasano A,Callieri M,Cignoni P,et al.Exploiting mirrors for laser stripe 3d scanning[C]∥International Confe-rence on 3D Digital Imaging and Modeling (3DIM 2003).2003:243
[51] Ihrke I,Reshetouski I,Manakov A,et al.A Kaleidoscopic Approach to Surround Geometry and Reflectance Acquisition[C]∥Proceedings of IEEE International Workshop on Computational Cameras and Displays.2012:29-36
[52] Garg G G,Talvala E V,Levoy M,et al.Symmetric Photogra-phy:Exploiting Data-sparseness in Reflectance Fields[C]∥Proc.EGSR.2006:251-262
[53] Ghosh A,Achutha S,Heidrich W,et al.BRDF Acquisition with Basis Illumination[C]∥Proc.ICCV.2007:183-197
[54] Ghosh A,Heidrich W,Achutha S,et al.A Basis Illumination Approach to BRDF Measurement[J].IJCV,2010,90(2):183-197
[55] Holroyd M,Lawrence J,Zickler T.A Coaxial Optical Scanner for Synchronous Acquisition of 3D Geometry and Surface Reflectance[J].ACM TOG,2010,29(4):157-166
[56] Zhou F,Peng B,Cui Y,et al.A novel laser vision sensor for omnidirectional 3D measurement[J].Optics & Laser Technology,2013,45:1-12
[57] Han J Y,Perlin K.Measuring Bidirectional Texture Reflectance with a Kaleidoscope[C]∥Proc.SIGGRAPH.2003:741-748
[58] Bangay S,Radloff J D.Kaleidoscope Configurations for Reflectance Measurement[C]∥Proc.AFRIGRAPH.2004: 161-170
[59] Dana K.BRDF/BTF Measurement Device [C]∥Proc.ICCV.2001:460-466
[60] Dana K J,Wang J.Device for Convenient Measurement of Spatially Varying Bidirectional Reflectance[J].JOSA, 2004,21:1-12
[61] Mukaigawa Y,Sumino K,Yagi Y.High-Speed Measurement of BDRF Using an Ellipsoidal Mirror and a Projector[C]∥Proc.CVPR.2007:1-8
[62] Kurisu M,Yokokohji Y,Oosato Y.Development of a laserrange finder for 3D map-building in rubble[C]∥2005 IEEE International Conference on Intelligent and Systems.IEEE,2004:1842-1847
[63] Jia T,Shi Y,Zhou Z X,et al.3D depth information extraction with omni-directional camera[J].Information Processing Letters,2015,115(2):285-291
[64] Lu S H,Wu T,Tang Y P,et al.In-pipe Deformation Detection and Reconstruction Based on Active Stereo Omni-directional Vision Sensor[J].Journal of Optoelectronics/Laser,2015,26(7):1301-1308(in Chinese) 鲁少辉,吴挺,汤一平,等.基于主动式全景视觉的管道形变检测及重构技术的研究[J].光电子·激光,2015,6(7):1301-1308
[65] Remondino F,Fraser C.Digital camera calibration methods:considerations and comparisons[J].International Archives of Photo grammetry,Remote Sensing and Spatial Information Sciences,2006,36(5):266-272
[66] Bouguet J Y.Camera Calibration Toolbox for Matlab[M]∥High Speed Vision System & Object Tracking.2005
[67] Mariottini G L,Scheggi S,Morbidi F,et al.Planar Catadioptric Stereo:Single and Multi-View Geometry for Calibration and Localization[C]∥Proc.ICRA.2009:2711-2716
[68] Ramalingam S,Bouaziz S,Sturm P,et al.The Light-Path Less Traveled[C]∥Proc.CVPR.2011:3145-3152
[69] Reshetouski I,Manakov A,Bandhari A,et al.Discovering the Structure of a Planar Mirror System from Multiple Observations of a Single Point[C]∥Proc.CVPR.2013:89-96
[70] Ihrke I,Kutulakos K N,Lensch H P A,et al.Transparent and Specular Object Reconstruction[J].CGF,2010,29(8):2400-2426
[71] Sturm P,Ramalingam S,Tardif J P,et al.Camera Models and Fundamental Concepts used in Geometric Computer Vision[J].Foundations and Trends in Computer Graphics and Vision.Now Publisher Inc.,2010,6(1/2):1-183
[72] Swaminathan R,Grossberg M D,Nayar S K.A Perspective on Distortions[C]∥Proc.CVPR.2003:594-601
[73] Yu J,McMillan L,Sturnm P.Multi-Prespective Modelling,Rendering and Imaging[J].CGF,2010,29(1):227-246
[74] Swaminathan R,Grossberg M D,Nayar S K.Caustics of Catadioptric Cameras[C]∥Proc.ICCV.2001:2-9
[75] Geyer C,Danillidis K.Paracatadioptric Camera Calibration[J].IEEE Trans.PAMI,2002,24(5):687-695
[76] Geyer C,Danillidis K.Catadioptric Projective Geometry[J].IJCV,2001,45(3):223-243
[77] Agrawal A,Taguchi Y,Ramalingam S.Analytical Forward Projection for Axial Non-Central Dioptric & Catadioptric Cameras[C]∥11th European Conference on Computer Vision.2010:129-143
[78] Agrawal A,Taguchi Y,Ramalingam S.Beyond Alhazen’s Problem:Analytical Projection Model for Non-Central Catadioptric Cameras with Quadric Mirrors[C]∥Proc.CVPR.2011:2993-3000
[79] Ding Y,Yu J.Recovering Shape Characteristics on Near-FlatSpecular Surfaces[C]∥Proc.CVPR.2008:1-8
[80] Ding Y,Yu J,Sturm P F.Recovering Specular Surfaces usingCurved Line Images[C]∥Proc.CVPR.2009:2326-2333
[81] Tarini M,Lensch H P A,Goesele M,et al.3D Acquisition ofMirroring Objects[J].Graphical Models,2005,67(4):233-259
[82] Bonfort T,Sturm P,Gargallo P.General Specular Surface Triangulation[J].Lecture Notes in Computer Science,2006,2:872-881
[83] Liu M,Hartley R,Salzmann M.Mirror Surface Reconstruction from a Single Image[C]∥Proc.CVPR.2013:129-136
[84] Kang S B.Catadioptric Self-Calibration[C]∥Proc.CVPR.2000:201-207
[85] Svoboda T,Pajdla T,Hlavá′V.Epipolar Geometry for Panora-mic Cameras[C]∥ 5th Europen Conference on Computer Vision.Springer,Heidelberg.2010:218-231
[86] Svoboda T, Pajdla T.Epipolar Geometry for Central Cata-dioptric Cameras[J].IJCV,2002,49(1):23-37
[87] Agrawal A,Ramalingam S.Single Image Calibration of Multi-Axial Imaging Systems[C]∥Proc.CVPR.2013: 1399-1406
[88] Kutulakos K N,Steger E.A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation[J].IJCV, 2008,76(1):13-29

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!