计算机科学 ›› 2026, Vol. 53 ›› Issue (6A): 250600225-7.doi: 10.11896/jsjkx.250600225

• 交叉&应用 • 上一篇    下一篇

面向变压器增强装配的虚实融合技术研究

马伟, 周昊奉   

  1. 国网宁夏电力有限公司吴忠供电公司 宁夏 吴忠 751199
  • 出版日期:2026-06-16 发布日期:2026-06-12
  • 通讯作者: 马伟(15509509775@163.com)
  • 基金资助:
    国网宁夏电力有限公司科技项目(5229WZ240002)

Research on Mixing of Virtual and Actual Reality for Transformer Augmented Assembly

MA Wei, ZHOU Haofeng   

  1. State Grid NingXia Electric Power Co.,Ltd.,Wuzhong,Ningxia 751199,China
  • Published:2026-06-16 Online:2026-06-12
  • About author:MA Wei,born in 1987,senior engineer.His main research interests include intelligent inspection,rapid fault location and line detection for distribution networks.
  • Supported by:
    Science and Technology Project of State Grid Ningxia Electric Power Co.,Ltd.(5229WZ240002).

摘要: 虚实融合的效果将直接影响增强装配系统的真实感和沉浸感,虚实物体之间正确的遮挡关系和碰撞交互对融合效果至关重要。提出基于变压器设备“虚拟替身”的遮挡处理方法,具有较强的鲁棒性和实时性;针对三维注册过程中特征点错误匹配点对数量过多的问题,提出ORB-Cosine相似度测量的三维注册方法,提高了特征点匹配的精度。当前的虚实物体碰撞检测方法的计算量大且检测精度较低,提出基于模型表面体素化表示和体积差异的八叉树分层碰撞检测优化算法,在保证计算效率的基础上提升了检测精度。实验结果表明,提出的方法具有较高的实时性和准确性,大大提高了增强装配系统的真实感和沉浸感。

关键词: 增强装配, 虚实融合, 遮挡处理, 碰撞检测, 虚拟替身

Abstract: The mixing of virtual and actual reality's effects will directly affect the realism and immersion of the augmented assembly system.The correct occlusion relationship and collision interaction between virtual and real objects are essential to the fusion's effect.An occlusion handling method based on “virtual avatar” of transformer equipment is proposed,which has strong robustness and real-time performance.Aiming at the problem that there are too many wrong matching pairs of feature points in the process of 3D registration,the 3D registration method for ORB-Cosine similarity measurement is proposed to improve the accuracy of feature point matching.The current collision detection methods for virtual and real objects have a large amount of calculation and low detection accuracy.It proposes an octree layered collision detection optimization algorithm based on voxel representation of model surface and volume difference,which improves the detection accuracy on the basis of ensuring calculation efficiency.Experimental results show that the proposed methods have high real-time and accuracy,which greatly enhance the realism and immersion of the assembly system.

Key words: Augmented reality, Mixing of virtual and actual reality, Occlusion handling, Collision detection, Virtual avatar

中图分类号: 

  • TP391.9
[1] LI W,WANG J,LIU M,et al.Real-Time Occlusion Handlingfor Augmented Reality Assistance Assembly Systems with Monocular Images[J].Journal of Manufacturing Systems,2022,62:561-574.
[2] JIANG S Q,ZHANG M J,LIW Q,et al.Real-Time Virtual and Real Occlusion Processing Technology Based on Voting Decision [J].Journal of Graphics,2021,42(4):629-635.
[3] ZHAO Y,CHEN J,ZHANG S Q,et al.H4H:Hybrid Convolution-Transformer Architecture Search for NPU-CIM Heterogeneous Systems for AR/VR Applications[C]//Proceedings of the 30th Asia and South Pacific Design Automation Conference.2025:1133-1141.
[4] ZHAI L,CHEN D.Image Real-Time Augmented Reality Technology Based on Spatial Color and Depth Consistency[J].Journal of Real-Time Image Processing,2021,18(2):369-377.
[5] KIDO D,FUKUDA T,YABUKI N.Assessing Future Landscapes Using Enhanced Mixed Reality with Semantic Segmentation by Deep Learning[J].Advanced Engineering Informatics,2021,48:101281.
[6] NAM H,JUNG D S,MOON G,et al.Joint reconstruction of 3d human and object via contact-based refinement transformer[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:10218-10227.
[7] LI W,WANG J,LIU M,et al.Real-time occlusion handling for augmented reality assistance assembly systems withmonocular images[J].Journal of Manufacturing Systems,2022,62:561-574.
[8] FRIKHA R,EJBALI R,ZAIED M.Handling Occlusion in Augmented Reality Surgical Training Based Instrument Tracking[C]//2016 IEEE/ACS 13th International Conference of Computer Systems and Applications(AICCSA).IEEE,2016:1-5.
[9] TIAN Y,ZHOU X,WANG X,et al.Registration and Occlusion Handling Based on the FAST ICP-ORB Method for Augmented Reality Systems[J].Multimedia Tools and Applications,2021,80(14):21041-21058.
[10] KIKUCHI N,FUKUDA T,YABUKI N.Landscape Visualiza-tion by Integrating Augmented Reality and Drones with Occlusion Handling to Link Real and Virtual Worlds-Towards City Digital Twin Realization[C]//2021 39th Conference on Education and Research in Computer Aided Architectural Design in Europe.2021:521-528.
[11] EVANGELIDIS K,PAPADOPOULOS T,SYLAIOU S.Mixed Reality:A Reconsideration Based on Mixed Objects and Geospatial Modalities[J].Applied Sciences,2021,11(5):2417.
[12] AVETISYAN A,XIE C,HOWARD-JENKINS H,et al.Scenescript:Reconstructing scenes with an autoregressive structured language model[C]//European Conference on Computer Vision.Cham:Springer,2024:247-263.
[13] CHEN C,PAN Y,LI D,et al.A Virtual-Physical Collision Detection Interface for AR-Based Interactive Teaching of Robot[J].Robotics and Computer-Integrated Manufacturing,2020,64:101948.
[14] WANG Y,YANG G.Research and Implementation of Collision Interaction Between Virtual and Actual Objects in Range Image[J].Computer Engineering and Applications,2015,51(21):161-167.
[15] CHEN M,LING C.3D Monocular Sphere-to-Plane Virtual-to-Real Objects Collision Estimation Algorithm[J].Journal of Computer-Aided Design & Computer Graphics,2012,24(1):43-49.
[16] LI Y,SHEN X K.A Collision Detection Algorithm in the Augmented Reality Environment Based on Real-Time Hand Tracking and Localization[J].Journal of Computer-Aided Design & Computer Graphics,2011,23(4):713-718.
[17] ZHANG Z Y.A Flexible New Technique for Camera Calibration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(11):1330-1334.
[18] JIN Y,GENG J,HE Z,et al.A Capsule-Based Collision Detection Approach of Irregular Objects in Virtual Maintenance[J].Assembly Automation,2021,41(1):89-105.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!