Computer Science ›› 2026, Vol. 53 ›› Issue (6A): 250600225-7.doi: 10.11896/jsjkx.250600225

• Interdiscipline & Application • Previous Articles     Next Articles

Research on Mixing of Virtual and Actual Reality for Transformer Augmented Assembly

MA Wei, ZHOU Haofeng   

  1. State Grid NingXia Electric Power Co.,Ltd.,Wuzhong,Ningxia 751199,China
  • Online:2026-06-16 Published:2026-06-12
  • About author:MA Wei,born in 1987,senior engineer.His main research interests include intelligent inspection,rapid fault location and line detection for distribution networks.
  • Supported by:
    Science and Technology Project of State Grid Ningxia Electric Power Co.,Ltd.(5229WZ240002).

Abstract: The mixing of virtual and actual reality's effects will directly affect the realism and immersion of the augmented assembly system.The correct occlusion relationship and collision interaction between virtual and real objects are essential to the fusion's effect.An occlusion handling method based on “virtual avatar” of transformer equipment is proposed,which has strong robustness and real-time performance.Aiming at the problem that there are too many wrong matching pairs of feature points in the process of 3D registration,the 3D registration method for ORB-Cosine similarity measurement is proposed to improve the accuracy of feature point matching.The current collision detection methods for virtual and real objects have a large amount of calculation and low detection accuracy.It proposes an octree layered collision detection optimization algorithm based on voxel representation of model surface and volume difference,which improves the detection accuracy on the basis of ensuring calculation efficiency.Experimental results show that the proposed methods have high real-time and accuracy,which greatly enhance the realism and immersion of the assembly system.

Key words: Augmented reality, Mixing of virtual and actual reality, Occlusion handling, Collision detection, Virtual avatar

CLC Number: 

  • TP391.9
[1] LI W,WANG J,LIU M,et al.Real-Time Occlusion Handlingfor Augmented Reality Assistance Assembly Systems with Monocular Images[J].Journal of Manufacturing Systems,2022,62:561-574.
[2] JIANG S Q,ZHANG M J,LIW Q,et al.Real-Time Virtual and Real Occlusion Processing Technology Based on Voting Decision [J].Journal of Graphics,2021,42(4):629-635.
[3] ZHAO Y,CHEN J,ZHANG S Q,et al.H4H:Hybrid Convolution-Transformer Architecture Search for NPU-CIM Heterogeneous Systems for AR/VR Applications[C]//Proceedings of the 30th Asia and South Pacific Design Automation Conference.2025:1133-1141.
[4] ZHAI L,CHEN D.Image Real-Time Augmented Reality Technology Based on Spatial Color and Depth Consistency[J].Journal of Real-Time Image Processing,2021,18(2):369-377.
[5] KIDO D,FUKUDA T,YABUKI N.Assessing Future Landscapes Using Enhanced Mixed Reality with Semantic Segmentation by Deep Learning[J].Advanced Engineering Informatics,2021,48:101281.
[6] NAM H,JUNG D S,MOON G,et al.Joint reconstruction of 3d human and object via contact-based refinement transformer[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2024:10218-10227.
[7] LI W,WANG J,LIU M,et al.Real-time occlusion handling for augmented reality assistance assembly systems withmonocular images[J].Journal of Manufacturing Systems,2022,62:561-574.
[8] FRIKHA R,EJBALI R,ZAIED M.Handling Occlusion in Augmented Reality Surgical Training Based Instrument Tracking[C]//2016 IEEE/ACS 13th International Conference of Computer Systems and Applications(AICCSA).IEEE,2016:1-5.
[9] TIAN Y,ZHOU X,WANG X,et al.Registration and Occlusion Handling Based on the FAST ICP-ORB Method for Augmented Reality Systems[J].Multimedia Tools and Applications,2021,80(14):21041-21058.
[10] KIKUCHI N,FUKUDA T,YABUKI N.Landscape Visualiza-tion by Integrating Augmented Reality and Drones with Occlusion Handling to Link Real and Virtual Worlds-Towards City Digital Twin Realization[C]//2021 39th Conference on Education and Research in Computer Aided Architectural Design in Europe.2021:521-528.
[11] EVANGELIDIS K,PAPADOPOULOS T,SYLAIOU S.Mixed Reality:A Reconsideration Based on Mixed Objects and Geospatial Modalities[J].Applied Sciences,2021,11(5):2417.
[12] AVETISYAN A,XIE C,HOWARD-JENKINS H,et al.Scenescript:Reconstructing scenes with an autoregressive structured language model[C]//European Conference on Computer Vision.Cham:Springer,2024:247-263.
[13] CHEN C,PAN Y,LI D,et al.A Virtual-Physical Collision Detection Interface for AR-Based Interactive Teaching of Robot[J].Robotics and Computer-Integrated Manufacturing,2020,64:101948.
[14] WANG Y,YANG G.Research and Implementation of Collision Interaction Between Virtual and Actual Objects in Range Image[J].Computer Engineering and Applications,2015,51(21):161-167.
[15] CHEN M,LING C.3D Monocular Sphere-to-Plane Virtual-to-Real Objects Collision Estimation Algorithm[J].Journal of Computer-Aided Design & Computer Graphics,2012,24(1):43-49.
[16] LI Y,SHEN X K.A Collision Detection Algorithm in the Augmented Reality Environment Based on Real-Time Hand Tracking and Localization[J].Journal of Computer-Aided Design & Computer Graphics,2011,23(4):713-718.
[17] ZHANG Z Y.A Flexible New Technique for Camera Calibration[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2000,22(11):1330-1334.
[18] JIN Y,GENG J,HE Z,et al.A Capsule-Based Collision Detection Approach of Irregular Objects in Virtual Maintenance[J].Assembly Automation,2021,41(1):89-105.
[1] CHEN Le, GAO Ling, REN Jie, DANG Xin, WANG Yi-hao, CAO Rui, ZHENG Jie, WANG Hai. Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality [J]. Computer Science, 2022, 49(1): 194-203.
[2] DU Yu-lin, HUANG Zhang-rui, ZHAO Xin-can, LIU Chen-yang. SSVEP Stimulus Number Effect on Performance of Brain-Computer Interfaces in Augmented Reality Glasses [J]. Computer Science, 2021, 48(8): 309-314.
[3] YANG Fan. Collision Detection Algorithm of AABB Bounding Box Based on B+ Tree [J]. Computer Science, 2021, 48(6A): 331-333.
[4] LI Pu, SUN Chang-le, XIONG Wei, WANG Hai-tao. Collision Detection Algorithm Based on Semi-transparent Color Overlay and Depth Value [J]. Computer Science, 2018, 45(6A): 193-197.
[5] SHEN Ying, WANG Hui, WANG Li-hui and WU Qing-qing. Simplifying 3D Models and Collision Detection on Smartphones [J]. Computer Science, 2017, 44(Z11): 251-256.
[6] PAN Ren-yu, SUN Chang-le, XIONG Wei and WANG Hai-tao. Survey and Prospect of Collision Detection Based on Virtual Assembly Environment [J]. Computer Science, 2016, 43(Z11): 136-139.
[7] WANG Wei, WANG Zhi-qiang, ZHAO Ji-jun and SHEN Yan-guang. Research of Augmented Reality Based on Mobile Platform [J]. Computer Science, 2015, 42(Z11): 510-519.
[8] ZHANG Guo-liang, WU Yan-xiang, WANG Zhan-ni and WANG Tian. Research on Augmented Reality System Modeling and Registration Error Based on Simple Visual Marker [J]. Computer Science, 2015, 42(6): 299-302.
[9] LIU Hai-ping. Research on Collision Detection of Convex Polyhedron Based on Mixed Artificial Fish Swarm Algorithm [J]. Computer Science, 2014, 41(Z6): 61-63.
[10] YANG Guo-liang and ZHANG Jin-hui. Research on Multi-object Tracking Using Hierarchical Data Association [J]. Computer Science, 2014, 41(9): 306-310.
[11] LU Xiao-jing and HUANG Xiang-sheng. Fast Calculation Method of Space Transform Model [J]. Computer Science, 2014, 41(3): 279-281.
[12] . Mobile Augmented Reality Technology Applied on Mobile Phone Platform [J]. Computer Science, 2012, 39(Z6): 493-498.
[13] WU Yan-lian,TANG Liang.CAO Wei-xing,ZHU Yan. Collision Detection and Response in Crop Visualization [J]. Computer Science, 2011, 38(10): 263-266.
[14] ZHAO Wei,LI Wen-hui. Fast Collision Detection Algorithm for Spherical Blend Reconstruction [J]. Computer Science, 2009, 36(7): 164-169.
[15] . [J]. Computer Science, 2008, 35(7): 161-165.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!