Computer Science ›› 2024, Vol. 51 ›› Issue (6): 272-281.doi: 10.11896/jsjkx.230300180

• Artificial Intelligence • Previous Articles     Next Articles

Study on Human-Machine Hybrid Intelligent Decision-making Paradigm and Its Operational Application

DING Yanyan1,2, FENG Jianhang3, YE Ling3, ZHENG Shaoqiu3, LIU Fan1,2   

  1. 1 College of Computer and Software,Hohai University,Nanjing 210098,China
    2 Science and Technology on Underwater Vehicle Technology Laboratory,Harbin Engineering University,Harbin 150001,China
    3 The 28th Research Institute of China Electronics Technology Group Corporation,Nanjing 210007,China
  • Received:2023-03-23 Revised:2023-09-08 Online:2024-06-15 Published:2024-06-05
  • About author:DING Yanyan,born in 1999,postgra-duate.Her main research interests include machine intelligence,multimodal learning and object detection of UAV.
    LIU Fan,born in 1988,Ph.D,professor,is a member of CCF(No.63762S).His main research interests include compu-ter vision,pattern recognition and machine learning.
  • Supported by:
    Joint Fund of Ministry of Education for Equipment Pre-research(8091B032157),Key Laboratory of Information System Requirement(LHZZ2021-M04),Research Fund from Science and Technology on Underwater Vehicle Technology Laboratory(2021JCJQ-SYSJJ-LB06905)and “Qinglan Project” of Jiangsu Province.

Abstract: Human-machine hybrid intelligence combines machine intelligence and human intelligence,giving full play to the respective intelligence advantages of machines and humans,and realizing cross-vector and cross-cognition of intelligence.As a new form of intelligence,human-machine hybrid intelligence has a wide range of application prospects.Human-machine hybrid intelligence decision making introduces human thinking into intelligence systems,and utilizes multi-intelligence cooperation to complete hybrid decision-making for a certain task.Existing research on human-machine hybrid intelligence decision making lacks holistic theoretical descriptions and categorical comparisons,more importantly,there are fewer architectural descriptions of operational decision making systems concerning the military domain.Therefore,the generic human-machine hybrid decision making paradigm is classified from the perspectives of collaborative interaction means and decision stages,while the applications of human-machine hybrid intelligent decision making systems in different paradigms for operational purposes are analyzed.In addition,the problems of current human-machine hybrid intelligent decision-making paradigms and systems are summarized,and the future development directions are prospected.

Key words: Human-Machine hybrid intelligence, Hybrid decision-making, Human-in-the-loop, Human-on-the-loop, Human-outside-the-loop

CLC Number: 

  • TP181
[1]SUN Y X,ZHOU X Z,XU S,et al.Research on human-machine hybrid model of intelligent command and control system[J].Firepower and Command and Control,2020,45(12):80-86.
[2]WU Z H,ZHENG N G.Hybrid intelligence:a new direction for artificial intelligence[J].Newsletter of China Computer Society,2012,8(3):59-64.
[3]TSAROUCHI P,MAKRIS S,CHRYSSOLOURIS G.Human-robot interaction review and challenges on task planning and programming[J].International Journal of Computer Integrated Manufacturing,2016,29(8):916-931.
[4]LIN P Y,XIA Y M,CAI S T,et al.Multi-robot cooperative map construction based on visual SLAM[J].Experimental Techno-logy and Management,2022,39(2):87-94.
[5]CENG C.Research on human-robot skill transfer technology[D].Guangzhou:South China University of Technology,2019.
[6]SHEN S L,HUANG X,ZHU R Z,et al.Development of universal industrial robot teaching device based on Linux system[J].Machine Tool and Hydraulic,2021,49(3):63-68.
[7]BAI K,WANG L.Cloud platform simulation of intelligent control system of picking robot based on Simulink[J].Agricultural Mechanization Research,2021,43(8):225-229.
[8]YANG D H,FANG W,SHU H.Civil Aircraft Cockpit Simulation Platform Based on Mixed Reality Technology[J].Civil Aircraft Design and Research,2023(4):13-20.
[9]VARGAS J,IMPATA B,GIL P,et al.3DCNN Performance in Hand Gesture Recognition Applied to Robot Arm Interaction[C]//Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods(ICPRAM).Prague,Czech Republic,2019:802-806.
[10]FENG Q.Multi-objective optimization based on improved particle swarm optimization and its application[D].Beijing:University of Science and Technology Beijing,2022
[11]TANG Q R,XIA G C,XU C F,et al.Design of man-machine interaction system for teleoperation of space manipulator[J].Journal of Command and Control,2022,8(3):278-285.
[12]ROSHDY A,AL KORK S,SAID S,et al.A wearable exoskeleton rehabilitation device for paralysis-a comprehensive study[J].Advances in Science,Technology and Engineering Systems Journal,2019,4(1):17-26.
[13]HAMAYAM,MATSUBARA T,NODA T,et al.Learning as-sistive strategies for exoskeleton robots from user-robot physical interaction[J].Pattern Recognition Letters,2017,99(nov.1):67-76.
[14]ZHANG R X,ZHANG X S,GUO Y,et al.Gesture recognition and analysis based on surface electromyography[J].Medical Biomechanics,2022,37(5):818-825.
[15]HUANG Q Y.Research on Multi-modal human-machine Interface and Its Application for Disabled Persons[D].Guangzhou:South China University of Technology,2019.
[16]WANG Y L,QIU J,HUANG R,et al.Human-machine collaborative intelligent system and its clinical application[J].Journal of University of Electronic Science and Technology of China,2020,49(4):482-489.
[17]MISKOVIC N,BIBULI M,BIRK A,et al.CADDY-Cognitive Autonomous Diving Buddy:Two Years of Underwater Human-Robot Interaction[J].Marine Technology Society Journal,2016,50(4):54-66.
[18]ZHU G M.Research on feature extraction and classificationmethod of multimodal brain-computer interface based on EEG and fNIRS[D].Hangzhou:Hangzhou Dianzi University,2017.
[19]MUSIC′ S,HIRCHE S.Control sharing in human-robot team interaction[J].Annual Reviews in Control,2017,44:342-354.
[20]CHEN Y N,PU Z X,ZHENG Z N.A new vascular interventional surgical robot with force detection mechanism[J].Journal of Engineering Design,2023,30(1):20-31.
[21]DU Y C,SUN Y.Design of a bionic multifunctional robot for helping the disabled[J].Progress in Biomedical Engineering,2020,41(1):15-17.
[22]SYCARA K,LEBIERE C,PEI Y,et al.Abstraction of analytical models from cognitive models of human control of robotic swarms[C]//13th International Conference on Cognitive Mo-deling(ICCM 2015).University of Pittsburgh,2015:13-18.
[23]STEWARTA,MING C,NEDIC A,et al.Towards Human-Ro-bot Teams:Model-Based Analysis of Human Decision Making in Two-Alternative Choice Tasks With Social Feedback[J].Proceedings of the IEEE,2012,100(3):751-775.
[24]ZHANG D,WANG M Y,TANG S.Task-oriented autonomous decision-making technology for UAV cluster[J].Journal of Command and Control,2022,8(4):365-377.
[25]BAI Y F,WU H Z,LIU J H,et al.Structural design and simulation of a wearable lower limb exoskeleton robot[J].Wool Spinning Technology,2021,49(7):68-74.
[26]SHENG M,LIU S Q,WANG J,et al.Real-time identification of motion intention of intelligent lower limb prosthesis based on improved template matching[J].Control and Decision,2020,35(9):2153-2161.
[27]HE R,ZHAO X C,YANG Y B,et al.Co-driving model based on driver’s risk response mechanism[J].Journal of Jilin University(Engineering Edition),2021,51(3):799-809.
[28]ZHANG J P,LI Z J.Q2SM:BERT-based multi-domain task-based dialogue system state tracking algorithm[J].Journal of Chinese Information,2020,34(7):89-95.
[29]WANG H W,LIU C Y,LI L,et al.Research on trajectorytracking control of unmanned vehicle based on efficient NMPC algorithm[J].Automotive Engineering,2022,44(10):1494-1502.
[30]CHEN Y G,HUANG Q,WU T Q.Research on the mobile assistant platform for the elderly based on MDM protocol[J].Science and Technology Wind,2021(24):3-4.
[31]ADAM C,LIANG R P,WU H,et al.Human-machine symbiosis operational decision-making system:development vision and key technologies[J].Firepower and Command and Control,2022,47(7):1-6.
[32]LI Y,CUI R,YAN W,et al.Long-term adaptive informative path planning for scalar field monitoring using cross-entropy optimization[J].Science China Information Sciences,2019,62:1-3.
[33]LIANG X,ZHAO H,LI X,et al.Force tracking impedance control with unknown environment via an iterative learning algorithm[C]//2018 3rd International Conference on Advanced Robotics and Mechatronics(ICARM).IEEE,2018:158-164.
[34]HUANG Q,LAN J,LI X.Automatic ultrasound scanning system based on robotic arm[J].Sci.China Inf.Sci.,2019,62(5):50211:1-50211:3.
[35]ZHOU Y.Research and application of dynamic multi-objective evolutionary optimization based on prediction[D].Lanzhou:Lanzhou University of Technology,2021.
[36]XU H,SONG B L,JIANG L,et al.An intelligent decision-ma-king algorithm for anti-interference resource allocation in communication[J].Journal of Electronics and Information,2021,43(11):3086-3095
[37]LIANG D,SUN N,WU Y,et al.Trajectory planning-based control of underactuated wheeled inverted pendulum robots[J].Science China Information Sciences,2019,62:1-3.
[38]HU Z Z,YUAN W L,LUO J R,et al.Decision-making algorithm for combinatorial optimization problems with multi-optimal solutions[J].Journal of National University of Defense Technology,2022,44(3):31-40.
[39]MA X L,CHEN X,LEI Y Y.Research on A* algorithm ofUAV route planning based on data link[J].Electro-optic and Control,2009,16(12):15-17.
[40]WANG H N,ZHANG X M.Research on path planning of multi-AGV system in human-machine mixed environment[J].Logistics Engineering and Management,2018,40(6):88-90.
[41]WU L H,LONG H X,FENG J P.Research on cognitive lear-ning mechanism and calculation model of intelligent machines[J].Electronic Technology and Software Engineering,2021(21):106-109.
[42]LI W,CHEN J.Review and prospect of cooperative combat ofmanned aircraft/unmanned aircraft mixed formation[J].Aerospace Control,2017,35(3):90-96.
[43]LIU B.Research on the concept and technology ofmanned/unmanned cooperative formation on the ground[J].Cruise Missiles,2018(10):29-34.
[44]YU J,QIU M,JIANG J,et al.Modelling domain relationshipsfor transfer learning on retrieval-based question answering systems in e-commerce[C]//Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining.2018:682-690.
[45]ZHOU J Y,WANG S T.Multi-source Online Transfer Learning Algorithm for Imbalanced Data[J].Journal of Frontiers of Computer Science and Technology,2023,17(3):687-700.
[46]VIJAYAKUMAR A K,COGSWELL M,SELVARAJU R R,et al.Diverse beam search:Decoding diverse solutions from neural sequence models[J].arXiv:1610.02424,2016.
[47]CHEN Y N,HAKKANI-TÜR D,TÜR G,et al.End-to-endmemory networks with knowledge carryover for multi-turn spoken language understanding[C]//Interspeech.2016:3245-3249.
[48]QIAN J,HUANG R T,ZOU B W,et al.Generative reading comprehension based on multi-task learning[J].Journal of Chinese Information,2021,35(12):103-111.
[1] JIANG Gaoxia, WANG Fei, XU Hang, WANG Wenjian. Robust Estimation and Filtering Methods for Ordinal Label Noise [J]. Computer Science, 2024, 51(6): 144-152.
[2] JIANG Rui, YANG Kaihui, WANG Xiaoming, LI Dapeng, XU Youyun. Attentional Interaction-based Deep Learning Model for Chinese Question Answering [J]. Computer Science, 2024, 51(6): 325-330.
[3] XIN Yuanxia, HUA Daoyang, ZHANG Li. Multi-agent Reinforcement Learning Algorithm Based on AI Planning [J]. Computer Science, 2024, 51(5): 179-192.
[4] YANG Xuhua, ZHANG Lian, YE Lei. Adaptive Context Matching Network for Few-shot Knowledge Graph Completion [J]. Computer Science, 2024, 51(5): 223-231.
[5] YUAN Rong, PENG Lilan, LI Tianrui, LI Chongshou. Traffic Flow Prediction Model Based on Dual Prior-adaptive Graph Neural ODE Network [J]. Computer Science, 2024, 51(4): 151-157.
[6] LIN Qiye, XIA Jianan, ZHOU Xuezhong. Study on Time-varying Brain State Based on fMRI Data-A Review [J]. Computer Science, 2024, 51(4): 182-192.
[7] WANG Jiahao, YAN Hang, HU Xin, ZHAO Dexin. Study on Open Set Activity Recognition Technology Based on Wearable Devices [J]. Computer Science, 2024, 51(4): 291-298.
[8] XING Kaiyan, CHEN Wen. Multi-generator Active Learning Algorithm Based on Reverse Label Propagation and ItsApplication in Outlier Detection [J]. Computer Science, 2024, 51(4): 359-365.
[9] WANG Xin, HUANG Weikou, SUN Lingyun. Survey of Incentive Mechanism for Cross-silo Federated Learning [J]. Computer Science, 2024, 51(3): 20-29.
[10] GAO Mengqi, FENG Xiang, YU Huiqun, WANG Mengling. Large-scale Multi-objective Evolutionary Algorithm Based on Online Learning of Sparse Features [J]. Computer Science, 2024, 51(3): 56-62.
[11] ZHOU Honglin, SONG Huazhu, ZHANG Juan. Knowledge Graph Embedding Model with Entity Description on Cement Manufacturing Domain [J]. Computer Science, 2024, 51(3): 251-256.
[12] XU Maolong, JIANG Gaoxia, WANG Wenjian. Label Noise Filtering Framework Based on Outlier Detection [J]. Computer Science, 2024, 51(2): 87-99.
[13] LI Junwei, LIU Quan, XU Yapeng. Option-Critic Algorithm Based on Mutual Information Optimization [J]. Computer Science, 2024, 51(2): 252-258.
[14] DAI Wei, CHAI Jing, LIU Yajiao. Semi-supervised Learning Algorithm Based on Maximum Margin and Manifold Hypothesis [J]. Computer Science, 2024, 51(2): 259-267.
[15] WANG Yangmin, HU Chengyu, YAN Xuesong, ZENG Deze. Study on Deep Reinforcement Learning for Energy-aware Virtual Machine Scheduling [J]. Computer Science, 2024, 51(2): 293-299.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!