Computer Science ›› 2021, Vol. 48 ›› Issue (1): 175-181.doi: 10.11896/jsjkx.200200023

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Domain Alignment Based Object Detection of X-ray Images

HE Yan-hui1, WU Gui-xing1,2, WU Zhi-qiang1   

  1. 1 School of Software Engineering,University of Science and Technology of China,Suzhou,Jiangsu 215123,China
    2 Suzhou Research Institute,University of Science and Technology of China,Suzhou,Jiangsu 215123,China
  • Received:2020-02-05 Revised:2020-05-24 Online:2021-01-15 Published:2021-01-15
  • About author:HE Yan-hui,born in 1994,postgra-duate.His main research interests include object detection,transfer learning and so on.
    WU Gui-xing,born in 1972,Ph.D,professor,Ph.D supervisor,researcher,is a member of China Computer Federation.His main research interests include information theory,multimedia and so on.
  • Supported by:
    Natural Science Foundation ofJiangsu Province,China(BK20141209).

Abstract: Significant progress has been made towards building accurate automatic object detection systems for a variety of parcel security check applications using convolutional neural networks.However,the performance of these systems often degrades when they are applied to new data that differs from the training data,for example,due to variations in X-ray imaging.In this paper,we propose a context-based and transmittance adaptive domain alignment method to address the above performance degradation.Firstly,by using color information existed in X-ray images,we design an attention mechanism to process each color channel of an X-ray image separately to solve the problem of color differences among different X-ray machines.Next,we develop a feature alignment method to reduce the statistics difference among different X-ray images generated by various manufacturers.Finally,we propose to use a context vector as a regularization for the improvement of adversarial training to improve the precision.Theme-thod proposed in this paper solves the problem of the accuracy degradation of the object detection in the test domain,which is different from the training domain.

Key words: Object detection, X-ray images, Domain alignment, Transmittance-adptation, Convolutional neural network

CLC Number: 

  • TP183
[1] EVERINGHAM M,VAN GOOL L,WILLIAMS C K,et al.The pascal visual object classes(voc) challenge [J].IJCV 2010,88(2):303-338.
[2] REN S,HE K,GIRSHICK R,et al.Faster rcnn:Towards real-time object detection with region proposal networks[C]//NIPS.2015:1-9.
[3] MERY D,RIFFO V,ZSCHERPEL U,et al.Gdxray:The database of x-ray images for nondestructive testing[J].Journal of Nondestructive Evaluation,2010,34(4):42.
[4] MIAO C J,XIE L X,WAN F,et al.SIXray:A Large-scale Security Inspection X-ray Benchmark for Prohibited Item Discovery in Overlapping Images[J].arXiv:1901.00303.
[5] Ailibaba.Dataset :Logistics goods restriction monitoring[EB/OL].(2019-03-05) [2019-06-08].
[6] GANIN Y,LEMPITSKY V.Unsupervised domain adaptationby backpropagation[C]//ICML.2014.
[7] BEN-DAVID S,BLITZER J,CRAMMER K,et al.A theory of learning from different domains[J].Machine Learning,2010,79(1):151-175.
[8] TZENG E,HOFFMAN J,SAENKO K,et al.Adversarial dis-criminative domain adaptation[C]//CVPR.2017:11,19.
[9] TZENG E,HOFFMAN J,ZHANG N,et al.Deep domain confusion:Maximizing for domain invariance[J].arXiv:1412.3474.
[10] LONG M,CAO Y,WANG J,et al.Learning transferable fea-tures with deep adaptation networks[C]//ICML.2015.
[11] DUAN L,TSANG I W,XU D.Domain transfer multiple kernel learning[J].TPAMI,2012,34(3):465-479.
[12] INOUE N,FURUTA R,YAMASAKI T,et al.Cross-domainweakly-supervised object detection through progressive domain adaptation[J].arXiv:1803.11365.
[13] ZHU J Y,PARK T,ISOLA P,et al.Unpaired image-to-image translation using cycle-consistent adversarial networks[J].arXiv:1703.10593.
[14] CHEN Y,LI W,SAKARIDIS C,et al.Domain adaptive faster r-cnn for object detection in the wild[J].arXiv:1803.03243.
[15] SAITO K,USHIKU Y,HARADA T,et al.Strong-Weak Distribution Alignment for Adaptive Object Detection[C]//CVPR.2019:2154-2162.
[16] ZHU X G,JIANG M,YANG C Y.Adapting Object Detectors via Selective Cross-Domain Alignment [C]//CVPR.2019:687-696.
[17] SCHWAB P,KELLER E,MUROI C.Not to Cry Wolf:Distantly Supervised Multitask Learning in Critical Care[J].arXiv:1802.05027.
[18] CAI Z,VASCONCELOS N.Cascade R-CNN:Delving into high quality object detection[J].arXiv:1712.00726.
[19] HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learning for Image Recognition[J].arXiv:1512.03385.
[20] LIN T Y,GOYAL P,GIRSHICK R,et al.Focal loss for dense object detection[J].arXiv:1708.02002.
[21] LIN T Y,DOLLAR P,GIRSHICK R,et al.Feature pyramidnetworks for object detection[C]//CVPR.2017:2117-2125.
[22] DENG J,DONG W,SOCHER R,et al.Imagenet:A large-scale hierarchical image database[C]//CVPR.2009:248-255.
[23] CORDTS M,OMRAN M,RAMOS S,et al.The Cityscapesdataset for semantic urban scene understanding[C]//CVPR.2016:268-276.
[1] SHAN Mei-jing, QIN Long-fei, ZHANG Hui-bing. L-YOLO:Real Time Traffic Sign Detection Model for Vehicle Edge Computing [J]. Computer Science, 2021, 48(1): 89-95.
[2] LI Ya-nan, HU Yu-jia, GAN Wei, ZHU Min. Survey on Target Site Prediction of Human miRNA Based on Deep Learning [J]. Computer Science, 2021, 48(1): 209-216.
[3] ZHANG Jia-jia, ZHANG Xiao-hong. Multi-branch Convolutional Neural Network for Lung Nodule Classification and Its Interpretability [J]. Computer Science, 2020, 47(9): 129-134.
[4] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
[5] CUI Tong-tong, WANG Gui-ling, GAO Jing. Ship Trajectory Classification Method Based on 1DCNN-LSTM [J]. Computer Science, 2020, 47(9): 175-184.
[6] QI Shao-hua, XU He-gen, WAN You-wen, FU Hao. Construction of Semantic Mapping in Dynamic Environments [J]. Computer Science, 2020, 47(9): 198-203.
[7] LIU Hai-chao, WANG Li. Graph Classification Model Based on Capsule Deep Graph Convolutional Neural Network [J]. Computer Science, 2020, 47(9): 219-225.
[8] LIANG Zheng-you, HE Jing-lin, SUN Yu. Three-dimensional Convolutional Neural Network Evolution Method for Facial Micro-expression Auto-recognition [J]. Computer Science, 2020, 47(8): 227-232.
[9] SUN Yan-li, YE Jiong-yao. Convolutional Neural Networks Compression Based on Pruning and Quantization [J]. Computer Science, 2020, 47(8): 261-266.
[10] LIU Xiao, YUAN Guan, ZHANG Yan-mei, YAN Qiu-yan, WANG Zhi-xiao. Hand Gesture Recognition Based on Self-adaptive Multi-classifiers Fusion [J]. Computer Science, 2020, 47(7): 103-110.
[11] CHENG Zhe, BAI Qian, ZHANG Hao, WANG Shi-pu and LIANG Yu. Improving Hi-C Data Resolution with Deep Convolutional Neural Networks [J]. Computer Science, 2020, 47(6A): 70-74.
[12] HE Lei, SHAO Zhan-peng, ZHANG Jian-hua and ZHOU Xiao-long. Review of Deep Learning-based Action Recognition Algorithms [J]. Computer Science, 2020, 47(6A): 139-147.
[13] SUN Zheng and WANG Xin-yu. Application of Deep Learning in Photoacoustic Imaging [J]. Computer Science, 2020, 47(6A): 148-152.
[14] LUO Jin-nan and ZHANG Ji-min. Rail Area Extraction Using Extended Haar-like Features and DBSCAN Clustering [J]. Computer Science, 2020, 47(6A): 153-156.
[15] ZHANG Man, LI Jie, DING Rong-li, CHENG Hao-tian and SHEN Ji. Remote Sensing Image ObJect Detection Technology Based on Improved YOLO-V2 Algorithm [J]. Computer Science, 2020, 47(6A): 176-180.
Full text



[1] LEI Li-hui and WANG Jing. Parallelization of LTL Model Checking Based on Possibility Measure[J]. Computer Science, 2018, 45(4): 71 -75 .
[2] WEN Jun-hao, SUN Guang-hui and LI Shun. Study on Matrix Factorization Recommendation Algorithm Based on User Clustering and Mobile Context[J]. Computer Science, 2018, 45(4): 215 -219 .
[3] ZHANG Yu, GAO Ke-ning, YU Ge. Method of Link Prediction in Social Networks Using Node Attribute Information[J]. Computer Science, 2018, 45(6): 41 -45 .
[4] CHI Kai-kai, LIN Yi-min, LI Yan-jun, CHENG Zhen. Duty Cycle Scheme Maximizing Throughput in Energy Harvesting Sensor Networks[J]. Computer Science, 2018, 45(6): 100 -104 .
[5] CHEN Rong, LI Peng, HUANG Yong. Moving Shadow Removal Algorithm Based on Multi-feature Fusion[J]. Computer Science, 2018, 45(6): 291 -295 .
[6] SUN Hai-feng and SONG Li-li. Intersection-relay-assisted Routing Scheme in VANETs[J]. Computer Science, 2018, 45(5): 75 -78 .
[7] XU Wen-hao, SHEN Hang and BAI Guang-wei. Link Burstiness-aware Opportunistic Routing Protocol in Wireless Networks[J]. Computer Science, 2018, 45(5): 83 -88 .
[8] SHI Jing-qi, YANG Geng, SUN Yan-jun, BAI Shuang-jie and MIN Zhao-e. Efficient Parallel Algorithm of Fully Homomorphic Encryption Supporting Operation of Floating-point Number[J]. Computer Science, 2018, 45(5): 116 -122 .
[9] ZHANG Lei and KANG Bao-sheng. Image Inpainting for Object Removal Based on Structure Sparsity and Patch Difference[J]. Computer Science, 2018, 45(5): 255 -259 .
[10] LIU Xiao, WANG Xiao-guo. Probabilistic Graphical Model Based Approach for Bank Telecommunication Fraud Detection[J]. Computer Science, 2018, 45(7): 122 -128 .