生成对抗网络GAN综述

doi:10.11896/j.issn.1002-137X.2019.03.009

Abstract

Abstract: Humans can understand the way of movement,so they can predictthe future development of things more accurately than machines.But GAN (Generative Adversarial Network) is a new neural Network system,its dataare very lifelike,even people can’t identify whether the data are real or generated.In a sense,GAN provides a brand new thought for guiding the artificial intelligence system to accomplish complex tasks,and makes the machine a specialist.In this paper,first of all,the basic model and some improvements model of GAN were discussed.Then,some application achievements of GAN were shown,such as the images generated by the super resolution,by a text description,by the artistic style and short video generated.Finally,some problems of theory,architecture,and application in the future research were discussed

Key words: Artificial intelligence, Deep learning, Discriminator, GAN, Generator

CLC Number:

TP181

CHENG Xian-yi,XIE Lu,ZHU Jian-xin,HU Bin,SHI Quan. Review of Generative Adversarial Network[J].Computer Science, 2019, 46(3): 74-81.

References

[1]GOODFELLOW I,BENGIO Y,COURVILLE A.Deep Learning[M].Cambridge,UK:MIT Press,2016:23-34.
[2]LIU Q,ZHAI J H,ZHANG Z Z,et al.A Survey on Deep Reinforcement Learning[J].Chinese Journal of Computers,2017,40(1):1-28.(in Chinese)
刘全,翟建伟,章宗长,等.深度强化学习综述[J].计算机学报,2017,40(1):1-28.
[3]GOODFELLOW I,POUGET-ABADIE J,MIRZA M,et al.Gene-
rative adversarial nets[C]∥Proceedings of the 2014 Conference on Advances in Neural Information Processing Systems 27.Montreal,Canada:Curran Associates,2014:2672-2680.
[4]YU L T,ZHANG W N,WANG J,et al.SeqGAN:sequence gene-
rative adversarial nets with policy gradient[J/OL].https://arxiv.org/abs/1609.05473.
[5]SHAKIR M,LAKSHMINARAYANAN B.Learning in Implicit Generative Models[J/OL].https://openreview.net/pdf?id=B16Jem9xe.
[6]CHENG C.Interpretation of the GAN and its progress in 2016[EB/OL].https://zhuan lan.zhihu.com/p/25000523?refer=dlclass.
[7]HU W W,TAN Y.Generating adversarial malware examples
for black-box attacks based on GAN[J/OL].https:// openreview.net/pdf?id=7xes.
[8]MIRZA M,OSINDERO S.Conditional Generative Adversarial
Nets[J].Computer Science,2014,27(8):2672-2680.
[9]DENTON E L,CHINTALA S,FERGUS R.Deep Generative
Image Models using a Laplacian Pyramid of Adversarial Networks[C]∥Advances in Neural Information Processing Systems.2015:1486-1494.
[10]RAVANBAKHSH S,LANUSSE F,MANDELBAUM R,et al.Enabling Dark Energy Science with Deep Generative Models of Galaxy Images[J/OL].https://arxiv.org/abs/1609.05796.
[11]SEBASTIAN N,CSEKE B,TOMIOKA R.f-GAN:Training
Generative Neural Samplers using Variational Divergence Minimization[J/OL].https://arxiv.org/abs/1606.00709.
[12]ZHAO J B,MICHAEL M,YANN L C.Energy-based Generative Adversarial Network[J/OL].https://arxiv.org/abs/1609.03126.
[13]HE K M,ZHANG X Y,REN S Q,et al.Deep residual learning for image recognition[C]∥Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).Las Vegas,NV,USA:IEEE,2016:770-778.
[14]CHEN X,DUAN Y,HOUTHOOFT R,et al.InfoGAN:Inter-
pretable Representation Learning by Information Maximizing Generative Adversarial Nets[J/OL].https://arxiv.org/abs/1606.03657.
[15]GANIN Y,USTINOVA E,AJAKAN H,et al.Domain adversa-
rial training of neural networks[J].Journal of Machine Learning Research,2016,17(59):1-35
[16]TOBIAS J.Unsupervised and semi-supervised learning with categorical generative adversarial networks[C]∥ICLR-2016,Springenberg.2016:876-884.
[17]CHEN W Z,WANG H,LI Y Y et al.Synthesizing training images for boosting human 3D pose estimation[C]∥Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV).Stanford,CA,USA:IEEE,2016:479-488.
[18]PROBST M.Generative Adversarial Networks in Estimation of Distribution Algorithms for Combinatorial Optimization[J/OL].https://arxiv.org/abs/1509.09235.
[19]GREGOR K,DANIHELKA I,GRAVES A,et al.DRAW:
A recurrent neural network for image generation[J/OL].https://arxiv.org/abs/ 1502.04623.
[20]RADFORD A,METZ L,CHINTALA S.Unsupervised representation learning with deep convolutional generative adversarial networks[J/OL].https://arxiv.org/abs/ 1511.06434.
[21]AUGUSTUS O,OLAH C,SHLENS J.Conditi- onal Image Synthesis With Auxiliary Classifier GANs[J/OL].https://arxiv.org/abs/1610.09585.
[22]HANOCK K,ZHANG B T.Generating Images Part by Part
with Composite Generative Adversarial Networks[J/OL].https://arxiv.org/abs/1607.05387.
[23]KURAKIN A,GOODFELLOW I,BENGIO S.Adversarial exam-
ples in the physical world[J/OL].https://arxiv.org/abs/1607.02533.
[24]ANTONIA C,BHARATH A A.Task Specific Adversarial Cost Function[J/OL].[2017-01-17].http://Creswell.com/caa?arXiv:1609.08661.
[25]CHE T,LI Y,JACOB A P,et al.Mode Regularized Generative Adversarial Networks[C/OL].[2017-01-30].https://openreview.net/pdf?id=HJKkY35le.
[26]IM D J,MA H,KIM C D,et al.Generative Adversarial Paralleli-
zation[C/OL].https://openreview.net/pdf?id=Sk8J83oee.
[27]METZ L,POOLE B,PFAU D,et al.Unrolled Generative Adversarial Networks[C/OL].https://openre view.net/pdf?id＝BydrOIcle.
[28]WARDE-FARLEY D,BENGIO Y.Improving Generative Ad-
versarial Networks with Denoising Feature Matching[C/OL].https://openreview.net/pdf?id=S1X7nhsxl.
[29]CHRISTIAN L.Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network[J/OL].https://ar-xiv.org/abs/1609.04802.
[30]ALEXEY D,BROX T.Generating images with perceptual similarity metrics based on deep networks[J/OL].https://arxiv.org/abs/1602.02644.
[31]REED S,AKATA Z,YAN X,et al.Generative adversarial text to image synthesis[C]∥International Conference on International Conference on Machine Learning.JMLR.org,2016:1060-1069.
[32]LARSEN A B L,SNDERBY S K,WINTHER O.Autoenco-
ding beyond pixels using a learned similarity metric[J/OL].[2015-11-02].https://arxiv.org/abs/1512.09300.
[33]VONDRICK C,PIRSIAVASH H,TORRALBA A.Generating Videos with Scene Dynamics[C]∥NIPS-2016.Stanford,CA:IEEE,2016:562-570.
[34]SPRINGENBERG J T.Unsupervised and Semi-supervised Lear-
ning withCategorical Generative Adversarial Networks[J/OL].https://arxiv.org/abs/1511.06390.
[35]LEON A.Gatys,Alexander S.Ecker,Matthias Bethge.A Neural Algorithm of Artistic Style[J/OL].https://arxiv.org/abs/1508.06576.
[36]ZHU H,LI Q M,LI D Q.Facial Multi-landmarks Localization Based on Single Convolution Neural Network[J].ComputerScien-ce,2018,45(4):273-279.(in Chinese)
朱虹,李千目,李德强.基于单个卷积神经网络的面部多特征点定位[J].计算机科学,2018,45(4):273-279.
[37]REN J,HU X F,LI N.Transfer Prediction Learning Based on Hybrid of SDA and SVR[J].Computer Science,2018,45(1):281-286.(in Chinese)
任俊,胡晓峰,李宁.基于SDA与SVR混合模型的迁移学习预测算法[J].计算机科学,2018,45(1):281-286.
[38]WANG K F,GOU C,DUAN Y J,et al.Generative Adversarial Networks:The State of the Art and Beyond[J].Acta Automatica Sinica,2017,43(3):321-333.(in Chinese)
王坤峰,苟超,段艳杰,等.生成式对抗网络GAN的研究进展与展望[J].自动化学报,2017,43(3):321-333.
[39]ODENA A.Semi-SupervisedLearning with Generative Adversarial Networks[J/OL].https://arxiv.org/abs/1508.06576.
[40]WANG X,GUPTA A.Generative Image Modeling using Style and Structure Adversarial Networks[J/OL].https://arxiv.org/abs/1603.05631.
[41]DENTON E L,CHINTALA S,FERGUS R.Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks[C]∥Advances in Neural Information Processing Systems.2015:1486-1494.
[42]EDWARDS H,STORKEY A.Censoring Representations with an Adversary[J/OL].[2015-01-26].https://arxiv.org/abs/1511.05897.
[43]ZHOU Z H,FENG J.Deep Forest:Towards An Alternative to Deep Neural Networks[J/OL].https://arxiv.org/abs/1702.08835.

Related Articles 15

[1]	XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2]	RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3]	TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4]	WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[5]	HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[6]	JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[7]	SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[8]	HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[9]	CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[10]	HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[11]	ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[12]	SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[13]	ZHU Wen-tao, LAN Xian-chao, LUO Huan-lin, YUE Bing, WANG Yang. Remote Sensing Aircraft Target Detection Based on Improved Faster R-CNN [J]. Computer Science, 2022, 49(6A): 378-383.
[14]	WANG Jian-ming, CHEN Xiang-yu, YANG Zi-zhong, SHI Chen-yang, ZHANG Yu-hang, QIAN Zheng-kun. Influence of Different Data Augmentation Methods on Model Recognition Accuracy [J]. Computer Science, 2022, 49(6A): 418-423.
[15]	MAO Dian-hui, HUANG Hui-yu, ZHAO Shuang. Study on Automatic Synthetic News Detection Method Complying with Regulatory Compliance [J]. Computer Science, 2022, 49(6A): 523-530.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed

Comments

Recommended 0

No Suggested Reading articles found!

Review of Generative Adversarial Network

PDF (PC)