图片分析在电子商务中的应用现状与未来趋势——基于图片视觉和内容特征的研究综述

doi:10.11896/jsjkx.210100017

摘要/Abstract

摘要： 计算机深度学习和大数据挖掘技术的发展,使得有效提取海量图片视觉和内容特征成为可能。图片分析已被广泛应用于电子商务研究中。通过对图片分析的相关文献进行梳理,从图片特征提取的方法和应用两个方面展开综述,提出了一个基于图片视觉和内容特征研究与应用的分析框架,系统地阐述了图片分析在电子商务领域的应用现状。通过分析发现,现有相关研究主要关注图片的视觉或内容特征对个体偏好和消费行为的影响作用,它们结合的作用效果仍有待深入探索;并且多数研究集中于社交网站用户发布图片的一般分析,缺少对消费行为的进一步研究。最后总结了图片分析在电子商务领域中未来需要关注的研究和发展方向,为未来的研究提供一定的参考。

关键词: 电子商务, 深度学习, 视觉内容分析, 视觉特征, 图片分析

Abstract: The development of computer deep learning and big data mining technology makes it possible to effectively extract the visual and content features of massive photos.Photo analysis has been widely used in e-commerce research.Through combing the related literatures of photo analysis,this paper reviews the methods and applications of photo feature extraction,puts forward an analysis framework based on the research and application of photo visual and content features,and systematically expounds the application status of photo analysis in the field of e-commerce.Through analysis,it is found that the existing related research mainly focuses on the influence of the visual or content features of photos on individual preference and consumption behavior.The effect of their combination remains to be further explored.And most of the research focuses on the general analysis of the photos posted by users on social networking sites,and lacks of further research on consumption behavior.Finally,it summarizes the future research and development direction of photo analysis in the field of e-commerce,which provides a certain reference for future research.

Key words: Deep learning, E-commerce, Photo analysis, Visual content analysis, Visual features

中图分类号:

TP399

刘荣, 张宁. 图片分析在电子商务中的应用现状与未来趋势——基于图片视觉和内容特征的研究综述[J]. 计算机科学, 2021, 48(6A): 137-142. https://doi.org/10.11896/jsjkx.210100017

LIU Rong, ZHANG Ning. Application Status and Future Trends of Photo Analysis in E-commerce:A Survey of Research Based on Photo Visual and Content Features[J]. Computer Science, 2021, 48(6A): 137-142. https://doi.org/10.11896/jsjkx.210100017

参考文献

[1] DIEHL K,ZAUBERMAN G,BARASCH A.How taking photos increases enjoyment of experiences [J].Journal of Personality and Social Psychology,2016,111(2):119-140.
[2] ARCHAK N,GHOSE A,IPEIROTIS P G.Deriving the pricing power of product features by mining consumer reviews [J].Management Science,2011,57(8):1485-1509.
[3] AHN J H,BAE Y S,JU J,et al.Attention adjustment,renewal,and equilibrium seeking in online search:An eye-tracking approach [J].Journal of Management Information Systems,2018,35(4):1218-1250.
[4] ZHANG S,LEE D,SINGH P V,et al.How much is an image worth?Airbnb property demand estimation leveraging large scale image analytics [OL].https://ssrn.com/abstract=2976021 or http://dx.doi.org/10.2139/ssrn.2976021,2017.
[5] CHI M,PAN M,WANG W.Impacts of cue consistency onshared accommodation bookings:Interaction between texts and images [J].Data Analysis and Knowledge Discovery,2020,4(11):74-83.
[6] LI X,WANG M,CHEN Y.The impact of product photo on online consumer purchase intention:An image-processing enabled empirical study[C]//Pacific Asia Conference on Information Systems.2014.
[7] WANG M,LI X,CHAU Y K.The impact of photo aesthetics on online consumer shopping behavior:An image-processing-enabled empirical study[C]//International Conference on Information Systems.2016.
[8] OUYANG W,WANG X,ZENG X,et al.Deepid-net:Defor-mable deep convolutional neural networks for object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2015:2403-2412.
[9] SUN Y,WANG X,TANG X.Deeply learned face representations are sparse,selective,and robust[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2015.
[10] ZHOU B,LAPEDRIZA A,XIAO J,et al.Learning deep features for scene recognition using places database[C]//Advances in Neural Information Processing Systems.2014:487-495.
[11] BHATTACHARYA S,SUKTHANKAR R,SHAH M.Aframework for photo-quality assessment and enhancement based on visual aesthetics[C]//Proceedings of the 18th ACM International Conference on Multimedia.2010:271-280.
[12] DATTA R,JOSHI D,LI J,et al.Studying aesthetics in photographic images using a computational approach[C]//European Conference on Computer Vision.2006:288-301.
[13] DHAR S,ORDONEZ V,BERG T L.High level describable attributes for predicting aesthetics and interestingness[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2011:1657-1664.
[14] KE Y,TANG X,JING F.The design of high-level features for photo quality assessment[C]//Proceedings of the IEEE Confe-rence on Computer Vision and Pattern Recognition.IEEE,2006:419-426.
[15] LUO W,WANG X,TANG X.Content-based photo quality assessment[C]//International Conference on Computer Vision.IEEE,2011:6-13.
[16] MARCHESOTTI L,PERRONNIN F,LARLUS D,et al.Asses-sing the aesthetic quality of photographs using generic image descriptors [C]//International Conference on Computer Vision.IEEE,2011:1784-1791.
[17] SU H H,CHEN T W,KAO C C,et al.Scenic photo quality assessment with bag of aesthetics-preserving features[C]//Proceedings of the 19th ACM international conference on Multimedia.2011:1213-1216.
[18] KARAYEV S,TRENTACOSTE M,HAN H,et al.Recognizing image style[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2014.
[19] LU X,LIN Z,JIN H,et al.Rapid:Rating pictorial aesthetics using deep learning[C]//Proceedings of the 22nd ACM international conference on Multimedia.2014:457-466.
[20] LU X,LIN Z,SHEN X,et al.Deep multi-patch aggregation network for image style,aesthetics,and quality estimation[C]//International Conference on Computer Vision.IEEE,2015.
[21] TANG H,JOSHI N,KAPOOR A.Blind image quality assessment using semi-supervised rectifier networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2014:2877-2884.
[22] TIAN X,DONG Z,YANG K,et al.Query-dependent aesthetic model with deep learning for photo quality assessment [J].IEEE Transactions on Multimedia,2015,17(11):2035-2048.
[23] DONG Z,SHEN X,LI H,et al.Photo quality assessment with DCNN that understands image well[C]//International Confe-rence on Multimedia Modeling.2015:524-535.
[24] LEE H J,HONG K S,KANG H,et al.Photo aesthetics analysis via DCNN feature encoding [J].IEEE Transactions on Multimedia,2017,19(8):1921-1932.
[25] KONG S,SHEN X,LIN Z,et al.Photo aesthetics ranking network with attributes and content adaptation[C]//European Conference on Computer Vision.2016:662-679.
[26] CELLI F,BRUNI E,LEPRI B.Automatic personality and interaction style recognition from Facebook profile pictures[C]//Proceedings of the 22nd ACM International Conference on Multimedia.2014:1101-1104.
[27] LIU L,PREOTIUC-PIETRO D,SAMANI Z R,et al.Analyzing personality through social media profile picture choice[C]//International Conference on Weblogs and Social Media.AAAI,2016.
[28] BHATTI S K,MUNEER A,LALI M I,et al.Personality anal-ysis of the USA public using Twitter profile pictures[C]//International Conference on Information and Communication Technologies.IEEE,2017.
[29] FERWERDA B,SCHEDL M,TKALCIC M.Predicting personality traits with Instagram pictures[C]//Proceedings of the 3rd Workshop on Emotions and Personality in Personalized Systems.2015:7-10.
[30] FERWERDA B,TKALCIC M.Predicting users' personalityfrom Instagram pictures:using visual and/or content features? [C]//Proceedings of the 26th Conference on User Modeling,Adaptation and Personalization.2018:157-161.
[31] SEGALIN C,PERINA A,CRISTANI M,et al.The pictures we like are our image:continuous mapping of favorite pictures into self-assessed and attributed personality traits [J].IEEE Tran-sactions on Affective Computing,2017,8(2):268-285.
[32] SIVAJI A,TZUAAN S S,YANG L T,et al.Hotel photo gallery and Malaysian travelers:Preliminary findings[C]//International Conference on User Science & Engineering.IEEE,2014.
[33] WANG M,LI X,CHAU P Y K.Leveraging image-processingtechniques for empirical research:Feasibility and reliability in online shopping context [J].Information Systems Frontiers,2020:1-20.
[34] STEPCHENKOVA S,ZHAN F.Visual destination images ofPeru:Comparative content analysis of DMO and user-generated photography [J].Tourism Management,2013,36:590-601.
[35] SONG S G,KIM D Y.A pictorial analysis of destination images on Pinterest:The case of Tokyo,Kyoto,and Osaka,Japan [J].Journal of Travel & Tourism Marketing,2016,33(5):687-701.
[36] HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2016:770-778.
[37] ZHANG K,CHEN Y,LI C.Discovering the tourists' behaviors and perceptions in a tourism destination by analyzing photos' visual content with a computer deep learning model:The case of Beijing [J].Tourism Management,2019,75:595-608.
[38] REN M,VU H Q,LI G,et al.Large-scale comparative analyses of hotel photo content posted by managers and customers to review platforms based on deep learning:Implications for hospitali-ty marketers [J].Journal of Hospitality Marketing & Management,2021,30(1):96-119.
[39] FAN H,CAO Z,JIANG Y,et al.Learning deep face representation [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2014.
[40] ZHANG L,YAN Q,ZHANG L.A computational frameworkfor understanding antecedents of guests' perceived trust towards hosts on Airbnb [J].Decision Support Systems,2018,115:105-116.
[41] GARROD B.Exploring place perception:A photo-based analysis [J].Annals of Tourism Research,2008,35(2):381-401.
[42] CHUNG N,KOO C.The use of social media in travel information search [J].Telematics & Informatics,2015,32(2):215-229.
[43] KIM S B,KIM D Y,WISE K.The effect of searching and surfing on recognition of destination images on Facebook pages [J].Computers in Human Behavior,2014,30:813-823.
[44] HUNTER W C.The social construction of tourism online destination image:A comparative semiotic analysis of the visual representation of Seoul [J].Tourism Management,2016,54(2):221-229.
[45] PAN S,LEE J,TSAI H.Travel photos:Motivations,image dimensions,and affective qualities of places [J].Tourism Management,2014,40(1):59-69.
[46] WACKER A,GROTH A.Projected and perceived destinationimage of Tyrol on Instagram [M]//Information and Communication Technologies in Tourism.Berlin:Springer,2020:103-114.
[47] ZHANG K,CHEN Y,LIN Z.Mapping destination images and behavioral patterns from user-generated photos:A computer vision approach [J].Asia Pacific Journal of Tourism Research,2020,25(11):1199-1214.
[48] DENG N,LIU Y F,NIU Y,et al.Different perceptions of Beijing's destination images from tourists:An analysis of Flickr photos based on deep learning method [J].Resources Science,2019,41(3):416-429.
[49] CHEN T,BORTH D,DARRELL T,et al.DeepSentiBank:Visual sentiment concept classification with deep convolutional neural networks [EB/OL].(2014-10-30)[2018-09-30].https://arxiv.org/pdf/1410.8586v1.pdf.
[50] NEIDHARDT J,SEYFANG L,SCHUSTER R,et al.A picture-based approach to recommender systems [J].Information Technology & Tourism,2015,15(1):49-69.
[51] FIGUEREDO M,RIBEIRO J,CACHO N,et al.From photos to travel itinerary:A tourism recommender system for smart tourism destination[C]//2018 IEEE Fourth International Conference on Big Data Computing Service and Applications (BigData Service).IEEE,2018.
[52] SERTKAN M,NEIDHARDT J,WERTHNER H.From pic-
tures to travel characteristics:Deep learning-based profiling of tourists and tourism destinations [M]//Information and Communication Technologies in Tourism.Berlin:Springer,2020:142-153.
[53] CYR D,HEAD M,LARIOS H,et al.Exploring human images in website design:A multi-method approach [J].MIS Quarterly,2009,33(3):539-566.
[54] ZHU X,RAMANAN D.Face detection,pose estimation,andlandmark localization in the wild[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2012:2879-2886.
[55] XIA H,PAN X,ZHOU Y,et al.Creating the best first impression:Designing online product photos to increase sales [J].Decision Support Systems,2020,131:113235-113249.
[56] LUCA M.Designing online marketplaces:Trust and reputation mechanisms [J].Innovation Policy and the Economy,2017,17:77-93.
[57] FORMAN C,GHOSE A,WIESENFELD B.Examining the relationship between reviews and sales:The role of reviewer identity disclosure in electronic markets [J].Information Systems Research,2008,19(3):291-313.
[58] SWAMI V,FURNHAM A.The psychology of physical attraction [M].London:Routledge/Taylor & Francis Group,2008.
[59] KNUTSON B.Facial Expressions of Emotion Influence Interpersonal Trait Inferences [J].Journal of Nonverbal Behavior,1996,20(3):165-182.
[60] ERT E,FLEISCHER A,MAGEN N.Trust and reputation in the sharing economy:The role of personal photos in Airbnb [J].Tourism Management,2016,55:62-73.
[61] FAGERSTRØM A,PAWAR S,SIGURDSSON V,et al.Thatpersonal profile image might jeopardize your rental opportunity! On the relative impact of the seller's facial expressions upon buying behavior on Airbnb [J].Computers in Human Behavior,2017,72:123-131.
[62] JAEGER B,SLEEGERS W W A,EVANS A M,et al.Theeffects of facial attractiveness and trustworthiness in online peer-to-peer markets [J].Journal of Economic Psychology,2018,75(A):102125-102135.
[63] DENG C,RAVICHANDRAN T.To smile or not? The effect of facial expression on service demand in sharing economy platforms[C]//Americas Conference on Information Systems.2020.

相关文章 15

[1]	饶志双, 贾真, 张凡, 李天瑞. 基于Key-Value关联记忆网络的知识图谱问答方法 Key-Value Relational Memory Networks for Question Answering over Knowledge Graph 计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2]	汤凌韬, 王迪, 张鲁飞, 刘盛云. 基于安全多方计算和差分隐私的联邦学习方案 Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy 计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3]	徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺. 时序知识图谱表示学习 Temporal Knowledge Graph Representation Learning 计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4]	王剑, 彭雨琦, 赵宇斐, 杨健. 基于深度学习的社交网络舆情信息抽取方法综述 Survey of Social Network Public Opinion Information Extraction Based on Deep Learning 计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5]	郝志荣, 陈龙, 黄嘉成. 面向文本分类的类别区分式通用对抗攻击方法 Class Discriminative Universal Adversarial Attack for Text Classification 计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6]	姜梦函, 李邵梅, 郑洪浩, 张建朋. 基于改进位置编码的谣言检测模型 Rumor Detection Model Based on Improved Position Embedding 计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7]	孙奇, 吉根林, 张杰. 基于非局部注意力生成对抗网络的视频异常事件检测方法 Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection 计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8]	胡艳羽, 赵龙, 董祥军. 一种用于癌症分类的两阶段深度特征选择提取算法 Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification 计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9]	程成, 降爱莲. 基于多路径特征提取的实时语义分割方法 Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction 计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10]	侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木. 中文预训练模型研究进展 Advances in Chinese Pre-training Models 计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11]	周慧, 施皓晨, 屠要峰, 黄圣君. 基于主动采样的深度鲁棒神经网络学习 Robust Deep Neural Network Learning Based on Active Sampling 计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12]	苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫. 小样本雷达辐射源识别的深度学习方法综述 Survey of Deep Learning for Radar Emitter Identification Based on Small Sample 计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13]	刘伟业, 鲁慧民, 李玉鹏, 马宁. 指静脉识别技术研究综述 Survey on Finger Vein Recognition Research 计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[14]	孙福权, 崔志清, 邹彭, 张琨. 基于多尺度特征的脑肿瘤分割算法 Brain Tumor Segmentation Algorithm Based on Multi-scale Features 计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[15]	康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩. 基于Transformer和LSTM的药物相互作用预测 Drug-Drug Interaction Prediction Based on Transformer and LSTM 计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed