计算机科学 ›› 2019, Vol. 46 ›› Issue (11A): 580-583.

• 综合、交叉与应用 • 上一篇    下一篇

静态图像行为标注众包系统的设计与实现

侯禹臣, 吴伟   

  1. (内蒙古大学计算机学院 呼和浩特010021)
  • 出版日期:2019-11-10 发布日期:2019-11-20
  • 通讯作者: 吴伟(1980-),男,博士,副教授,主要研究方向为智能信息处理,E-mail:cswuwei@imu.edu.cn。
  • 作者简介:侯禹臣(1993-),男,硕士生,主要研究方向为智能信息处理。
  • 基金资助:
    本文受国家自然科学基金项目(61763035)资助。

Design and Implementation of Crowdsourcing System for Still Image Activity Annotation

HOU Yu-chen, WU Wei   

  1. (Department of Computer Science,Inner Mongolia University,Huhhot 010021,China)
  • Online:2019-11-10 Published:2019-11-20

摘要: 针对静态图像行为识别研究缺乏标注数据的问题,在Android平台下,利用“众包”思想,设计并开发了基于静态图像的视觉行为人工标注系统。该系统主要包括分配标注任务、用户标注图像信息、评审标注信息和查看历史标注信息等功能。对于评审分数较高的标注信息,利用网络爬虫技术提取该图像的辅助文本标签,并且将标注信息转化为词向量后进行存储,以便于后期的实验研究。同时,系统应用一种基于定价机制的任务分配算法,有效地提高了用户图像标注效率。实际部署系统应用情况表明,该系统操作简洁、流畅,各算法功能模块稳定、高效,并且充分地利用移动端便捷的优势,能够顺利进行图像行为标注数据的收集和整理工作。

关键词: Android, 词向量, 图像行为标注, 网络爬虫, 众包

Abstract: According to the problem of lack of the annotation data in still image activity recognition research,under the Android platform,a visual activity manual annotation system based on still images was designed and developed with the idea of “crowd-sourcing”.The system mainly includes the functions of assigning annotation tasks,annotating image information,reviewing annotation information and examining historical annotation information.For the annotation information with high evaluation scores,the web crawler technology is used to extract the auxiliary text labels of the image,and the annotation information is converted into word embedding storage for the convenience of later experimental research.Meanwhile,the system applies a task assignment algorithm based on pricing mechanism,which effectively improves the efficiency of user image annotation.The application of the actual deployment system shows that the operation is simple and smooth,the function modules of each algorithm are stable and efficient,and the advantages of mobile terminals are fully utilized to collect and organize the data of image activity annotation.

Key words: Android, Crowdsourcing, Image activity annotation, Web crawler, Word embedding

中图分类号: 

  • TP311.52
[1]HUISKES M J,THOMEE B,LEW M S.New trends and ideas in visual concept detection[C]∥Proc of the 11th ACM Confe-rence on Multimedia Information Retrieval.Philadelphia,PA,USA:ACM,2010:527-536.
[2]单言虎,张彰,黄凯奇.人的视觉行为识别研究回顾、现状及展望[J].计算机研究与发展,2016,53(1):93-112.
[3]GUO G,LAI A.A survey on still image based human action re-cognition[J].Pattern Recognition,2014,47(10):3343-3361.
[4]SONG X,ZHOU H,LIU G.Human behavior recognition based on multi-feature fusion of image[J/OL].http://doi.org/10.1007/s10586-018-2073-7.
[5]MUHAMMED M A E,AHMED A A,KHALID T A.Benchmark analysis of popular ImageNet classification deep CNNarchitectures[C]∥Smart Technologies For Smart Nation (SmartTecCon).IEEE,2017:902-907.
[6]HUANG G,HU H.c-RNN:A Fine-Grained Language Model for Image Captioning[J].Neural Processing Letters,2019,49(2):683-691.
[7]LIU Z,LI X,LUO P,et al.Deep learning markov random field for semanticsegmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2018,40(8):1814-1828.
[8]QIN X,HE S,ZHANG Z,et al.ByLabel:A Boundary Based Semi-Automatic Image Annotation Tool[C]∥2018 IEEE Winter Conference on Applications of Computer Vision (WACV).IEEE,2018:1804-1813.
[9]BERNAL J,HISTACE A,MASANA M,et al.GTCreator:aflexible annotation tool for image-based datasets[J].International Journal of Computer Assisted Radiology and Surgery,2018:1-11.
[10]MA Y,LIU X,LIU Y,et al.A Tale of Two Fashions:An Empirical Study on the Performance of Native Apps and Web Apps on Android[J].IEEE Transactions on Mobile Computing,2018,17(5):990-1003.
[11]ZHANG P,WEI Z,LI Y,et al.Automatic Image Annotation Based on Multi-Auxiliary Information[J].IEEE Access,2017,5(99):18402-18411.
[12]江志刚.基于SSM框架的网上题目录入答题系统设计[J].无线互联科技,2017(20):62-63.
[13]任玉刚.Android开发艺术探索[M].北京:电子工业出版社,2015:414-441.
[14]SINGER Y,MITTAL M.Pricing Mechanisms for Crowdsourcing Markets[C]∥International Conference on World Wide Web.2014:1157-1166.
[15]SINGER Y.How to win friends and influence people,truthfully:influence maximization mechanisms for social networks[C]∥WSDM.2012:733-742.
[16]DOBZINSKI S,PAPADIMITRIOU C,SINGER Y.Mechanisms for complement-free procurement[C]∥EC.2011:273-282.
[17]余豪士,匡芳君.基于Python的反反爬虫技术分析与应用[J].智能计算机与应用,2018,8(4):112-115.
[18]周练.Word2vec的工作原理及应用探究[J].科技情报开发与经济,2015,25(2):145-148.
[19]FAUZI M A.Word2Vec Model for Sentiment Analysis of Pro-duct Reviews In Indonesian Language[J].International Journal of Electrical & Computer Engineering,2018,7(1):244-252.
[1] 傅彦铭, 朱杰夫, 蒋侃, 黄保华, 孟庆文, 周兴.
移动众包中基于多约束工人择优的激励机制研究
Incentive Mechanism Based on Multi-constrained Worker Selection in Mobile Crowdsourcing
计算机科学, 2022, 49(9): 275-282. https://doi.org/10.11896/jsjkx.210700129
[2] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[3] 姜胜腾, 张亦弛, 罗鹏, 刘月玲, 曹阔, 赵海涛, 魏急波.
语义通信系统的性能度量指标分析
Analysis of Performance Metrics of Semantic Communication Systems
计算机科学, 2022, 49(7): 236-241. https://doi.org/10.11896/jsjkx.211200071
[4] 姚烨, 朱怡安, 钱亮, 贾耀, 张黎翔, 刘瑞亮.
一种基于异质模型融合的 Android 终端恶意软件检测方法
Android Malware Detection Method Based on Heterogeneous Model Fusion
计算机科学, 2022, 49(6A): 508-515. https://doi.org/10.11896/jsjkx.210700103
[5] 王毅, 李政浩, 陈星.
基于用户场景的Android 应用服务推荐方法
Recommendation of Android Application Services via User Scenarios
计算机科学, 2022, 49(6A): 267-271. https://doi.org/10.11896/jsjkx.210700123
[6] 阳真, 黄松, 郑长友.
基于区块链与改进CP-ABE的众测知识产权保护技术研究
Study on Crowdsourced Testing Intellectual Property Protection Technology Based on Blockchain and Improved CP-ABE
计算机科学, 2022, 49(5): 325-332. https://doi.org/10.11896/jsjkx.210900075
[7] 韩红旗, 冉亚鑫, 张运良, 桂婕, 高雄, 易梦琳.
基于共同子空间分类学习的跨媒体检索研究
Study on Cross-media Information Retrieval Based on Common Subspace Classification Learning
计算机科学, 2022, 49(5): 33-42. https://doi.org/10.11896/jsjkx.210200157
[8] 严磊, 张功萱, 王添, 寇小勇, 王国洪.
混合云下具有交付期约束的众包任务调度算法
Scheduling Algorithm for Bag-of-Tasks with Due Date Constraints on Hybrid Clouds
计算机科学, 2022, 49(5): 244-249. https://doi.org/10.11896/jsjkx.210300120
[9] 刘硕, 王庚润, 彭建华, 李柯.
基于混合字词特征的中文短文本分类算法
Chinese Short Text Classification Algorithm Based on Hybrid Features of Characters and Words
计算机科学, 2022, 49(4): 282-287. https://doi.org/10.11896/jsjkx.210200027
[10] 陈丹红, 彭张林, 万德全, 杨善林.
众包平台用户价值识别与细分:基于改进的RFM模型
Identification and Segmentation of User Value in Crowdsourcing Platforms:An Improved RFMModel
计算机科学, 2022, 49(4): 37-42. https://doi.org/10.11896/jsjkx.210800255
[11] 沈彪, 沈立炜, 李弋.
空间众包任务的路径动态调度方法
Dynamic Task Scheduling Method for Space Crowdsourcing
计算机科学, 2022, 49(2): 231-240. https://doi.org/10.11896/jsjkx.210400249
[12] 刘凯, 张宏军, 陈飞琼.
基于领域适应嵌入的军事命名实体识别
Name Entity Recognition for Military Based on Domain Adaptive Embedding
计算机科学, 2022, 49(1): 292-297. https://doi.org/10.11896/jsjkx.201100007
[13] 韩丽霞, 张占营.
基于树增益朴素贝叶斯网络的服务定价策略
TAN-based Service Pricing Strategy
计算机科学, 2021, 48(6A): 203-. https://doi.org/10.11896/jsjkx.200900024
[14] 杨进才, 曹元, 胡泉, 沈显君.
基于Transformer模型与关系词特征的汉语因果类复句关系自动识别
Relation Classification of Chinese Causal Compound Sentences Based on Transformer Model and Relational Word Feature
计算机科学, 2021, 48(6A): 295-298. https://doi.org/10.11896/jsjkx.200500019
[15] 张少杰, 鹿旭东, 郭伟, 王世鹏, 何伟.
供需匹配中的非诚信行为预防
Prevention of Dishonest Behavior in Supply-Demand Matching
计算机科学, 2021, 48(4): 303-308. https://doi.org/10.11896/jsjkx.200900090
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!