Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 230200079-9.doi: 10.11896/jsjkx.230200079

• Artificial Intelligence • Previous Articles     Next Articles

Global Task Assignment Model for Crowdsourcing with Mixed-quality Worker Context

JIANG Jiuchuan, WEI Jinpeng, ZHANG Jinwei   

  1. School of Information Engineering,Nanjing University of Finance and Economics,Nanjing 210023,China
  • Published:2023-11-09
  • About author:JIANG Jiuchuan,born in 1981,Ph.D,associate professor,master supervisor,is a senior member of China Computer Federation.His main research interests include artificial intelligence,data mi-ning,and social networks.
  • Supported by:
    National Social Science Foundation of China(22BGL261).

Abstract: Most existing crowdsourcing researches previously use top workers to complete tasks,i.e.,crowdsourcing platforms always assign workers with the highest skill levels and reputation to tasks.However,in reality,most of the workers have relatively low skill levels and reputation,resulting in a large number of unassignable tasks and workers without tasks to do in crowdsourcing platforms.The main reasons for the problem are as follows:(1)complex tasks have high skill level requirements and the number of professional workers is small,so workers with insufficient skill levels are unable to complete complex tasks,which causes a large number of tasks fail to be assigned;(2)tasks are priority assigned to workers with high skill levels and high reputation,while workers with relatively low skill levels and reputation are not available to be assigned because they cannot meet the task requirements.In the real crowdsourcing platform,we find that many complex tasks have sufficient budgets and workers can improve their skill levels through collaboration.On the basis of these practical observations,we design a worker collaboration model in this paper.When the platform lacks of workers who meet the task requirements,the model allows workers with inadequate skill levels to participate in the team and collaborate to achieve the task skill level requirements before being assigned the task.Finally,the experiments are carried out on a real dataset and the results show that the proposed model can improve the success rate of task assignment and also reduce the budget cost of requesters,increase the income of workers.

Key words: Crowdsourcing, Complex tasks, Task allocation, Cooperation of workers, Skill levels

CLC Number: 

  • TP391
[1]HOWE J.The Rise of Crowdsourcing [J].Wired Magazine,2006,14(6):1-4.
[2]FENG J H,LI G L,FENG J H.A Survey On Crowdsourcing [J].Chinese Journal of Computers,2015,38(9):1713-1726.
[3]GUMMIDI S,XIE X,PEDERSEN T B.A Survey of SpatialCrowdsourcing [J].ACM Transactions on Database Systems,2019,44(2):1-46.
[4]GOEL G,NIKZAD A,SINGLA A.Allocating tasks to workers with matching constraints:truthful mechanisms for crowdsour-cing markets[C]//Proceedings of the 23rd International Confe-rence on World Wide Web.2014:279-280.
[5]KARGER D R,OH S,SHAH D.Efficient crowdsourcing formulti-class labeling[C]//Proceedings of the ACMSIGMETRICS/International Conference on Measurement and Modeling of Computer Systems.2013:81-92.
[6]JING W,IPEIROTIS P G,PROVOST F.Managing Crow-dsourcing Workers [J].Journal of Chongqing University,2011,32(6):10-12.
[7]TRAN-THANH L,HUYNH T D,ROSENFELD A,et al.Budgetfix:budget limited crowdso-urcing for interdependent task allocation with quality guarantees[C]//13th International Conference on Autonomous Agents and Multi-Agent Systems.2014,477-484.
[8]WANG W,JIANG J,BO A,et al.Toward Efficient Team Formation for Crowdsourcing in Noncooperative Social Networks [J].IEEE Transactions on Cybernetics,2016,47(12):4208-4222.
[9]LIU Q,LUO T,TANG R,et al.An efficient and truthful pricing mechanism for team formation in crowdsourcing markets[C]//2015 IEEE International Conference on Communications(ICC).2015,567-572.
[10]STAFFELBACH M,SEMPOLINSKI P,KIJEWSKI-CORREA T,et al.Lessons learned from crowdsourcing complex engineering tasks [J].Plos One,2015,10(9):e0134978.
[11]NUNO L,NUNO S,PAULO N.A survey of task-oriented crowdsourcing [J].Artificial Intelligence Review,2015,44(2):187-213.
[12]JIANG J,AN B,JIANG Y,et al.Context-aware reliable crowdsourcing in social networks [J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,50(2):617-632.
[13]ZHENG W J,ZHANG J Y,LI J,et al.Study on Design and Application of Medical Semantic Crowdsourcing Annotation Platform [J].Journal of Medical Informatics,2020,41(7):49-52.
[14]JIANG J,AN B,JIANG Y,et al.Understanding Crowdsourcing Systems from a Multiagent Perspective and Approach [J].ACM Transactions on Autonomous and Adaptive Systems,2018,13(2):1-32.
[15]EAGLE N.txteagle:Mobile crowdsourcing[C]//InternationalConference on Internationalization,Design and Global Development.Berlin,Heidelberg:Springer,2009:447-456.
[16]HO C J,VAUGHAN J W.Online Task Assignment in Cr-owdsourcing Markets[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2012:45-51.
[17]HOU Y C,WU W.Design and Implementation of Crowdsourcing System for Still Image Activity Annotation [J].Computer Science,2019,46(S2):580-583.
[18]KARGER D R,OH S,SHAH D.Budget-Optimal Task Allocation for Reliable Crowdsourcing Systems [J].Operations Research,2014,62(1):1-24.
[19]DAI P,LIN C H,WELDD S.POMDP-based control of workflows for crowdsourcing [J].Artificial Intelligence,2013,202:52-85.
[20]KITTUR A,SMUS B,KHAMKAR S,et al.Crowdforge:Crowdsourcing complex work[C]//Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology.2011:43-52.
[21]FAN Z J,SHEN L W,PENG X,et al.Multi Stage Task Allocation on Constrained Spatial Crowdsourcing [J].Chinese Journal of Computers,2019,42(12):2722-2741.
[22]FU Y M,ZHU J F,JIANG K,et al.Incentive Mechanism Based on Multi-constrained Worker Selection in Mobile Crowdsourcing [J].Computer Science,2022,49(9):275-282.
[23]ROKICKI M,ZERR S,SIERSDORFER S.Groupsourcing:Team competition designs for crowdsourcing[C]//Proceedings of the 24th International Conference on World Wide Web.2015:906-915.
[24]KARGAR M,AN A,ZIHAYAT M.Efficient biobjective team formation in social networks[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases.2012:483-498.
[25]ZHENG Z,QIN Z,LI K,et al.A team-based multitask data acquisition scheme under time constraints in mobile crowd sensing[J].Connection Science,2022,34(1):1119-1145.
[26]HARRISON S,JOHNSON P.Challenges in the adoption of cri-sis crowdsourcing and social media in Canadian emergency ma-nagement [J].Government Information Quarterly,2019,36(3):501-509.
[27]LI B Y,CHENG Y R,WANG G Y,et al.3D-online Stable Matching Problem for New Spatial Crowdsourcing Platforms [J].Journal of Software,2020,31(12):3836-3851.
[28]JIAO Y,LIN Z,YU L,et al.A Fine-Grain Batching-Based Task Allocation Algorithm for Spatial Crowdsourcing[J].ISPRS International Journal of Geo-Information,2022,11(3):203.
[1] LIU Qingju, PAN Qingxian, TONG Xiangrong, YU Song, PAN Yanan. Bidirectional Quality Control Strategies Based on CIDA and PI-cosine in Crowdsourcing [J]. Computer Science, 2023, 50(10): 282-290.
[2] FU Yan-ming, ZHU Jie-fu, JIANG Kan, HUANG Bao-hua, MENG Qing-wen, ZHOU Xing. Incentive Mechanism Based on Multi-constrained Worker Selection in Mobile Crowdsourcing [J]. Computer Science, 2022, 49(9): 275-282.
[3] CHEN Dan-hong, PENG Zhang-lin, WAN De-quan, YANG Shan-lin. Identification and Segmentation of User Value in Crowdsourcing Platforms:An Improved RFMModel [J]. Computer Science, 2022, 49(4): 37-42.
[4] TAN Zhen-qiong, JIANG Wen-Jun, YUM Yen-na-cherry, ZHANG Ji, YUM Peter-tak-shing, LI Xiao-hong. Personalized Learning Task Assignment Based on Bipartite Graph [J]. Computer Science, 2022, 49(4): 269-281.
[5] SHEN Biao, SHEN Li-wei, LI Yi. Dynamic Task Scheduling Method for Space Crowdsourcing [J]. Computer Science, 2022, 49(2): 231-240.
[6] SHEN Zhen, ZHAO Cheng-gui. Storage Task Allocation Algorithm in Decentralized Cloud Storage Network [J]. Computer Science, 2022, 49(12): 17-21.
[7] JIANG Jing, PING Yuan, WU Qiu-di, ZHANG Li. Developer Recommendation Method for Crowdsourcing Tasks in Open Source Community [J]. Computer Science, 2022, 49(12): 99-108.
[8] ZHANG Shao-jie, LU Xu-dong, GUO Wei, WANG Shi-peng, HE Wei. Prevention of Dishonest Behavior in Supply-Demand Matching [J]. Computer Science, 2021, 48(4): 303-308.
[9] ZHAO Yang, NI Zhi-wei, ZHU Xu-hui, LIU Hao, RAN Jia-min. Multi-worker and Multi-task Path Planning Based on Improved Lion Evolutionary Algorithm forSpatial Crowdsourcing Platform [J]. Computer Science, 2021, 48(11A): 30-38.
[10] LI Yu, DUAN Hong-yue, YIN Yu-yu, GAO Hong-hao. Survey of Crowdsourcing Applications in Blockchain Systems [J]. Computer Science, 2021, 48(11): 12-27.
[11] LI Hu, FANG Bao-fu. Emotional Robot Collaborative Task Assignment Auction Algorithm Based on Positive GroupAffective Tone [J]. Computer Science, 2020, 47(4): 169-177.
[12] YU Dun-hui, CHENG Tao, YUAN Xu. Software Crowdsourcing Task Recommendation Algorithm Based on Learning to Rank [J]. Computer Science, 2020, 47(12): 106-113.
[13] WANG Kuo, WANG Zhong-jie. Crowdsourcing Collaboration Process Recovery Method [J]. Computer Science, 2020, 47(10): 19-25.
[14] ZHANG Guang-yuan, WANG Ning. Truth Inference Based on Confidence Interval of Small Samples in Crowdsourcing [J]. Computer Science, 2020, 47(10): 26-31.
[15] HU Ying, WANG Ying-jie, TONG Xiang-rong. Task Recommendation Model Based on Crowd Worker’s Movement Trajectory [J]. Computer Science, 2020, 47(10): 32-40.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!