参差质量工人环境中的众包任务全局分配模型

doi:10.11896/jsjkx.230200079

摘要/Abstract

摘要： 已有的众包研究大多优先使用优秀工人来完成任务,即众包平台会为任务分配技能水平度和信誉度最高的工人。然而现实平台中大部分工人的技能水平度与信誉度相对较低,导致众包平台中同时存在大量无法分配的任务和无任务可做的工人。问题的主要原因如下:(1)复杂任务对工人技能水平度要求高,专业工人数量较少,而占大多数的技能水平度较低的工人无法完成复杂任务,使得大量任务分配失败;(2)任务会被优先分配给技能水平度高和信誉度高的工人,而技能水平度、信誉度相对较低的工人因为没有达到任务要求往往无任务可做。在实际众包平台中,我们发现很多复杂任务都有充足的预算,并且平台中的工人们可以通过合作来提升技能水平度。基于这些实际观察,设计了一个工人合作模型:当平台中缺少符合任务要求的工人时,该模型会让技能水平度不足的工人加入团队,通过团队内工人合作达到任务要求的技能水平度,从而使任务分配成功。最后在真实数据集上开展了实验,实验结果表明,所提模型能够提高任务分配成功率,并同时降低任务发布者的预算成本、提高工人的整体收入水平。

关键词: 众包, 复杂任务, 任务分配, 工人协作, 技能水平度

Abstract: Most existing crowdsourcing researches previously use top workers to complete tasks,i.e.,crowdsourcing platforms always assign workers with the highest skill levels and reputation to tasks.However,in reality,most of the workers have relatively low skill levels and reputation,resulting in a large number of unassignable tasks and workers without tasks to do in crowdsourcing platforms.The main reasons for the problem are as follows:(1)complex tasks have high skill level requirements and the number of professional workers is small,so workers with insufficient skill levels are unable to complete complex tasks,which causes a large number of tasks fail to be assigned;(2)tasks are priority assigned to workers with high skill levels and high reputation,while workers with relatively low skill levels and reputation are not available to be assigned because they cannot meet the task requirements.In the real crowdsourcing platform,we find that many complex tasks have sufficient budgets and workers can improve their skill levels through collaboration.On the basis of these practical observations,we design a worker collaboration model in this paper.When the platform lacks of workers who meet the task requirements,the model allows workers with inadequate skill levels to participate in the team and collaborate to achieve the task skill level requirements before being assigned the task.Finally,the experiments are carried out on a real dataset and the results show that the proposed model can improve the success rate of task assignment and also reduce the budget cost of requesters,increase the income of workers.

Key words: Crowdsourcing, Complex tasks, Task allocation, Cooperation of workers, Skill levels

中图分类号:

TP391

蒋玖川, 魏金鹏, 张金伟. 参差质量工人环境中的众包任务全局分配模型[J]. 计算机科学, 2023, 50(11A): 230200079-9. https://doi.org/10.11896/jsjkx.230200079

JIANG Jiuchuan, WEI Jinpeng, ZHANG Jinwei. Global Task Assignment Model for Crowdsourcing with Mixed-quality Worker Context[J]. Computer Science, 2023, 50(11A): 230200079-9. https://doi.org/10.11896/jsjkx.230200079

参考文献

[1]HOWE J.The Rise of Crowdsourcing [J].Wired Magazine,2006,14(6):1-4.
[2]FENG J H,LI G L,FENG J H.A Survey On Crowdsourcing [J].Chinese Journal of Computers,2015,38(9):1713-1726.
[3]GUMMIDI S,XIE X,PEDERSEN T B.A Survey of SpatialCrowdsourcing [J].ACM Transactions on Database Systems,2019,44(2):1-46.
[4]GOEL G,NIKZAD A,SINGLA A.Allocating tasks to workers with matching constraints:truthful mechanisms for crowdsour-cing markets[C]//Proceedings of the 23rd International Confe-rence on World Wide Web.2014:279-280.
[5]KARGER D R,OH S,SHAH D.Efficient crowdsourcing formulti-class labeling[C]//Proceedings of the ACMSIGMETRICS/International Conference on Measurement and Modeling of Computer Systems.2013:81-92.
[6]JING W,IPEIROTIS P G,PROVOST F.Managing Crow-dsourcing Workers [J].Journal of Chongqing University,2011,32(6):10-12.
[7]TRAN-THANH L,HUYNH T D,ROSENFELD A,et al.Budgetfix:budget limited crowdso-urcing for interdependent task allocation with quality guarantees[C]//13th International Conference on Autonomous Agents and Multi-Agent Systems.2014,477-484.
[8]WANG W,JIANG J,BO A,et al.Toward Efficient Team Formation for Crowdsourcing in Noncooperative Social Networks [J].IEEE Transactions on Cybernetics,2016,47(12):4208-4222.
[9]LIU Q,LUO T,TANG R,et al.An efficient and truthful pricing mechanism for team formation in crowdsourcing markets[C]//2015 IEEE International Conference on Communications(ICC).2015,567-572.
[10]STAFFELBACH M,SEMPOLINSKI P,KIJEWSKI-CORREA T,et al.Lessons learned from crowdsourcing complex engineering tasks [J].Plos One,2015,10(9):e0134978.
[11]NUNO L,NUNO S,PAULO N.A survey of task-oriented crowdsourcing [J].Artificial Intelligence Review,2015,44(2):187-213.
[12]JIANG J,AN B,JIANG Y,et al.Context-aware reliable crowdsourcing in social networks [J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2017,50(2):617-632.
[13]ZHENG W J,ZHANG J Y,LI J,et al.Study on Design and Application of Medical Semantic Crowdsourcing Annotation Platform [J].Journal of Medical Informatics,2020,41(7):49-52.
[14]JIANG J,AN B,JIANG Y,et al.Understanding Crowdsourcing Systems from a Multiagent Perspective and Approach [J].ACM Transactions on Autonomous and Adaptive Systems,2018,13(2):1-32.
[15]EAGLE N.txteagle:Mobile crowdsourcing[C]//InternationalConference on Internationalization,Design and Global Development.Berlin,Heidelberg:Springer,2009:447-456.
[16]HO C J,VAUGHAN J W.Online Task Assignment in Cr-owdsourcing Markets[C]//Proceedings of the AAAI Confe-rence on Artificial Intelligence.2012:45-51.
[17]HOU Y C,WU W.Design and Implementation of Crowdsourcing System for Still Image Activity Annotation [J].Computer Science,2019,46(S2):580-583.
[18]KARGER D R,OH S,SHAH D.Budget-Optimal Task Allocation for Reliable Crowdsourcing Systems [J].Operations Research,2014,62(1):1-24.
[19]DAI P,LIN C H,WELDD S.POMDP-based control of workflows for crowdsourcing [J].Artificial Intelligence,2013,202:52-85.
[20]KITTUR A,SMUS B,KHAMKAR S,et al.Crowdforge:Crowdsourcing complex work[C]//Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology.2011:43-52.
[21]FAN Z J,SHEN L W,PENG X,et al.Multi Stage Task Allocation on Constrained Spatial Crowdsourcing [J].Chinese Journal of Computers,2019,42(12):2722-2741.
[22]FU Y M,ZHU J F,JIANG K,et al.Incentive Mechanism Based on Multi-constrained Worker Selection in Mobile Crowdsourcing [J].Computer Science,2022,49(9):275-282.
[23]ROKICKI M,ZERR S,SIERSDORFER S.Groupsourcing:Team competition designs for crowdsourcing[C]//Proceedings of the 24th International Conference on World Wide Web.2015:906-915.
[24]KARGAR M,AN A,ZIHAYAT M.Efficient biobjective team formation in social networks[C]//Joint European Conference on Machine Learning and Knowledge Discovery in Databases.2012:483-498.
[25]ZHENG Z,QIN Z,LI K,et al.A team-based multitask data acquisition scheme under time constraints in mobile crowd sensing[J].Connection Science,2022,34(1):1119-1145.
[26]HARRISON S,JOHNSON P.Challenges in the adoption of cri-sis crowdsourcing and social media in Canadian emergency ma-nagement [J].Government Information Quarterly,2019,36(3):501-509.
[27]LI B Y,CHENG Y R,WANG G Y,et al.3D-online Stable Matching Problem for New Spatial Crowdsourcing Platforms [J].Journal of Software,2020,31(12):3836-3851.
[28]JIAO Y,LIN Z,YU L,et al.A Fine-Grain Batching-Based Task Allocation Algorithm for Spatial Crowdsourcing[J].ISPRS International Journal of Geo-Information,2022,11(3):203.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed