Computer Science

Computer Science ›› 2024, Vol. 51 ›› Issue (12): 87-99.doi: 10.11896/jsjkx.240100169

• Computer Software • Previous Articles     Next Articles

Value Assessment System Oriented for Open-source Software Developers and Its Empirical Research

YOU Lan1, TIAN Mingyan1, ZHOU Ye1, CHEN Zhijun1, WANG Wei2, JIN Hong1, ZENG Xing1, CUI Haibo1   

  1. 1 School of Computer Science and Information Engineering, Hubei University, Wuhan 430062, China
    2 School of Data Science and Engineering, East China Normal University(Putuo Campus), Shanghai 200062, China
  • Received:2024-01-23 Revised:2024-06-21 Online:2024-12-15 Published:2024-12-10
  • About author:YOU Lan,born in 1978,Ph.D,professor,is a senior member of CCF(No.H8967M).Her main research interests include spatiotemporal big data,natural language processing,and social computing.
    CHEN Zhijun,born in 1977,professor,master’s supervisor.His main research interests include artificial intelligence and databases.
  • Supported by:
    National Natural Science Foundation of China(61977021),Key Research and Development Program of Hubei Province(2022BAA044) and Scientific Research Project of Education Department of Hubei Province(Q20211010).

PDF (PC)

155

Abstract: Assessing the value of open-source software developers in a scientific and objective manner is an important issue in the open-source field.Existing research methods encounter challenges,including the use of limited evaluation metrics and the complexities associated with determining metric weights.To mitigate these issues,this paper proposes a multi-dimensional and multi-level assessment system for open-source software developers.The system is informed by an analysis of big data from the open-source ecosystem and combines both subjective and objective evaluation methods.By considering developers’ performance in project management,programming,team collaboration,learning,and dedication,the proposed system comprehensively and objectively assesses their values using five primary indicators,twelve secondary indicators,and seven tertiary indicators.The Critic method is employed in this paper to determine the weights of various dimensions,overcoming the issue of low accuracy caused by experiential weights.Finally,multiple empirical studies are conducted using GitHub’s 2020 global open-source ecosystem data to validate the effectiveness and feasibility of the open-source community developer value assessment system.This research provides an objective,scientific,and practical method for measuring the talent,discovery,and management of open-source software developers.The experimental code can be Obtained from theGithub platform1).

Key words: Open-source software, Developer, Value evaluationsystem, Indicator weight, Empirical research analysis

CLC Number: 

  • TP311.5
[1]LI R N,TANG C.Analysis of influencing factors of open source hardware patent value and construction of evaluation index system[J].China Invention & Patent(Journal of Intellectual Property Information Science),2022,8:15-24.
[2]WU Z F,ZHU T T,XUAN Q,et al.Evaluation of Core Deve-lopers in Open Source Software by Contribution Allocation[J].Journal of Software,2018,29(8):2272-2282.
[3]TANG J J,CAO Y Z,ZHU J W,et al.Human resource value prediction of open source community software developers based on hybrid neural network[J].Computer Applications and Software,2021,38(8):64-77.
[4]YANG B,YU Q,ZHANG W,et al.Influence factors correlation analysis in GitHub open source software development process[J].Ruan Jian Xue Bao/Journal of Software,2017,28(6):1330-1342.
[5]OLIVA G.Characterizing key developers:A case study withapache ant[C]//Proceedings of the International Conference on Collaboration and Technology.Springer-Verlag,2012:97-112.
[6]LI Z X,YU Y,WANG T,et al.Empirical Study on Pull-request Revisions in Open Source Software Community of TensorFlow[J].Journal of Software,2023,34(9):1-13.
[7]YUAN S,TANG J,GU X T.A Survey on Scholar Profiling Techniques in the Open Internet[J].Journal of Computer Research and Development,2018,55(9):1903-1919.
[8]LIAO Z F,YANG H Y,SONG T H,et al.Developer Project Recommendation Model Based on CNN-LSTM in GitHub[J].Acta Electonica Sinica,2020,48(11):2202-2207.
[9]JIANG J,WU Q D,ZHANG L.Open Source Community Review Process Measurement System and Its Empirical Research[J].Journal of Software,2021,32(12):3698-3709.
[10]LEI J,YE H J,WU Z S,et al.Big-Data Platform Based on Open Source Ecosystem[J].Journalof Computer Research and Deve-lopment,2017,54(1):80-93.
[11]SOWE S K,STAMELOS I,ANGELIS L.Understanding know-ledge sharing activities in free/open source software projects:Anempirical study[J].Journal of Systemsand Software,2008,81(3):431-446.
[12]NAKAKOJI K,YAMAMOTO Y,NISHINAKA Y,et al.Evolution patterns of open-source software systems and communities[C]//Proceedings of the 14th International Workshop on Principles of Software Evolution.2002:76-85.
[13]HUNTER P,WALLI S.The rise and evolution of the open source software foundation[J].IFOSS L.Rev.,2013,5:31.
[14]CASALNUOVO C,VASILESCU B,DEVANBU P,et al.Deve-loper onboarding in GitHub:the role of prior social links and language experience[C]//Proceedings of the 2015 10th Joint Mee-ting on Foundations of Software Engineering.2015:817-828.
[15]YU Y,WANG H M,YIN G,et al.Reviewer recommendation for pull-requests in GitHub:What can we learn from code review and bug assignment[J].Information and Software Technology,2016,74:204-218.
[16]LENARDUZZI V,TAIBI D,TOSI D,et al.Open source software evaluation,selection,and adoption:a systematic literature review[C]//2020 46th Euromicro Conference on Software Engineering and Advanced Applications(SEAA).IEEE,2020:437-444.
[17]MOCKUS A,FIELDING R T,HERBSLEB J D.Two case stu-dies of open source software development:Apache and Mozilla[J].ACM Trans.on Software Engineering and Methodology,2002,11(3):309-346.
[18]YE Y,KISHIDA K.Toward an understanding of the motivation open source software developers[C]//Proceedings of the 25th International Conference on Software Engineering.Portland,2003:419-429.
[19]SEN R,SINGH S S,BORLE S.Open source software success:Measure and analysis[J].Decision Support Systems,2012,52(2):364-372.
[20]WANG T,YIN G,WANG H M,et al.Linking stack overflow to issue tracker for issue resolution[C]//Proceedings of the 6th Asia-Pacific Symposium on Internetware on Internetware.ACM Press,2014:11-14.
[21]CROWSTON K,WEI K,HOWISON J,et al.Free/Libre open-source software development:What we know and what we do not know[J].ACM Computing Surveys(CSUR),2012,44(2):7.
[22]WANG,Z D,YANG F,YI W,et al.Unveiling Elite Developers’ Activities in Open Source Projects[J].ACM Transactions on Software Engineering and Methodology(TOSEM),2019,29:1-35.
[23]BOC K,THOMA S,NILS A,et al.Automatic Core-DeveloperIdentification on GitHub:A Validation Study[J].ACM Tran-sactions on Software Engineering and Methodology,2023,32:1-29.
[1] CHEN Zhifei, HAO Yang, CHEN Lin, XIAO Liang. Rule-based Technique for Detecting Risky Dynamic Typing Code [J]. Computer Science, 2023, 50(7): 27-37.
[2] DONG Xia-lei, XIANG Zheng-long, WU Hong-run, WANG Ding-wen, LI Yuan-xiang. Automatic Assignment Method for Software Bug Based on Multivariate Features of Developers [J]. Computer Science, 2022, 49(12): 81-88.
[3] JIANG Jing, PING Yuan, WU Qiu-di, ZHANG Li. Developer Recommendation Method for Crowdsourcing Tasks in Open Source Community [J]. Computer Science, 2022, 49(12): 99-108.
[4] CHEN Chen, ZHOU Yu, WANG Yong-chao, HUANG Zhi-qiu. Context-aware Based API Personalized Recommendation [J]. Computer Science, 2021, 48(12): 100-106.
[5] HE Peng, YU Lv-jun. Analysis of Open Source Software Cliff Walls for Group Collaborative Development [J]. Computer Science, 2020, 47(6): 51-58.
[6] LU Dong-dong, WU Jie, LIU Peng, SHENG Yong-xiang. Analysis of Key Developer Type and Robustness of Collaboration Network in Open Source Software [J]. Computer Science, 2020, 47(12): 100-105.
[7] DA Yi-fei, LIU Xu-dong, SUN Hai-long. Big Data Driven Analysis of Knowledge Exchange Network in Developer Community [J]. Computer Science, 2018, 45(9): 113-118.
[8] CHEN Dan, WANG Xing, HE Peng and ZENG Cheng. Towards Understanding Existing Developers’ Collaborative Behavior in OSS Communities [J]. Computer Science, 2016, 43(Z6): 476-479.
[9] LI Qi-feng and LI Bing. Evolution of Contributors in Open Source Software Development [J]. Computer Science, 2015, 42(12): 43-46.
[10] ZHANG Xi-zhe, LUO Shi ,YIN Ying, ZHANG Bin. Analysis on Dynamic Behavior for Open-source Software Execution Network [J]. Computer Science, 2011, 38(Z10): 242-248.
[11] SHI Dian-xi，YIN Gang，MI Hai-bo，YUAN Lin，WANG Huai-min. Research on Dynamic Job Configuration Framework for Mining of Software Repositories [J]. Computer Science, 2011, 38(7): 113-116.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.