计算机科学 ›› 2026, Vol. 53 ›› Issue (6): 396-407.doi: 10.11896/jsjkx.250700114

• 计算机软件 • 上一篇    下一篇

如何从开源社区筛选合作型开发项目——在GitHub上的探索性研究

董国郡1, 程璨2,3,4, 方晴5, 游兰1, 王伟6, 彭庆喜7   

  1. 1 湖北大学计算机学院 武汉 430062
    2 湖北大学人工智能学院 武汉 430062
    3 智能感知系统与安全教育部重点实验室(湖北大学) 武汉 430062
    4 南京大学计算机软件新技术全国重点实验室 南京 210023
    5 荆楚理工学院师范学院 湖北 荆门 448000
    6 华东师范大学数据科学与工程学院 上海 200062
    7 武汉学院信息工程学院 武汉 430212
  • 收稿日期:2025-07-21 修回日期:2025-10-15 出版日期:2026-06-15 发布日期:2026-06-09
  • 通讯作者: 游兰(yoyo@hubu.edu.cn)
  • 作者简介:(guojun.dong@stu.hubu.edu.cn)
  • 基金资助:
    湖北省自然科学基金青年项目(2023AFB374);南京大学计算机软件新技术全国重点实验室开放课题(KFKT2025B48);湖北省教育厅哲学社会科学研究项目青年项目(24Q166);湖北省技术创新专项计划(2025BEB028, 2024BAB034);湖北省高校优秀中青年科技创新团队(T2022055)

How to Filter Collaborative Development Projects from Open-source Communities--Exploratory Study on GitHub

DONG Guojun1, CHENG Can2,3,4, FANG Qing5, YOU Lan1, WANG Wei6, PENG Qingxi7   

  1. 1 School of Computer Science,Hubei University,Wuhan 430062,China
    2.School of Artificial Intelligence,Hubei University,Wuhan 430062,China
    3 Key Laboratory of Intelligent Sensing System and Security,Ministry of Education(Hubei University),Wuhan 430062,China
    4 State Key Laboratory for Novel Software Technology at Nanjing University,Nanjing 210023,China
    5 Normal College,Jingchu University of Technology,Jingmen,Hubei 448000,China
    6 School of Data Science and Engineering,East China Normal University,Shanghai 200062,China
    7 School of Information Engineering,Wuhan College,Wuhan 430212,China
  • Received:2025-07-21 Revised:2025-10-15 Published:2026-06-15 Online:2026-06-09
  • About author:DONG Guojun,born in 2000,postgra-duate,is a student member of CCF(No.A11808G).His main research interests include open-source software ecosystem and large language models.
    YOU Lan,born in 1978,Ph.D,professor,is a senior member of CCF(No.H8967M).Her main research interests include spatio-temporal big data,natural language processing,and social computing.
  • Supported by:
    Hubei Provincial Natural Science Foundation Youth Program(2023AFB374) ,Open Subjects of State Key Laboratory for Novel Software Technology at Nanjing University(KFKT2025B48),Hubei Provincial Department of Education Philosophy and Social Sciences Research Project:Youth Program(24Q166),Technology Innovation Special Program of Hubei Province(2025BEB028,2024BAB034) and Hubei Provincial University Excellent Young and Middle-aged Scientific and Technological Innovation Team(T2022055).

摘要: 合作开发项目(Collaborative Development Projects,CDPs)和工程化开发项目(Engineering Development Projects,EDPs)是开源软件(Open-Source Software,OSS)生态中两种典型的项目形态,能反映出项目开发状态与工程化程度。对于开发者而言,了解项目是否是CDP通常具有挑战性,因其合作开发的特性缺乏明确界定;了解项目是否是EDP缺乏足够多的有价值的开发信息。对于研究者而言,若在样本筛选中忽视CDP和EDP两类样本,会导致样本池受到污染,混入大量非以开发为目标或无意合作的项目,从而降低研究结果的有效性。目前的研究缺乏针对这两类项目的自动化筛选方法。针对这一困境,通过构建标准数据集验证了50种不同方法与特征的组合和24种机器学习算法与特征集的组合方法在项目筛选中的性能差异,为研究者提供高效筛选目标项目的模型。研究表明:1)针对需求高Precision的场景,基准方法表现优异,在筛选CDP和EDP时其Precision分别为0.900和0.880;2)针对需求高F1-Score的场景,机器学习方法表现最佳,在筛选CDP和EDP时其F1-Score分别为0.879和0.821;3)大语言模型方法筛选CDP和EDP时,Precision分别为0.691和0.569;4)机器学习方法与现有筛选方法相结合,在筛选CDP时其Precision可提高4.56%~42.8%,在筛选EDP时其Precision可提高5.9%~237.5%。

关键词: 数据挖掘, 开源软件, GitHub

Abstract: Collaborative development projects(CDPs) and engineering development projects(EDPs) represent two typical project models within the open-source software(OSS) ecosystem,reflecting a project's development status and engineering maturity.For developers,determining whether a project is a CDP is often challenging due to the lack of clear boundaries defining its collaborative nature.Conversely,identifying an EDP requires access to sufficient valuable development information.For researchers,neglecting CDP and EDP samples during selection contaminates the sample pool with numerous projects not development-oriented or unintentionally collaborative,thereby diminishing the validity of research findings.Current research lacks automated screening methods for these two project types.Addressing this gap,this study constructs a standardized dataset to validate the performance differences of 50 combinations of methods and features,along with 24 combinations of machine learning algorithms and feature sets,in project screening.This provides researchers with an efficient model for targeting relevant projects.The findings reveal:1)For scenarios demanding high Precision,baseline methods excel,achieving Precision scores of 0.900 and 0.880 when screening CDPs and EDPs,respectively;2)For scenarios prioritizing high F1-Score,machine learning methods perform best,yielding F1-Scores of 0.879 and 0.821 for CDP and EDP screening,respectively;3)Large language model methods achieve Precision scores of 0.691 and 0.569 for CDP and EDP screening,respectively;4)Integrating machine learning methods with existing screening approaches improve Precision by 4.56% to 42.8% for CDP screening and by 5.9% to 237.5% for EDP screening.

Key words: Data mining, Open-sources software, GitHub

中图分类号: 

  • TP311
[1]COSENTINO V,IZQUIERDO J L C,CABOT J.A systematic mapping study of software development with GitHub [J].IEEE Access,2017,5:7173-7192.
[2]QI Q,CAO J,LIU Y C.The evolution of software ecosystem in GitHub [J].Journal of Computer Research and Development,2020,57(3):513-524.
[3]WANG Y,REN Y X,GAO T,et al.Survey on governance technology of open-source software library ecosystem:twenty years of progress [J].Journal of Software,2024,35(2):629-674.
[4]WATTANAKRIENGKRAI S,CHINTHANET B,HATA H,et al.GitHub repositories with links to academic papers:Public access,traceability,and evolution [J].Journal of Systems and Software,2022,183:111117.
[5]BRONESKE D,KITTAN S,KRÜGER J.Sharing Software-Evolution Datasets:Practices,Challenges,and Recommendations [C]//Proceedings of the ACM on Software Engineering.2024:2051-2074.
[6]KIKAS R,DUMAS M,PFAHL D.Using dynamic and contextual features to predict issue lifetime in github projects[C]//Proceedings of the 13th International Conference on Mining Software Repositorie.2016.
[7]MUNAIAH N,KROH S,CABREY C,et al.Curating github for engineered software projects [J].Empirical Software Enginee-ring,2017,22:3219-3253.
[8]KALLIAMVAKOU E,GOUSIOS G,BLINCOE K,et al.An in-depth study of the promises and perils of mining GitHub [J].Empirical Software Engineering,2016,21:2035-2071.
[9]DONG R Z,LI B X,WANG L L,et al.Review of research on software ecosystems [J].Chinese Journal of Computers,2020,43(2):250-271.
[10]DAN C,XING W,PENG H,et al.Towards understanding exis-ting developers' collaborative behavior in oss communities [J].Computer Science,2016,43(S1):476-479,501.
[11]ZHANG Y,WANG Z,LI Z X,et al.Empirical study on application and maintenance of oss community profile documentation [J].Computer Science,2023,50(S1):826-833.
[12]YIN G,WANG T,LIU B X,et al.Survey of software data mi-ning for open source ecosystem [J].Journal of Software,2018,29(8):2258-2271.
[13]GOUSIOS G,SPINELLIS D.GHTorrent:GitHub's data from a firehose[C]//Proceedings of the 2012 9th IEEE Working Conference on Mining Software Repositories(MSR).IEEE,2012.
[14]MOMBACH T,VALENTE M T.GitHub REST API vs GH-Torrent vs GitHub Archive:A comparative study [R].2018.
[15]KOTTI Z,KRAVVARITIS K,DRITSA K,et al.Standing onshoulders or feet? An extended study on the usage of the MSR data papers [J].Empirical Software Engineering,2020,25(5):3288-3322.
[16]JØRGENSEN M.The influence of selection bias on effort overruns in software development projects [J].Information and Software Technology,2013,55(9):1640-1650.
[17]JARCZYK O,JAROSZEWICZ S,WIERZBICKI A,et al.Surgical teams on GitHub:Modeling performance of GitHub project development processes [J].Information and Software Technology,2018,100:32-46.
[18]BAO L,XIA X,LO D,et al.A large scale study of long-timecontributor prediction for github projects [J].IEEE Transactions on Software Engineering,2019,47(6):1277-1298.
[19]ELAZHARY O,STOREY M A,ERNST N,et al.Do as I do,not as I say:Do contribution guidelines match the github contribution process?[C]//Proceedings of the 2019 IEEE International Conference on Software Maintenance and Evolution(ICSME).IEEE,2019.
[20]BERTONCELLO M V,PINTO G,WIESE I S,et al.Pull requests or commits? which method should we use to study contributors' behavior?[C]//Proceedings of the 2020 IEEE 27th International Conference on Software Analysis,Evolution and Reengineering(SANER).IEEE,2020.
[21]KALLIS R,DI SORBO A,CANFORA G,et al.Predicting issue types on GitHub [J].Science of Computer Programming,2021,205:102598.
[22]XIA X Y,ZHAO S Y,HAN F Y,et al.Data mining and information service for open collaboration digital ecosystem [J].Computer Science,2024,51(10):187-195.
[23]PRANA G A A,TREUDE C,THUNG F,et al.Categorizing the content of github readme files [J].Empirical Software Enginee-ring,2019,24:1296-1327.
[24]PUHLFÜRß T,MONTGOMERY L,MAALEJ W.An exploratory study of documentation strategies for product features in popular GitHub projects[C]//Proceedings of the 2022 IEEE International Conference on Software Maintenance and Evolution(ICSME).IEEE,2022.
[25]DEY T,LOUNGANI J,IVERS J.Smarter Project Selection for Software Engineering Research[C]//Proceedings of the 20th International Conference on Predictive Models and Data Analy-tics in Software Engineering.2024.
[26]LIU B C,ZHANG L,LIU Z W,et al.Cross-project issue recommendation method for open-source software defects [J].Journal of Software,2024,35(5):2340-2358.
[27]SAFIULLINA G,GUMEROV A,DLAMINI G,et al.Prelimi-nary Study:Exploring GitHub Repository Metrics[C]//Proceedings of the Future of Information and Communication Conference.Springer,2024.
[28]PARMAR A,KATARIYA R,PATEL V.A review on random forest:An ensemble classifier[C]//Proceedings of the International Conference on Intelligent Data Communication Technologies and Internet of Things(ICICI).Springer,2018.
[29]WANG J,WANG H,NIE F,et al.Ratio sum versus sum ratio for linear discriminant analysis [J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2021,44(12):10171-10185.
[30]MIENYE I D,SUN Y.A survey of ensemble learning:Con-cepts,algorithms,applications,and prospects [J].IEEE Access,2022,10:99129-99149.
[31]HANCOCK J T,KHOSHGOFTAAR T M.CatBoost for big data:an interdisciplinary review [J].Journal of Big Data,2020,7(1):94.
[32]ZHAO G,DA COSTA D A,ZOU Y.Improving the pull requests review process using learning-to-rank algorithms [J].Empirical Software Engineering,2019,24:2140-2170.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!