基于人脸检测和模糊综合评判的在线教育专注度研究

doi:10.11896/jsjkx.191100203

摘要/Abstract

摘要： 针对在线教育中对学生的监督手段较为匮乏的问题,基于人脸检测的模糊综合评判算法通过人脸图像检测头部的左(右)转头转角、头部抬(低)头转角、眼睛闭合度、嘴巴闭合度和面部表情,使用头部的左(右)转头转角和头部抬(低)头转角对头部姿态进行评分,在眼睛闭合度和嘴巴闭合度的检测结果的基础上对疲劳度进行评分,结合面部表情的检测结果对情绪进行评分,再根据三个评分使用模糊综合评判方法量化评判其学习专注度。该算法应用于在线教育平台的学生课堂专注度评估,有助于授课老师及时获取网络课堂中学生的课堂专注度,为改进教学计划和督促学生学习提供助力。基于此算法设计的在线教育平台的学习专注度检测系统经模拟场景使用测试,能有效地根据人脸检测结果评估学生的课堂专注度,提升了课堂质量和学生的学习效果。

关键词: 课堂监督, 模糊综合评判, 人脸检测, 在线教育, 专注度

Abstract: Aiming at the problem of less supervised means for students in online education,the fuzzy comprehensive evaluation algorithm based on face detection detects the head's left (right) turning angle,head lifting (low) angle,eye closure,mouth closure and facial expression through face image detection,uses the left (right) turning angle of the head and the head lifting (low) angle to score the head posture.Based on the results of eye closure and mouth closure,the fatigue score is evaluated.Combined with facial expression detection results,the emotion score is evaluated.Then the fuzzy comprehensive evaluation method is used to quantitatively judge the concentration degree of learning according to the scores of head posture,fatigue and emotion.The algorithm is applied to the evaluation of students' classroom concentration on the online education platform,helping the instructors to timely acquire the classroom concentration of the students in the online classroom,and provide assistance for improving the teaching plan and urging students to learn.The learning concentration detection system of the online education platform designed based on this algorithm is used to simulate the scene use test,which can effectively evaluate the classroom concentration of the students according to the face detection result,and improve the classroom quality and the learning effect of the students.

Key words: Classroom supervision, Concentration, Face detection, Fuzzy comprehensive evaluation, Online education

中图分类号:

TP183

钟马驰, 张俊朗, 蓝扬波, 何月铧. 基于人脸检测和模糊综合评判的在线教育专注度研究[J]. 计算机科学, 2020, 47(11A): 196-203. https://doi.org/10.11896/jsjkx.191100203

ZHONG Ma-chi, ZHANG Jun-lang, LAN Yang-bo, HE Yue-hua. Study on Online Education Focus Degree Based on Face Detection and Fuzzy Comprehensive Evaluation[J]. Computer Science, 2020, 47(11A): 196-203. https://doi.org/10.11896/jsjkx.191100203

参考文献

[1] WU L Q.A comparative study on the effect of online classroom teaching and traditional classroom teaching[J].Education Mo-dernization,2019,6(9):276-277.
[2] TU Y,ZHANG Y J.An empirical study on the supervision mo-del of knowledge construction effect in online classroom[J].Education Modemization,2018,41(3):64-73.
[3] WANG J J.Research on the application of emotion computing based on expression recognition technology in Modern Distance Education[D].Tianjin:Tianjin Normal University,2005.
[4] YUAN Y.Research on the recognition of bad expression in Distance Education[D].Chengdu:Sichuan Normal University,2014.
[5] LI W Q.Research on learning focus recognition method for Distance Education[D].Hangzhou:Hangzhou Dianzi University,2018.
[6] PAN X.Research on face detection and expression feature extraction of learners in online teaching context[D].Beijing:Capital Normal University,2009.
[7] XIONG B H.Research and application of attention detectionmethod integrating sight analysis in online learning [D].Hangzhou:Hangzhou University of Electronic Science and technology,2018.
[8] PENG D L.General psychology [M].Beijing:Beijing NormalUniversity Press,2001:169-193.
[9] WIERWILLE W W,ELLSWORT L A,WREGGIT S S,et al.Research on vehicle-based driver status/performance monitoring;development,validation,and refinemen of algorithms for detection of driver drowsiness,final report[R].Office of Crash Avoidance Research National Highway Traffic Safety Administration,1994,12:247.
[10] LIN C D,YANG Z L,HUANG X T.Dictionary of Psychology(Volume I)[M].Shanghai:Shanghai Education Press,2003:947-948.
[11] FENG M N,LIU X M.The relationship between cognitive inhibition and emotion and action control style of college students[J].Chinese Journal of mental health,2019(11):862-867.
[12] SHEN J C,DU S X,LUO Y,et al.Fuzzy comprehensive evaluation method and application based on cloud model[J].Fuzzy System and Mathematics,2012,26(6):115-123.
[13] LU Y,WANG Z.Detecting Driver Yawning in Successive Images[C]//The International Conference on Bioinformatics and Biomedical Engineering.IEEE Xplore,2007,07:581-583.
[14] SAATY,THOMAS L,PENIWATI,et al.Group Decision Ma-king:Drawing out and Reconciling Differences[M].Pittsburgh,Pennsylvania:RWS Publications,2013:1-385.
[15] LI X C.Fuzzy mathematics method and application[M].Beijing:Chemical Industry Press,2017:83-113.

相关文章 15

[1]	景慧昀, 周川, 贺欣. 针对人脸检测对抗攻击风险的安全测评方法 Security Evaluation Method for Risk of Adversarial Attack on Face Detection 计算机科学, 2021, 48(7): 17-24. https://doi.org/10.11896/jsjkx.210300305
[2]	张开强, 蒋从锋, 程小兰, 贾刚勇, 张纪林, 万健. 多分辨率下资源感知的图像目标自适应缩放检测 Resource-aware Based Adaptive-scaling Image Target Detection Under Multi-resolution Scenario 计算机科学, 2021, 48(4): 180-186. https://doi.org/10.11896/jsjkx.201200116
[3]	邓良, 许庚林, 李梦杰, 陈章进. 基于深度学习与多哈希相似度加权实现快速人脸识别 Fast Face Recognition Based on Deep Learning and Multiple Hash Similarity Weighting 计算机科学, 2020, 47(9): 163-168. https://doi.org/10.11896/jsjkx.190900118
[4]	赵博, 杨明, 汤志伟, 蔡玉鑫. 基于FPGA的智能视频加速检索系统 Intelligent Video Surveillance Systems Based on FPGA 计算机科学, 2020, 47(6A): 609-611. https://doi.org/10.11896/JsJkx.190700118
[5]	林增敏, 洪朝群, 庄蔚蔚. 融合人脸跟踪和聚类的人脸图像去重方法 Face Image Deduplication Based on Fusion of Face Tracking and Clustering 计算机科学, 2020, 47(11A): 615-619. https://doi.org/10.11896/jsjkx.200400142
[6]	罗凤娥,张成伟,刘安. 基于数据挖掘的航班延误预警管理分析 Flight Delays Early Warning Management and Analysis Based on Data Mining 计算机科学, 2016, 43(Z6): 542-546. https://doi.org/10.11896/j.issn.1002-137X.2016.6A.129
[7]	霍芋霖,符意德. 基于Zynq的人脸检测设计 Face Detection Design Based on Zynq 计算机科学, 2016, 43(10): 322-325. https://doi.org/10.11896/j.issn.1002-137X.2016.10.060
[8]	张胜礼,李永明. 广义模糊集GFScom在模糊综合评判中的应用 Application of Generalized Fuzzy Sets GFScom to Fuzzy Comprehensive Evaluation 计算机科学, 2015, 42(7): 125-128. https://doi.org/10.11896/j.issn.1002-137X.2015.07.027
[9]	贾宁,高楠,力贵才,王兆云. 基于OpenCV的图像分类软件的设计与实现 Design and Implementation of Image Classification Software Based on OpenCV 计算机科学, 2014, 41(Z11): 150-153.
[10]	叶俊,张正军. 基于DS-Adaboost算法的人脸检测 Face Detection Based on DS-Adaboost Algorithm 计算机科学, 2013, 40(Z11): 318-319.
[11]	杨双双，郭玉翠，左赛哲，胡映然. 基于资源评价的信任管理模型 Trust Management Model Based on Evaluation of Resources 计算机科学, 2012, 39(8): 31-.
[12]	谢倩茹,耿国华. 复杂光照环境下视频人脸序列的自动检测方法 Automatic Face Detection in Video Sequences in Complex Lighting Environments 计算机科学, 2011, 38(10): 267-269.
[13]	张永,薛芝茂. 基于两级分类器的人脸检测系统设计 Face Detection System Design Based on Two Classifiers 计算机科学, 2010, 37(4): 293-.
[14]	李样,王建国. 彩色图像中纯脸检测与定位的优化算法研究 Optimization Algorithm for Detection and Localization of Pure Face in Color Images 计算机科学, 2009, 36(7): 284-287. https://doi.org/10.11896/j.issn.1002-137X.2009.07.070
[15]	. 基于广义掩膜积分图像的快速模板匹配计算机科学, 2008, 35(6): 223-226.

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed