本文已被:浏览 896次 下载 2021次
Received:May 28, 2021 Revised:July 01, 2021
Received:May 28, 2021 Revised:July 01, 2021
中文摘要: 由于现在缺乏多语言教学中的主观题自动评分, 针对这一问题提出了一种基于孪生网络和BERT模型的主观题自动评分系统. 主观题的问题文本和答案文本通过自然语言预处理BERT模型得到文本的句向量, BERT模型已经在大规模多种语言的语料上经过训练, 得到的文本向量包含了丰富的上下文语义信息, 并且能处理多种语言信息. 然后把问题文本和答案文本的句向量再通过深度网络的孪生网络进行语义相似度的计算, 最后连接逻辑回归分类器, 完成主观题的自动评分. 实验所使用数据集由Hewlett基金提供的英文数据集以及翻译后的中文数据集, 并以二次加权 Kappa系数作为模型的评估指标. 实验结果表明, 对比其他基准模型, 基于孪生网络和BERT模型的自动评分系统在各个数据子集得到的结果最好.
Abstract:To make up the gap of short answer grading systems in multilingual teaching, this paper proposes an automatic short answer grading system based on siamese network and bidirectional encoder representations from transformers (BERT) model. First, the question and answer texts of short answers yield sentence vectors of texts with the natural language-preprocessed BERT model. The BERT model has been trained on a large-scale multilingual corpus, and the obtained text vectors contain rich contextual semantic information and can deal with multilingual information. Then, the sentence vectors of question and answer texts are subjected to the calculation of the semantic similarity in the siamese network of a deep network. Finally, a logistic regression classifier is employed to complete automatic short answer grading. The datasets used for automatic short answer grading tasks are provided by the Hewlett Foundation, and the quadratic weighted kappa coefficient is used as the evaluation index of the model. The experimental results show that the proposed method outperforms other baseline models for automatic short answer grading in each data subset.
keywords: natural language processing automatic short answer grading siamese network bidirectional encoder representation from transformers (BERT) quadratic weighted Kappa computer
文章编号: 中图分类号: 文献标志码:
基金项目:天津财经大学珠江学院教学改革重点项目(ZJJG20-04Z)
引用文本:
钱升华.基于孪生网络和BERT模型的主观题自动评分系统.计算机系统应用,2022,31(3):143-149
QIAN Sheng-Hua.Automatic Short Answer Grading Based on Siamese Network and BERT Model.COMPUTER SYSTEMS APPLICATIONS,2022,31(3):143-149
钱升华.基于孪生网络和BERT模型的主观题自动评分系统.计算机系统应用,2022,31(3):143-149
QIAN Sheng-Hua.Automatic Short Answer Grading Based on Siamese Network and BERT Model.COMPUTER SYSTEMS APPLICATIONS,2022,31(3):143-149