###
:2019,28(6):118-124
本文二维码信息
码上扫一扫!
基于Multi-head Attention和Bi-LSTM的实体关系分类
(1.中国科学院大学, 北京 100049;2.中国科学院 沈阳计算技术研究所, 沈阳 110168;3.东北大学, 沈阳 110819)
Relation Classification Based on Multi-Head Attention and Bidirectional Long Short-Term Memory Networks
(1.University of Chinese Academy of Sciences, Beijing 100049, China;2.Shenyang Institute of Computing Technology, Chinese Academy of Sciences, Shenyang 110168, China;3.Northeastern University, Shenyang 110819, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 364次   下载 226
投稿时间:2018-12-13    修订日期:2019-01-08
中文摘要: 关系分类是自然语言处理领域的一项重要任务,能够为知识图谱的构建、问答系统和信息检索等提供技术支持.与传统关系分类方法相比较,基于神经网络和注意力机制的关系分类模型在各种关系分类任务中都获得了更出色的表现.以往的模型大多采用单层注意力机制,特征表达相对单一.因此本文在已有研究基础上,引入多头注意力机制(Multi-head attention),旨在让模型从不同表示空间上获取关于句子更多层面的信息,提高模型的特征表达能力.同时在现有的词向量和位置向量作为网络输入的基础上,进一步引入依存句法特征和相对核心谓词依赖特征,其中依存句法特征包括当前词的依存关系值和所依赖的父节点位置,从而使模型进一步获取更多的文本句法信息.在SemEval-2010任务8数据集上的实验结果证明,该方法相较之前的深度学习模型,性能有进一步提高.
Abstract:Relation classification is an important subtask in the field of Natural Language Processing (NLP), which provides technical support for the construction of knowledge map, question answer systems, and information retrieval. Compared with traditional relational classification methods, deep learning model-based methods with attention have achieved better performance in various relation classification tasks. Most of previous models use one-layer attention, which cause single representation of the feature. Therefore, on the basis of the existing works, the study introduces a multi-head attention, which aims to enable the model to obtain more information about sentence from different representation subspaces and improve the model's feature expression ability. Otherwise, based on the existing word embedding and position embedding as network input, we introduce dependency parsing feature and relative core predicate dependency feature to the model. The dependency parsing features include the dependency value and the location of the dependent parent node position for the current word. The experimental results on the SemEval-2010 relation classification task show that the proposed method outperforms most of the existing methods.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
刘峰,高赛,于碧辉,郭放达.基于Multi-head Attention和Bi-LSTM的实体关系分类.计算机系统应用,2019,28(6):118-124
LIU Feng,GAO Sai,YU Bi-Hui,GUO Fang-Da.Relation Classification Based on Multi-Head Attention and Bidirectional Long Short-Term Memory Networks.COMPUTER SYSTEMS APPLICATIONS,2019,28(6):118-124

用微信扫一扫

用微信扫一扫