###
计算机系统应用:2018,27(11):103-108
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于皮肤电信号与文本信息的双模态情感识别系统
张力行1, 叶宁1,2, 黄海平1,2, 王汝传1,2
(1.南京邮电大学 计算机学院、软件学院、网络空间安全学院, 南京 210023;2.南京邮电大学 江苏省无线传感网高技术重点实验室, 南京 210023)
Bimodal Emotion Recognition System Based on Skin Electrical Signals and Text Information
ZHANG Li-Xing1, YE Ning1,2, HUANG Hai-Ping1,2, WANG Ru-Chuan1,2
(1.School of Computer Science, Software and Cyberspace Security, Nanjing University of Posts and Telecommunications, Nanjing 210023, China;2.Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks, Nanjing University of Posts and Telecommuni-cations, Nanjing 210023, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 57次   下载 85
投稿时间:2018-04-10    修订日期:2018-04-27
中文摘要: 人机交互离不开情感识别,目前论是单模态的情感识别还是多生理参数融合的情感识别都存在识别率低,鲁棒性差的问题.为了克服上述问题,故提出一种基于两种不同类型信号的融合情感识别系统,即生理参数皮肤电信号和文本信息融合的双模态情感识别系统.首先通过采集与分析相应情感皮肤电信号特征参数和文本信息的情感关键词特征参数并对其进行优化,分别设计人工神经网络算法和高斯混合模型算法作为单个模态的情感分类器,最后利用改进的高斯混合模型对判决层进行加权融合.实验结果表明,该种融合系统比单模态和多生理参数融合的多模态情感识别精度都要高.所以,依据皮肤电信号和文本信息这两种不同类型的情感特征可以构建出识别率高,鲁棒性好的情感识别系统.
Abstract:Human-computer interaction is inseparable from emotion recognition. At present, there is a problem of low recognition rate and poor robustness both in single-modality emotion recognition and multi-physiological parameters fusion emotion recognition. Therefore, a fusion emotion recognition system based on two different types of signals is proposed, that is, a dual-modality emotion recognition system that integrates physiological parameters of skin electrical signals and text information. Firstly, by collecting and analyzing the characteristic parameters of the corresponding emotional skin electrical signals and the emotional keyword features of the textual information, the artificial neural network algorithm and the Gaussian mixture model algorithm are designed as a single mode emotion classifier, respectively. The Gaussian mixture model weights the decision layers. Experimental results show that this kind of fusion system has higher accuracy than multi-modality emotion recognition combined with single mode and multiple physiological parameters. Therefore, based on the two different types of emotional characteristics of skin electrical signals and text information, an emotion recognition system with high recognition rate and sound robustness can be constructed.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61572260,61373017,61572261,61672297);江苏省“六大人才高峰”(2010DZXX026);中国博士后科学基金(2014M560440);江苏省博士后科研基金(1302055C);江苏省重点项目研究与发展计划(BE2015702,BE2017742);江苏省优秀青年科学基金学者(BK20160089)
引用文本:
张力行,叶宁,黄海平,王汝传.基于皮肤电信号与文本信息的双模态情感识别系统.计算机系统应用,2018,27(11):103-108
ZHANG Li-Xing,YE Ning,HUANG Hai-Ping,WANG Ru-Chuan.Bimodal Emotion Recognition System Based on Skin Electrical Signals and Text Information.COMPUTER SYSTEMS APPLICATIONS,2018,27(11):103-108

用微信扫一扫

用微信扫一扫