多维度智能心理测评系统  

Multi-dimensional intelligent psychological evaluation system

作　　者：黄伍 龙文浩 刘铸 舒展 田文洪[1,2] HUANG Wu;LONG Wenhao;LIU Zhu;SHU Zhan;TIAN Wenhong(School of Information and Software Engineering,University of Electronic Science and Technology of China,Chengdu Sichuan 610054,China;Chengdu ZhongKeYunJi Information Technology Company Limited,Chengdu Sichuan 610054,China)

机构地区：[1]电子科技大学信息与软件工程学院,成都610054 [2]成都中科云集信息技术有限公司,成都610054

出　　处：《计算机应用》2021年第S02期192-197,共6页journal of Computer Applications

基　　金：四川省科技计划重点研发项目(2021YFG0325)。

摘　　要：针对目前心理测评形式单一的问题,设计并实现了一套结合深度学习的多维度智能心理测评系统。该系统通过Java语言以Spring作为后端框架,搭建了Web服务器,前端采用数据驱动模式。人脸表情识别采用基于卷积神经网络(CNN)的MobileNetV2模型,文本分析采用了多任务双向门重复单元(BGRU),开发部署使用了Docker容器化技术,最终实现了管理员子系统与用户子系统。首创了融合量表、表情、语音等多维度特征分析的方案。其中所提出的特征提取和融合模型使得人脸基本表情识别在CK+与jaffe的融合数据集上准确率达到了99.27%,在实际测试中准确率达到了90.7%;声音情绪特征识别采用业界领先技术。该系统的用户服务与管理服务部署在云服务器中,同时支持PC机、智能手机,并提供针对性调节解决方案。该系统已经在实际使用之中。Aiming at the problem of single form of current psychological evaluation,an multi-dimensional psychological evaluation system combined with deep learning was designed and implemented. Java was used as the programming language,Spring was used as the back-end framework to build a Web server,and a data-driven model was used to build the front-end. CNN(Convolutional Neural Network)-based model MobileNetV2 was used for facial expression recognition,Bidirectional Gated Recurrent Unit(BGRU)was used for text analysis,and Docker containerization technology was used for development and deployment. Finally,a system including administrator subsystem and user subsystem was realized. It was the first system that integrated multi-dimensional feature analysis such as scale,facial expression and speech. The proposed feature extraction and fusion model made the basic facial expression recognition accuracy of 99. 27% on the fusion dataset of CK+ and jaffe,and the accuracy in the actual test reaches 90. 7%;industry-leading technology was adopted in the voice emotion feature recognition.The user service and management service of the system were deployed in the cloud server,which supported PCs and smart phones at the same time,and also provided targeted adjustment solutions. The system is already in actual use.

关 键 词：心理测评 B/S架构 心理测评量表 人脸表情识别 人机对话 文本情绪识别 

分 类 号：TP311.5[自动化与计算机技术—计算机软件与理论]