基于宽度神经网络的FAQ问答模型
FAQ question answering model based on width neural network
FAQ问答数据一般具有长度较短、上下文缺失、语法结构信息缺失等问题,使用深度神经网络往往会造成优化困难以及过拟合等问题。浅层特征如局部特征对FAQ问答任务尤其重要。为了将不同样的浅层特征进行组合,本文提出基于宽度神经网络的FAQ问答模型,该模型将基于字粒度的卷积神经网络隐层与基于词粒度的循环神经网络隐层进行拼接,不仅能学习到短语特征、局部特征等,还能学习到时序特征。在某企业的真实FAQ客服数据上,该模型对比当前较强的分类模型,取得了最好的效果。实验表示,使用宽度浅层神经网络将不同的浅层特征进行组合,能够增强模型的鲁棒性。
he FAQ question and answer data generally has problems such as short length, lack of context, and lack of grammatical structure information. Deep neural networks often causes optimization difficulties and over-fitting. Shallow features such as local features are especially important for FAQ questions and answers. In order to combine different shallow features, this paper proposes a FAQ question-and-answer model based on breadth neural network. This model splices the hidden layer of convolutional neural network based on word granularity and the hidden layer of recurrent neural network based on word granularity. Learning phrase features, local features, etc., can also learn timing features. In the real FAQ customer service data of a company, the model compares the current strong classification model and achieves the best results. Experiments show that using shallow-width neural networks to combine different shallow features can enhance the robustness of the model.
莫歧、王小捷
计算技术、计算机技术
FAQ卷积神经网络循环神经网络宽度神经网络
frequently asked questionsconvolutional neural networkrecurrent neural networkwidth neural network
莫歧,王小捷.基于宽度神经网络的FAQ问答模型[EB/OL].(2019-03-29)[2025-08-02].http://www.paper.edu.cn/releasepaper/content/201903-381.点此复制
评论