摘要
针对目前词向量表示低频词质量差,表示的语义信息容易混淆,以及现有的消歧模型对多义词不能准确区分等问题,提出一种基于词向量融合表示的多特征融合消歧方法。该方法将使用知网(HowNet)义原表示的词向量与Word2vec生成的词向量进行融合来补全词的多义信息以及提高低频词的表示质量。首先计算待消歧实体与候选实体的余弦相似度来获得二者的相似度;其次使用聚类算法和知网知识库来获取实体类别特征相似度;然后利用改进的潜在狄利克雷分布(LDA)主题模型来抽取主题关键词以计算实体主题特征相似度,最后通过加权融合以上三类特征相似度实现多义词词义消歧。在西藏畜牧业领域测试集上进行的实验结果表明,所提方法的准确率(90.1%)比典型的图模型消歧方法提高了7.6个百分点。
Aiming at the problems that the low-frequency words expressed by the existing word vectors are of poor quality,the semantic information expressed by them is easy to be confused,and the existing disambiguation models cannot distinguish polysemous words accurately,a multi-feature fusion disambiguation method based on word vector fusion was proposed.In the method,the word vectors expressed by HowNet sememes and the word vectors generated by Word2vec(Word to vector)were fused to complement the polysemous information of words and improve the expression quality of lowfrequency words.Firstly,the cosine similarity between the entity to be disambiguated and the candidate entity was calculated to obtain the similarity between them.After that,the clustering algorithm and HowNet knowledge base were used to obtain entity category feature similarity.Then,the improved Latent Dirichlet Allocation(LDA)topic model was used to extract the topic keywords to calculate the similarity of entity topic feature similarity.Finally,the word sense disambiguation of polysemous words was realized by weighted fusion of the above three types of feature similarities.Experimental results conducted on the test set of the Tibet animal husbandry field show that the accuracy of the proposed method(90.1%)is 7.6 percentage points higher than that of typical graph model disambiguation method.
作者
王伟
赵尔平
崔志远
孙浩
WANG Wei;ZHAO Erping;CUI Zhiyuan;SUN Hao(College of Information Engineering,Xizang Minzu University,Xianyang Shaanxi 712082,China)
出处
《计算机应用》
CSCD
北大核心
2021年第8期2193-2198,共6页
journal of Computer Applications
基金
国家自然科学基金资助项目(61762082)
西藏自治区科技计划项目(XZ202001ZY0055G)。
关键词
消歧
义原
词向量融合
特征融合
多义词
disambiguation
sememe
word vector fusion
feature fusion
polysemy
作者简介
王伟(1996-),男,江苏扬州人,硕士研究生,CCF会员,主要研究方向:自然语言处理、知识图谱;通信作者:赵尔平(1976-),男,陕西彬县人,副教授,硕士,CCF会员,主要研究方向:大数据、知识图谱,电子邮箱xdzep@163.com;崔志远(1997-),男,山东潍坊人,硕士研究生,CCF会员,主要研究方向:自然语言处理、知识图谱;孙浩(1995-),男,江苏徐州人,硕士研究生,CCF会员,主要研究方向:自然语言处理、知识图谱。
