Semi-Supervised Method for Chinese Word Sense Disambiguation

ZHANG Chunxiang; XU Zhifeng; GAO Xueyao

doi:10.3969/j.issn.0258-2724.20170178

Volume 54 Issue 2

Jun. 2019

Turn off MathJax

Article Contents

Abstract

References

Journal of Southwest Jiaotong University > 2019 > 54(2): 408-414.

ZHANG Chunxiang, XU Zhifeng, GAO Xueyao. Semi-Supervised Method for Chinese Word Sense Disambiguation[J]. Journal of Southwest Jiaotong University, 2019, 54(2): 408-414. doi: 10.3969/j.issn.0258-2724.20170178

Citation:

ZHANG Chunxiang, XU Zhifeng, GAO Xueyao. Semi-Supervised Method for Chinese Word Sense Disambiguation[J]. Journal of Southwest Jiaotong University, 2019, 54(2): 408-414. doi: 10.3969/j.issn.0258-2724.20170178

Citation:

PDF( 560 KB)

Semi-Supervised Method for Chinese Word Sense Disambiguation

doi: 10.3969/j.issn.0258-2724.20170178

Received Date: 14 Mar 2017
Rev Recd Date: 08 Jan 2018

Available Online: 06 Mar 2018

Publish Date: 01 Apr 2019

Abstract

Abstract

To solve the problem of a word having multiple meanings in the natural language processing (NLP) field, a semi-supervised disambiguation method, that uses a range of word sense disambiguation (WSD) models and linguistic knowledge has been proposed in this paper. First, words, parts of speech and translations were used as discriminative features, which were extracted from word units adjacent to the left and right of an ambiguous word. A word sense classifier was constructed using a Bayes model, following which a word sense classifier based on a maximum entropy (ME) model was constructed. Second, a Co-Training algorithm, based on a multitude of unannotated corpora, was adopted to optimize the WSD model. Third, optimization experiments were conducted in which training corpus in SemEval-2007: Task#5 and a large number of unannotated corpora from Harbin Institute of Technology were applied to optimize the Bayesian classifier and the maximum entropy classifier. Finally, the optimized WSD model was tested. Test results demonstrate an increase in the disambiguation accuracy of the proposed method by 0.9% compared to WSD models based on support vector machines, thereby exhibiting an improvement in WSD performance.
- natural language processing,
- word sense disambiguation,
- maximum entropy,
- Bayesian classifier

FullText(HTML)

References(20)

References

王李冬,张引,吕明琪. 基于词组主题建模的文本语义压缩算法[J]. 西南交通大学学报,2015,50(4): 755-763. doi: 10.3969/j.issn.0258-2724.2015.04.027

WANG Lidong, ZHANG Yin, LÜ Mingqi. Document semantic compression algorithm based on phrase topic model[J]. Journal of Southwest Jiaotong University, 2015, 50(4): 755-763. doi: 10.3969/j.issn.0258-2724.2015.04.027

翟东海,崔静静,聂洪玉,等. 基于语义相似度的话题关联检测方法[J]. 西南交通大学学报,2015,50(3): 517-522. doi: 10.3969/j.issn.0258-2724.2015.03.021

ZHAI Donghai, CUI Jingjing, NIE Hongyu, et al. Topic link detection method based on semantic similarity[J]. Journal of Southwest Jiaotong University, 2015, 50(3): 517-522. doi: 10.3969/j.issn.0258-2724.2015.03.021

杨陟卓,黄河燕. 基于语言模型的有监督词义消歧模型优化研究[J]. 中文信息学报,2014,28(1): 19-25. doi: 10.3969/j.issn.1003-0077.2014.01.003

YANG Zhizhuo, HUANG Heyan. Supervised WSD model optimization based on language model[J]. Journal of Chinese Information Processing, 2014, 28(1): 19-25. doi: 10.3969/j.issn.1003-0077.2014.01.003

JUDITA P. DALE: a word sense disambiguation system for biomedical documents trained using automatically labeled examples[C]//Proceedings of the NAACL HLT 2013 Demonstration Session. Atlanta: Association for Computational Linguistics, 2013: 1-4

RAGANATO A. Neural sequence learning models for word sense disambiguation[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen: Association for Computational Linguistics, 2017: 1167-1178

IACOBACCI I, PILEHVAR M T, NAVIGLI R. Embeddings for word sense disambiguation: an evaluation study[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin: Association for Computational Linguistics, 2016: 897-907

SHINNOU H, SASAKI M, KOMIYA K. Learning under covariate shift for domain adaptation for word sense disambiguation[C]//Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation. Shanghai: Shanghai Jiaotong University, 2015: 215-223

郭瑛媚,史晓东,陈毅东,等. 基于话题分布相似度的无监督评论词消歧方法[J]. 北京大学学报,2013,49(1): 95-101.

GUO Yingmei, SHI Xiaodong, CHEN Yidong, et al. Unsupervised opinion word disambiguation based on topic distribution similarity[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2013, 49(1): 95-101.

李旭,刘国华,张东明. 一种改进的汉语全文无指导词义消歧方法[J]. 自动化学报,2010,36(1): 184-187.

LI Xu, LIU Guohua, ZHANG Dongming. An improved word sense disambiguation method for Chinese full-words based on unsupervised learning[J]. Acta Automatica Sinica, 2010, 36(1): 184-187.

SUNNY M, RITWIK M, MARTIN R, et al. That's sick dude!: automatic identification of word sense change across different timescales[C]//Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. Baltimore: Association for Computational Linguistics, 2014: 1020-1029

KOUNO K, SHINNOU H, SASAKI M, et al. Unsupervised domain adaptation for word sense disambiguation using stacked denoising autoencoder[C]//Proceedings of the 29th Pacific Asia Conference on Language, Information and Computation. Shanghai: Shanghai Jiaotong University, 2015: 224-231

PANCHENKO A, MARTEN F, RUPPERT E, et al. Unsupervised, knowledge-free, and interpretable word sense disambiguation[C]//Proceedings of the 2017 EMNLP System Demonstrations. Copenhagen: Association for Computational Linguistics, 2017: 91-96

CEM A, JANYCE W, RADA M, et al. Iterative constrained clustering for subjectivity word sense disambiguation[C]//Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics. Gothenburg: Association for Computational Linguistics, 2014: 269-278

KAVEH T, HWEE T N. Semi-supervised word sense disambiguation using word embeddings in general and specific domains[C]//Human Language Technologies: the 2015 Annual Conference of the North American Chapter of the ACL. Denver: Association for Computational Linguistics, 2015: 314-323

KAVEH T, HWEE T N. One million sense-tagged instances for word sense disambiguation and induction[C]//Proceedings of the 19th Conference on Computational Language Learning. Beijing: Association for Computational Linguistics, 2015: 338-344

鹿文鹏,黄河燕,吴昊. 基于领域知识的图模型词义消歧方法[J]. 自动化学报,2014,40(12): 2836-2850.

LU Wenpeng, HUANG Heyan, WU Hao. Word sense disambiguation with graph model based on domain knowledge[J]. Acta Automatica Sinica, 2014, 40(12): 2836-2850.

PERSHINA M. Personalized page rank for named entity disambiguation[C]//Human Language Technologies: the 2015 Annual Conference of the North American Chapter of the ACL. Denver: Association for Computational Linguistics, 2015: 238-243

RICHARD J, LUIS N P. Combining relational and distributional knowledge for word sense disambiguation[C]//Proceedings of the 20th Nordic Conference of Computational Linguistics. Vilnius: Linköping University Electronic Press, 2015: 69-78

IVAN L A. Improving selection of synsets from Wordnet for domain-specific word sense disambiguation[J]. Computer Speech and Language, 2017, 41(1): 128-145.

JIN P, WU Y F, YU S W. SemEval-2007 task 5: multilingual Chinese-English lexical sample task[C]//Proceedings of the 4th International Workshop on Semantic Evaluations. Prague: Association for Computational Linguistics, 2007: 19-23

Relative Articles

[1]	WANG Cheng, WANG Tao, HUANG Xing, LIU Xiangyun, LI Zhengliang, LIU Chang. Overall Reliability Analysis of Transmission Towers with Asymmetrical Legs Based on Sample Moment and Maximum Entropy Method[J]. Journal of Southwest Jiaotong University. doi: 10.3969/j.issn.0258-2724.20230105
[2]	YOU Zhichao, GAO Hongli, GUO Liang, CHEN Yucheng, LIU Yuekai. Equipment Deployment of Direct Tool-Condition Monitoring Based on Improved Information Entropy[J]. Journal of Southwest Jiaotong University, 2024, 59(1): 160-167. doi: 10.3969/j.issn.0258-2724.20220025
[3]	ZHANG Chunxiang, TANG Libo, GAO Xueyao. Word Sense Disambiguation Based on Semi-Supervised Convolutional Neural Networks[J]. Journal of Southwest Jiaotong University, 2022, 57(1): 11-17, 27. doi: 10.3969/j.issn.0258-2724.20200105
[4]	WANG Wei, LIU Danna, PENG Di. Extension Evaluation on Excavation Safety of Deep Foundation Pit in Sandy Cobble Stratum Based on Entropy Method[J]. Journal of Southwest Jiaotong University, 2021, 56(4): 785-791, 838. doi: 10.3969/j.issn.0258-2724.20200333
[5]	DAI Chaohua, LIU Yang, HUANG Chenxi, ZHAO Duo, GUO Ai, CHEN Weirong, LIU Nan. Parameters Optimization for Hybrid Energy Storage System of Electric Vehicles Based on Cross-Entropy Algorithm[J]. Journal of Southwest Jiaotong University, 2020, 55(4): 839-846. doi: 10.3969/j.issn.0258-2724.20190442
[6]	JIN Hang, LIN Jianhui, WU Chuanhui, DENG Tao, HUANG Chenguang. Diagnostic Method for High-Speed Train Bearing Fault Based on EEMD-TEO Entropy[J]. Journal of Southwest Jiaotong University, 2018, 53(2): 359-366. doi: 10.3969/j.issn.0258-2724.2018.02.019
[7]	WU Hao, LI Qunzhan, LIU Wei. New Algorithm of Wide-Area Protection Based on Current Polarity and Energy Relative Entropy[J]. Journal of Southwest Jiaotong University, 2017, 30(3): 439-449. doi: 10.3969/j.issn.0258-2724.2017.03.002
[8]	SHU Li, LIN Feng, LIU Zhonghao, YOU Jian, ZHOU Jiliu. POI Classfication Based Sweep Coverage Scheme in Wireless Sensor Networks[J]. Journal of Southwest Jiaotong University, 2014, 27(1): 165-172. doi: 10.3969/j.issn.0258-2724.2014.01.026
[9]	QIN Na, JIN Weidong, HUANG Jin, LI Zhimin, LIU Jingbo. Feature Extraction of High Speed Train Bogie Based on Ensemble Empirical Mode Decomposition and Sample Entropy[J]. Journal of Southwest Jiaotong University, 2014, 27(1): 27-32. doi: 10.3969/j.issn.0258-2724.2014.01.005
[10]	ZHAO Xiaohua, XU Shili, RONG Jian, ZHANG Xingjian. Discriminating Threshold of Driving Fatigue Based on the Electroencephalography Sample Entropy by Receiver Operating Characteristic Curve Analysis[J]. Journal of Southwest Jiaotong University, 2013, 26(1): 178-183. doi: 10.3969/j.issn.0258-2724.2013.01.028
[11]	ZHANG Limei, LIU Lu, . Fast Search of Multi-channel Mass Data Based on Optimal Entropy Matching[J]. Journal of Southwest Jiaotong University, 2012, 25(2): 313-317. doi: 10.3969/j.issn.0258-2724.2012.02.023
[12]	FENG Chao, YUAN Chao-Wei. Optimization of Kernel Parameters Based on Third-Order Rényi Entropy[J]. Journal of Southwest Jiaotong University, 2011, 24(6): 899-903. doi: 10.3969/j.issn.0258-2724.2011.06.002
[13]	DAI Xiaowen, CAI Zhiping, ZHONG Guiying. Video Shot Detection Method Based on Wavelet Transform and Wavelet Entropy[J]. Journal of Southwest Jiaotong University, 2008, 21(3): 314-318.
[14]	XIN Zhihong, HU Pei, YU Xiang. Entropy,Information and Evolution of Structure of Enterprise Organization[J]. Journal of Southwest Jiaotong University, 2006, 19(2): 250-252.
[15]	XIAO Wen, LIShi-ming. Incentive Entropy andW arningM echanism of Incentive System for Firms[J]. Journal of Southwest Jiaotong University, 2005, 18(5): 705-709.
[16]	LIUWen-li. Nernst Theorem and Entropy ofTwo DimensionalBlack Holes[J]. Journal of Southwest Jiaotong University, 2005, 18(4): 558-561.
[17]	ZHANG Chao, ZHANG Jia-shu, CHENHui, JIADong-li. Transition Region Extraction Algorithm Based on LocalFuzzy Entropy[J]. Journal of Southwest Jiaotong University, 2005, 18(5): 663-666.
[18]	WENQi, PENGHong, XUZhi-gen. VirusDetection Based on Rough Set and Bayes C lassifier[J]. Journal of Southwest Jiaotong University, 2005, 18(5): 659-663.
[19]	LIUHai-yan, CHEN Gao-bo, PENG Chuan. Solving Multi-objective Programming Problems with Maximal Entropy Method and Genetic Algorithm[J]. Journal of Southwest Jiaotong University, 2003, 16(1): 8-11.

Supplements(0)

Cited By

Cited by

Periodical cited type(6)

1.	卫欣玲. 基于知识库的自然语言中歧义字段自动识别系统设计. 自动化技术与应用. 2023(01): 69-72+151 .
2.	刘文松，胡竹青，张锦辉，刘雪菁，林峰，俞俊，徐一丹. 电力科技图谱柔性构建方法. 电力信息与通信技术. 2022(03): 12-19 .
3.	贺佳，杜建强，聂斌，熊旺平，雷银香，罗计根，曾青霞. 基于多节点组合特征和模糊聚类的中文词义消歧方法. 计算机应用与软件. 2021(02): 152-157+220 .
4.	戴洪涛，侯开虎，周洲，肖灵云. 基于VCK-vector模型的词义消歧方法. 软件. 2020(02): 134-140 .
5.	唐善成，马付玉，张镤月，陈熊熊. 采用Seq2Seq模型的非受限词义消歧方法. 西北大学学报(自然科学版). 2019(03): 351-355 .
6.	张延星，王广祥，朱志芸，张蝶依. 基于知识图谱词义消歧的文本聚类方法. 华北理工大学学报(自然科学版). 2019(04): 89-94 .

Other cited types(7)

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(1) / Tables(2)

Get Citation

PDF

XML

Article views(526) PDF downloads(10)