- ISSN 0258-2724
- CN 51-1277/U
- EI Compendex
- Scopus
- Indexed by Core Journals of China, Chinese S&T Journal Citation Reports
- Chinese S&T Journal Citation Reports
- Chinese Science Citation Database
| Citation: | PAN Lei, YUAN Hongxiao, ZHONG Zhun, LIAO Hongzhou, YANG Ruijia. Event Causality Identification Based on Large Language Model-Constructed Graph Networks[J]. Journal of Southwest Jiaotong University. doi: 10.3969/j.issn.0258-2724.20240484
|
To enhance the accuracy of document-level event causality identification, the implicit knowledge within large language models was first leveraged to filter out events related to the target event from the document, constructing a candidate event set. Next, the candidate event set was organized into a fully connected event relationship graph, which was then subjected to conditional constraints. These constraints simplified the fully connected graph into a constrained event relationship graph, reducing noise propagation from irrelevant events. Finally, a self-attention mechanism was used to compute the influence of any node on other nodes in the graph network, and the model was trained with a binary classification loss function incorporating focal loss, further mitigating false positives in causality identification. Experimental results show that in the causality identification tasks, the model achieves a precision of 77.3% for intra-sentence event pair causality identification on the Causal-TimeBank dataset. On the EventStoryLine dataset, it achieves a precision of 75.2% for intra-sentence event pair causality identification, an F1-score of 60.6% for inter-sentence event pair identification, and an F1-score of 59.6% for document-level event pair identification.
| [1] |
杨竣辉, 刘宗田, 刘炜, 等. 基于语义事件因果关系识别[J]. 小型微型计算机系统, 2016, 37(3): 433-437.
Yang Junhui, Liu Zongtian, Liu Wei, et al. Identify causality relationships based on semantic event[J]. Journal of Chinese Computer Systems, 2016, 37(3): 433-437.
|
| [2] |
朱庆, 李茂粟, 丁雨淋, 等. 滑坡灾情数据多层级语义检索方法[J]. 西南交通大学学报, 2020, 55(3): 467-475. doi: 10.3969/j.issn.0258-2724.20180695
Zhu Qing, Li Maosu, Ding Yulin, et al. Multi-level semantic retrieval method for landslide disaster data[J]. Journal of Southwest Jiaotong University, 2020, 55(3): 467-475. doi: 10.3969/j.issn.0258-2724.20180695
|
| [3] |
王淑营, 李雪, 黎荣, 等. 基于知识图谱的高速列车知识融合方法[J]. 西南交通大学学报, 2024, 59(5): 1194-1203.
Wang Shuying, Li Xue, Li Rong, et al. Knowledge fusion method of high-speed train based on knowledge graph[J]. Journal of Southwest Jiaotong University, 2024, 59(5): 1194-1203.
|
| [4] |
周旭, 温韬, 龙志强. 基于漏检率的磁浮列车悬浮系统异常检测[J]. 西南交通大学学报, 2023, 58(4): 903-912.
Zhou Xu, Wen Tao, Long Zhiqiang. Anomaly detection of suspension system in maglev train based on missed detection rate[J]. Journal of Southwest Jiaotong University, 2023, 58(4): 903-912.
|
| [5] |
郑巧夺, 吴贞东, 邹俊颖. 基于双层CNN-BiGRU-CRF的事件因果关系抽取[J]. 计算机工程, 2021, 47(5): 58-64, 72.
Zheng Qiaoduo, Wu Zhendong, Zou Junying. Event causality extraction based on two-layer CNN-BiGRU-CRF[J]. Computer Engineering, 2021, 47(5): 58-64,72.
|
| [6] |
Tran Phu M, Nguyen T H. Graph convolutional networks for event causality identification with rich document-level structures[C]//Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg: Association for Computational Linguistics, 2021: 3480-3490.
|
| [7] |
Chen M Q, Cao Y X, Deng K Q, et al. ERGO: event relational graph transformer for document-level event causality identification[C]//Proceedings of the 29th International Conference on Computational Linguistics. Stroudsburg: Association for Computational Linguistics, 2022: 2118-2128.
|
| [8] |
Chen M Q, Cao Y X, Zhang Y, et al. CHEER: centrality-aware high-order event reasoning network for document-level event causality identification[C]// Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Stroudsburg: Association for Computational Linguistics, 2023: 10804-10816.
|
| [9] |
Liu Y, Jiang X X, Zhao W Z, et al. Dual graph convolutional networks for Document-level event causality identification[C]//Web and Big Data. Cham: Springer, 2023: 114-128.
|
| [10] |
Wu S F, Zhao R H, Zheng Y F, et al. Identify event causality with knowledge and analogy[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2023, 37(11): 13745-13753.
|
| [11] |
Gao L, Choubey P K, Huang R H. Modeling document-level causal structures for event causal relation identification[C]//Proceedings of the 2019 Conference of the North. Stroudsburg: Association for Computational Linguistics, 2019: 1808-1817.
|
| [12] |
Liu J, Chen Y B, Zhao J. Knowledge enhanced event causality identification with mention masking generalizations[C]//Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. Yokohama: International Joint Conferences on Artificial Intelligence Organization, 2020: 3608-3614.
|
| [13] |
Zuo X Y, Chen Y B, Liu K, et al. KnowDis: knowledge enhanced data augmentation for event causality detection via distant supervision[C]//Proceedings of the 28th International Conference on Computational Linguistics. Barcelona: International Committee on Computational Linguistics, 2020: 1544-1550.
|
| [14] |
Zuo X Y, Cao P F, Chen Y B, et al. Improving event causality identification via self-supervised representation learning on external causal statement[C]//Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021. Stroudsburg: Association for Computational Linguistics, 2021: 2162-2172.
|
| [15] |
Man H, Van Nguyen C, Ngo N T, et al. Hierarchical selection of important context for generative event causality identification with optimal transports[C]//Proceedings of the Language Resources and Evaluation Conference, 2024: 8122-8132.
|
| [16] |
Gao J L, Ding X, Qin B, et al. Is ChatGPT a good causal reasoner? a comprehensive evaluation[C]//Findings of the Association for Computational Linguistics: EMNLP 2023. Stroudsburg: Association for Computational Linguistics, 2023: 11111-11126.
|
| [17] |
Touvron H, Lavril T, Izacard G, et al. LLaMA: open and efficient foundation language models[PP/OL]. V1. arXiv (2023-02-27)[2024-06-10]. https://doi.org/10.48550/arXiv.2302.13971.
|
| [18] |
Beltagy I, Peters M E, Cohan A. Longformer: the long-document transformer[PP/OL]. V2. arXiv (2020-12-02)[2024-06-10]. https://doi.org/10.48550/arXiv.2004.05150.
|
| [19] |
Vaswani A, Vaswani A, Shazeer N, et al. Attention is all you need[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. New York: ACM, 2017: 6000-6010.
|
| [20] |
Caselli T, Vossen P. The event StoryLine corpus: a new benchmark for causal and TemporalRelation extraction[C]//Proceedings of the Events and Stories in the News Workshop. Stroudsburg: Association for Computational Linguistics, 2017: 77-86.
|
| [21] |
Mirza P, Sprugnoli R, Tonelli S, et al. Annotating causality in the TempEval-3 corpus[C]//Proceedings of the EACL 2014 Workshop on Computational Approaches to Causality in Language (CAtoCL). Gothenburg, Stroudsburg: Association for Computational Linguistics, 2014: 10-19.
|
| [22] |
Huang P X, Zhao X, Hu M H, et al. Distill, fuse, pre-train: towards effective event causality identification with commonsense-aware pre-trained model[C]//Proceedings of the Language Resources and Evaluation Conference, 2024: 5029-5040.
|
| [23] |
Chen M L, Yang W Z, Wei F Y, et al. Event causality identification via structure optimization and reinforcement learning[J]. Knowledge-Based Systems, 2024, 284: 111256.
|
| [24] |
Gao J L, Ding X, Li Z Y, et al. Event causality identification via competitive-cooperative cognition networks[J]. Knowledge-Based Systems, 2024, 300: 112139.
|
| [25] |
Devlin J, Chang M W, Lee K, et al. BERT: pre-training of deep bidirectional transformers for language understanding[C]//Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg: Association for Computational Linguistics, 2019: 4171-4186.
|
Figures(3) / Tables(8)
DownLoad:
