Logo PTI Logo FedCSIS

Proceedings of the 18th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 35

Mechanism for detecting cause-and-effect relationships in court judgments

DOI: http://dx.doi.org/10.15439/2023F4827

Citation: Proceedings of the 18th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 35, pages 10411046 ()

Full text

Abstract. Among the solutions for the detection of cause-and-effect relationships are methods based on knowledge, statistical solutions or methods allowing the use of deep learning. The solution presented in the article uses bidirectional artificial neural networks LSTM to detect such relationships in legal texts in Polish. The analysis was performed at the sentence level, but due to the specific legal language and the focus on Polish, two separated networks were used in the experiment. The task of the first one is to classify whether a sentence contains a~conditional, while the second one is to identify the elements of this relationship. Both use word embedding sets for the Polish language corpus. The results of the experiment prove that it is possible to perform such extraction with satisfactory results, and raise questions and point to further possible ways forward.

References

  1. Stanford Encyclopedia of Philosophy, Causal Models, 2022 https://plato.stanford.edu/entries/causal-models/
  2. E. Blanco, N. Castell, and D. Moldovan, Causal relation extraction, Proceedings of the Sixth International Conference on Language Resources and Evaluation, 2008, pp. 310
  3. Yang J, Han S. C. and Poon J. A survey on extraction of causal relations from natural language text, Knowledge and Information Systems 64, 2022, pp. 1161-1186, https://doi.org/10.48550/arXiv.2101.06426
  4. T. Dasgupta, R. Saha, L. Dey, and A. Naskar, Automatic Extraction of Causal Relations from Text using Linguistically Informed Deep Neural Networks, Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, Melbourne, Australia. Association for Computational Linguistics, 2018, pp. 306-316, http://dx.doi.org/10.18653/v1/W18-5035
  5. C. S. G. Khoo, J. Kornfilt, R. N. Oddy, and S. H. Myaeng, Automatic Extraction of Cause-Effect Information from Newspaper Text Without Knowledge-based Inferencing, Literary and Linguistic Computing, Volume 13, Issue 4, 1998, pp. 177–186, https://doi.org/10.1093/llc/13.4.177
  6. C. S. G. Khoo, S. Chan, and Y Niu, Extracting Causal Knowledge from a Medical Database Using Graphical Patterns, Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics, Hong Kong, Association for Computational Linguistics, 2000, pp. 336–343, http://dx.doi.org/10.3115/1075218.1075261
  7. R. Girju, D. Moldovan, Text Mining for Causal Relations, Proceedings of the Fifteenth International Florida Artificial Intelligence Research Society Conference, 2002, pp. 360–364
  8. R. Girju, Automatic Detection of Causal Relations for Question Answering, Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering, Association for Computational Linguistics, 203, pp. 76–83, http://dx.doi.org/10.3115/1119312.1119322
  9. Portal Orzeczeń Sądów Powszechnych, https://orzeczenia.ms.gov.pl/
  10. Wyrok.org — Największa baza wyroków w Polsce, https://wyrok.org/
  11. Centralna Baza Orzeczeń Sądów Administracyjnych, https://orzeczenia.nsa.gov.pl/
  12. Dziennik wyroków i ogłoszeń sądowych, https://www.ebos.pl/
  13. Beautiful Soup Python library, https://www.crummy.com/software/BeautifulSoup/bs4/doc/
  14. NLTK: Natural Language Toolkit, https://www.nltk.org
  15. H. Nakayama, T. Kubo, J. Kamura, Y. Taniguchi and X. Liang, Doccano: Text Annotation Tool for Human, 2018, https://github.com/doccano/doccano
  16. M. Abadi et al. TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems, 2015, https://doi.org/10.48550/arXiv.1603.04467
  17. A. Sorgente, G Vettigli, and F. Mele: Automatic extraction of cause-effect relations in Natural Language Text, Proceedings of the 7th International Workshop on Information Filtering and Retrieval co-located with the 13th Conference of the Italian Association for Artificial Intelligence, 2013, pp. 37–48
  18. S. Zhao, T. Liu, S. Zhao, Y. Chen, and J. Nie, Event causality extraction based on connectives analysis, Neurocomputing 173, 2016, pp. 1943–1950, https://doi.org/10.1016/j.neucom.2015.09.066
  19. Z. Li, Q. Li, X. Zou, and J. Ren, Causality Extraction based on Self-Attentive BiLSTM-CRF with Transferred Embeddings, Neurocomputing 423, 2021, pp. 209, https://arxiv.org/abs/1904.07629
  20. S. Zheng, F. Wang, H. Bao, Y. Hao, P. Zhou, and B. Xu, Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme, Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, 2017, pp. 1227–1236, http://dx.doi.org/10.18653/v1/P17-1113
  21. T. N. de Silva, X. Zhibo, Z. Rui, and M. Kezhi, Causal Relation Identification Using Convolutional Neural Networks and Knowledge Based Features, International Journal of Computer, Electrical, Automation, Control and Information Engineering 11 (6), 2017, pp. 697–702, https://doi.org/10.5281/zenodo.1130679
  22. C. Kruengkrai, K. Torisawa, C. Hashimoto, J. Kloetzer, J. H. Oh, and M. Tanaka, Improving Event Causality Recognition with Multiple Background Knowledge Sources Using Multi-Column Convolutional Neural Networks, Proceedings of the AAAI Conference on Artificial Intelligence 31(1), 2017, https://doi.org/10.1609/aaai.v31i1.11005
  23. J. Dunietz, J. Carbonell, and L. Levin, DeepCx: A transition-based approach for shallow semantic parsing with complex constructional triggers, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, 2018, pp. 1691–1701, http://dx.doi.org/10.18653/v1/D18-1196
  24. A. Akbik, D. Blythe, and R. Vollgraf, Contextual String Embeddings for Sequence Labeling, Proceedings of the 27th International Conference on Computational Linguistics, 2018, pp. 1638–1649
  25. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, Attention is All you Need, Advances in Neural Information Processing Systems 30, 2017, pp. 6000–6010, https://doi.org/10.48550/arXiv.1706.03762
  26. Z. Tan, M. Wang, J. Xie, Y. Chen, and X. Shi: Deep Semantic Role Labeling with Self-Attention, Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, 2018, https://doi.org/10.48550/arXiv.1712.01586
  27. A. Przepiórkowski, M. Bańko, R. L. Górski, and B. Lewandowska-Tomaszczyk, Narodowy Korpus Języka Polskiego, Wydawnictwo Naukowe PWN, Warsaw, 2012
  28. A. Mykowiecka, M. Marciniak, and P. Rychlik, Testing word embeddings for Polish, 2017, http://dsmodels.nlp.ipipan.waw.pl