Logo PTI Logo FedCSIS

Proceedings of the 17th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 30

Encoder-Decoder Neural Network with Attention Mechanism for Types Detection in Linked Data


DOI: http://dx.doi.org/10.15439/2022F209

Citation: Proceedings of the 17th Conference on Computer Science and Intelligence Systems, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 30, pages 733739 ()

Full text

Abstract. With the emergence of use of Linked Data in different application domains, several problems have arisen, such as data incompleteness. Type detection for entities in RDFdata is one of the most important tasks in dealing with the incompleteness of Linked Data. In this paper, we propose an approach based on Deep Learning techniques, using an encoder-decoder model with attention mechanism, embedding layer to extract the features of each subject from the RDF triples and the GRU cells to address the problem of vanishing. We use the DBpedia dataset for the training and test phases. Initial test results showed the effectiveness of our model.


  1. P. Ristoski and H. Paulheim, “Semantic web in data mining and knowledge discovery: A comprehensive survey,” Journal of Web Semantics, vol. 36, pp. 1–22, 2016.
  2. M. Mountantonakis and Y. Tzitzikas, “Large-scale semantic integration of linked data: A survey,” ACM Computing Surveys (CSUR), vol. 52, no. 5, pp. 1–40, 2019.
  3. R. A. Fiorini, “Computational intelligence from autonomous system to super-smart society and beyond,” International Journal of Software Science and Computational Intelligence (IJSSCI), vol. 12, no. 3, pp. 1–13, 2020.
  4. C. Bizer, T. Heath, and T. Berners-Lee, “Linked data: The story so far,” in Semantic services, interoperability and web applications: emerging concepts, pp. 205–227, IGI global, 2011.
  5. T. Berners-Lee, “Linked data - design issues.” http://www.w3.org/DesignIssues/LinkedData.html, 2006. Accessed: 2022-05-09.
  6. K. J. Laskey and K. B. Laskey, “Uncertainty reasoning for the world wide web: Report on the urw3-xg incubator group.,” URSW, vol. 8, pp. 108–116, 2008.
  7. X. Sumba and J. Ortiz, “Between the interaction of graph neural networks and semantic web,” in Proceedings of the 2019 NeurIPS Workshop on Graph Representation Learning, 2019.
  8. C. Wilcox, S. Djahel, and V. Giagos, “Identifying the main causes of medical data incompleteness in the smart healthcare era,” in 2021 International Symposium on Networks, Computers and Communications (ISNCC), pp. 1–6, IEEE, 2021.
  9. H. Paulheim and C. Bizer, “Type inference on noisy rdf data,” in International semantic web conference, pp. 510–525, Springer, 2013.
  10. T. Kliegr and O. Zamazal, “Lhd 2.0: A text mining approach to typing entities in knowledge graphs,” Journal of Web Semantics, vol. 39, pp. 47–61, 2016.
  11. R. Biswas, R. Sofronova, M. Alam, and H. Sack, “Entity type prediction in knowledge graphs using embeddings,” arXiv preprint https://arxiv.org/abs/2004.13702, 2020.
  12. M. Barati, Q. Bai, and Q. Liu, “An entropy-based class assignment detection approach for rdf data,” in Pacific rim international conference on artificial intelligence, pp. 412–420, Springer, 2018.
  13. Y. Nechaev, F. Corcoglioniti, and C. Giuliano, “Type prediction combining linked open data and social media,” in Proceedings of the 27th ACM International Conference on Information and Knowledge Management, pp. 1033–1042, 2018.
  14. R. Biswas, R. Türker, F. B. Moghaddam, M. Koutraki, and H. Sack, “Wikipedia infobox type prediction using embeddings.,” in DL4KGS@ESWC, pp. 46–55, 2018.
  15. N. Mihindukulasooriya and M. Rico, “Type prediction of rdf knowledge graphs using binary classifiers with structural data,” in International Conference on Web Engineering, pp. 279–287, Springer, 2018.
  16. X. Zhang, E. Lin, and S. Pi, “Predicting object types in linked data by text classification,” in 2017 Fifth International Conference on Advanced Cloud and Big Data (CBD), pp. 391–396, IEEE, 2017.
  17. H. Jin, C. Li, J. Zhang, L. Hou, J. Li, and P. Zhang, “Xlore2: large-scale cross-lingual knowledge graph construction and application,” Data Intelligence, vol. 1, no. 1, pp. 77–98, 2019.
  18. M.-L. Zhang and Z.-H. Zhou, “A review on multi-label learning algorithms,” IEEE transactions on knowledge and data engineering, vol. 26, no. 8, pp. 1819–1837, 2013.
  19. J. Du, Q. Chen, Y. Peng, Y. Xiang, C. Tao, and Z. Lu, “Ml-net: multilabel classification of biomedical texts with deep neural networks,” Journal of the American Medical Informatics Association, vol. 26, no. 11, pp. 1279–1285, 2019.