Logo PTI
Polish Information Processing Society
Logo FedCSIS

Annals of Computer Science and Information Systems, Volume 15

Proceedings of the 2018 Federated Conference on Computer Science and Information Systems

A neural framework for online recognition of handwritten Kanji characters


DOI: http://dx.doi.org/10.15439/2018F140

Citation: Proceedings of the 2018 Federated Conference on Computer Science and Information Systems, M. Ganzha, L. Maciaszek, M. Paprzycki (eds). ACSIS, Vol. 15, pages 479483 ()

Full text

Abstract. The aim of this study is to propose an efficient and fast framework for recognition of Kanji characters working in a real-time during their writing. Previous research on online recognition of handwritten characters used a large dataset containing samples of characters written by many writers. Our study presents a solution that achieves fine results, using a small dataset containing a single sample for each Kanji character from only one writer. The proposed system analyses and classifies the stroke types appearing in a Kanji and then recognises it. For this purpose, we utilise a Convolutional Neural Network and a hierarchical dictionary containing Kanji definitions. Moreover, we compare the histograms of Kanjis to solve the problem of distinguishing character having the same number of strokes of the same type, but arranged in a different position in relation to each other. The proposed framework was validated experimentally on online handwritten Kanjis by beginners and advanced learners. Achieved accuracy up to 89\% indicates that it may be a valuable solution for learning Kanji by beginners.


  1. T. Morohashi, Dai Kan-Wa jiten. Tokyo : Taishukan Shoten, Showa 59-61, 1986.
  2. M. Nakai, N. Akira, H. Shimodaira, and S. Sagayama, “Substroke approach to hmm-based on-line kanji handwriting recognition,” in Proceedings of Sixth International Conference on Document Analysis and Recognition, 2001, pp. 491–495. [Online]. Available: http://dx.doi.org/10.1109/ICDAR.2001.953838
  3. M. Nakai, T. Sudo, H. Shimodaira, and S. Sagayama, “Pen pressure features for writer-independent on-line handwriting recognition based on substroke hmm,” in Object recognition supported by user interaction for service robots, vol. 3, 2002, pp. 220–223. [Online]. Available: http://dx.doi.org/10.1109/ICPR.2002.1047834
  4. J. Tokuno, M. Nakai, H. Shimodaira, S. Sagayama, and M. Nakagawa, “On-line Handwritten Character Recognition Selectively Employing Hierarchical Spatial Relationships among Subpatterns,” in Tenth International Workshop on Frontiers in Handwriting Recognition, G. Lorette, Ed., Université de Rennes 1. La Baule (France): Suvisoft, Oct. 2006, http://www.suvisoft.com. [Online]. Available: https://hal.inria.fr/inria-00104751
  5. I. Ota, R. Yamamoto, S. Sako, and S. Sagayama, “Online handwritten kanji recognition based on inter-stroke grammar,” in Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), vol. 2, Sept 2007, pp. 1188–1192. [Online]. Available: http://dx.doi.org/10.1109/ICDAR.2007.4377103
  6. M. Nakagawa, J. Tokuno, B. Zhu, M. Onuma, H. Oda, and A. Kitadai, “Recent results of online japanese handwriting recognition and its applications,” in Arabic and Chinese Handwriting Recognition, D. Doermann and S. Jaeger, Eds. Berlin, Heidelberg: Springer Berlin Heidelberg, 2008, pp. 170–195.
  7. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” CoRR, vol. abs/1409.1556, 2014. [Online]. Available: http://arxiv.org/abs/1409.1556
  8. C. Tsai, “Recognizing handwritten japanese characters using deep convolutional neural networks,” 2015.
  9. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems 25, F. Pereira, C. J. C. Burges, L. Bottou, and K. Q. Weinberger, Eds. Curran Associates, Inc., 2012, pp. 1097–1105. [Online]. Available: http://dx.doi.org/10.1145/3065386
  10. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” CoRR, vol. abs/1412.6980, 2014. [Online]. Available: http://arxiv.org/abs/1412.6980
  11. X. Glorot and Y. Bengio, “Understanding the difficulty of training deep feedforward neural networks,” in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, ser. Proceedings of Machine Learning Research, Y. W. Teh and M. Titterington, Eds., vol. 9. Chia Laguna Resort, Sardinia, Italy: PMLR, 13–15 May 2010, pp. 249–256. [Online]. Available: http://dx.doi.org/