Logo PTI Logo rice

Proceedings of the 2022 Seventh International Conference on Research in Intelligent and Computing in Engineering

Annals of Computer Science and Information Systems, Volume 33

A Big Data Platform for Real-Time Video~Surveillance

, , , , ,

DOI: http://dx.doi.org/10.15439/2022R25

Citation: Proceedings of the 2022 Seventh International Conference on Research in Intelligent and Computing in Engineering, Vu Dinh Khoa, Shivani Agarwal, Gloria Jeanette Rincon Aponte, Nguyen Thi Hong Nga, Vijender Kumar Solanki, Ewa Ziemba (eds). ACSIS, Vol. 33, pages 95–101 ()

Full text

Abstract. Nowadays, smart house facilities are strongly developed with the support of multiple security cameras to protect not only a house but also a building. A large amount of video data is produced by these cameras every day. Therefore, traditional data management systems face challenges in collecting, storing, and analyzing big video data. In such systems, it is difficult to find objects and their actions from video surveillance in the building because of either the consuming time or the lack of intelligent technology support. In this paper, we propose a novel big data platform for real-time video surveillance analysis based on the combination of distributed data frameworks and intelligent video processing libraries. The proposed platform is able to collect both real-time video streams and historical video data by using Kafka and Spark Structured Streaming frameworks. Furthermore, the proposed platform provides an intelligent video processing module for object detection by using OpenCV, YOLO, and Keras libraries. To evaluate the proposal, we deploy the proposed big data platform and implement a web interface to support end-user to analyze video surveillance. Through the results of the initial video querying implementation, we show the viability of the proposed platform.

References

  1. Bunrong Leang et al. “Improvement of Kafka streaming using partition and multi-threading in big data environment”. In: Sensors 19.1 (2019), p. 134.
  2. Ayae Ichinose et al. “A study of a video analysis framework using Kafka and spark streaming”. In: 2017 IEEE International Conference on Big Data (Big Data). 2. IEEE. 2017, pp. 2396–2401.
  3. Kai Yu et al. “A large-scale distributed video parsing and evaluation platform”. In: Chinese Conference on Intelligent Visual Surveillance. 3. Springer. 2016, pp. 37–43.
  4. Mark Hamilton et al. “Flexible and scalable deep learning with MMLSpark”. In: International Conference on Predictive Applications and APIs. 4.
  5. Lei Huang et al. “Enabling versatile analysis of large scale traffic video data with deep learning and HiveQL”. In: 2017 IEEE International Conference on Big Data (Big Data). 5. IEEE. 2017, pp. 1153–1162.
  6. Seda Kul et al. “Event-based microservices with Apache Kafka streams: A real-time vehicle detection system based on type, color, and speed attributes”. In: IEEE Access 9.6 (2021), pp. 83137–83148.
  7. Md Azher Uddin et al. “SIAT: A distributed video analytics framework for intelligent video surveillance”. In: Symmetry 11.7 (2019), p. 911.
  8. Sadettin Melenli and Aylin Topkaya. “Real-time maintaining of social distance in covid-19 environment using image processing and big data”. In: The International Conference on Artificial Intelligence and Applied Mathematics in Engineering. 8. Springer. 2020, pp. 578–589.
  9. Lucy Linder et al. “Big building data-a big data platform for smart buildings”. In: Energy Procedia 122.10 (2017), pp. 589–594.
  10. Tom Wilcox et al. “A Big Data platform for smart meter data analytics”. In: Computers in Industry 105.11 (2019), pp. 250–259.
  11. Muhammad Syafrudin et al. “Performance analysis of IoT-based sensor, big data processing, and machine learning model for real-time monitoring system in automotive manufacturing”. In: Sensors 18.12 (2018), p. 2946.
  12. Weishan Zhang et al. “A video cloud platform combing online and offline cloud computing technologies”. In: Personal and Ubiquitous Computing 19.13 (2015), pp. 1099–1110.
  13. Jian Fu, Junwei Sun, and Kaiyuan Wang. “Spark–a big data processing platform for machine learning”. In: 2016 International Conference on Industrial Informatics-Computing Technology, Intelligent Technology, Industrial Information Integration (ICIICII). 16. IEEE. 2016, pp. 48–51.
  14. R Shyam et al. “Apache spark a big data analytics platform for smart grid”. In: Procedia Technology 21.17 (2015), pp. 171–178.
  15. Baojun Zhou et al. “Online internet traffic monitoring system using spark streaming”. In: Big Data Mining and Analytics 1.14 (2018), pp. 47–56.
  16. Jason Jinquan Dai et al. “Bigdl: A distributed deep learning framework for big data”. In: Proceedings of the ACM Symposium on Cloud Computing. 15. 2019, pp. 50–60.