Agent at the Edge: Opportunity and Challenges of Video Streaming Analytics at the CDN Edge
Reza Shokri Kalan, Seren Gul
DOI: http://dx.doi.org/10.15439/2024F1683
Citation: Proceedings of the 19th Conference on Computer Science and Intelligence Systems (FedCSIS), M. Bolanowski, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 39, pages 631–636 (2024)
Abstract. To provide high-quality streaming services to end users, streaming analytics applications need to process massive volumes of data promptly. Such applications suffer from high network transmission costs for transferring logs to a stream processor (cloud or on-premises), archiving, and computing costs for timely log analysis due to the volume, variety, and velocity of log data. This is especially important in live streaming, where millions of users play video simultaneously and consume network resources that are technically limited. A Distributed log analytic system can help to deal with this huge amount of data located at different locations and change rapidly. The advent of rich resources at the edge has enabled data processing close to the data source in a geo-distributed setup. Pushing log analytics closer to data sources is an effective strategy to reduce resource bottlenecks for the stream processor. This paper explores the benefits and drawbacks of deploying agents to analyze distributed logs, aiming to enhance the quality of video playback. Where increasing network and client diversity at the edge adds complexity to the task of processing live streams to end users situated across various networks and geographic locations. Furthermore, it introduces a mechanism to provide an abstract overview of the current streaming ecosystem resulting in better QoE.
References
- C. Yang, S. Lan, L. Wang, W. Shen, and G. G. Huang, “Big data driven edge-cloud collaboration architecture for cloud manufacturing: a software defined perspective,” IEEE access, vol. 8, 2020.
- A. Oroojlooy and D. Hajinezhad, “A review of cooperative multi-agent deep reinforcement learning,” Applied Intelligence, vol. 53, no. 11, 2023.
- R. S. Kalan, M. Sayit, and A. C. Begen, “Implementation of sand architecture using sdn,” in 2018 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN). IEEE, 2018, pp. 1–6.
- Q. Pu, G. Ananthanarayanan, P. Bodik, S. Kandula, A. Akella, P. Bahl, and I. Stoica, “Low latency geo-distributed data analytics,” ACM SIGCOMM Computer Communication Review, vol. 45, no. 4, 2015.
- A. Sandur, C. Park, S. Volos, G. Agha, and M. Jeon, “Streaming analytics with adaptive near-data processing,” in Companion Proceedings of the Web Conference 2022, 2022, pp. 563–566.
- B. Heintz, A. Chandra, and R. K. Sitaraman, “Optimizing timeliness and cost in geo-distributed streaming analytics,” IEEE Transactions on Cloud Computing, vol. 8, no. 1, pp. 232–245, 2017.
- C. Wang, Z. Lu, Z. Wu, J. Wu, and S. Huang, “Optimizing multi-cloud cdn deployment and scheduling strategies using big data analysis,” in 2017 IEEE (SCC). IEEE, 2017, pp. 273–280.
- C. Wang, S. Zhang, Y. Chen, Z. Qian, J. Wu, and M. Xiao, “Joint configuration adaptation and bandwidth allocation for edge-based real-time video analytics,” in IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2020, pp. 257–266.
- R. Bhardwaj, Z. Xia, G. Ananthanarayanan, J. Jiang, Y. Shu, N. Karianakis, K. Hsieh, P. Bahl, and I. Stoica, “Ekya: Continuous learning of video analytics models on edge compute servers,” in 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22), 2022, pp. 119–135.
- M. Zhang, F. Wang, and J. Liu, “Casva: Configuration-adaptive streaming for live video analytics,” in IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE, 2022, pp. 2168–2177.
- Y. Wang, W. Wang, D. Liu, X. Jin, J. Jiang, and K. Chen, “Enabling edge-cloud video analytics for robotics applications,” IEEE Transactions on Cloud Computing, 2022.
- R. S. Kalan, “Improving quality of http adaptive streaming with server and network-assisted dash,” in 2021 17th International Conference on Network and Service Management (CNSM). IEEE, 2021, pp. 244–248.