Logo PTI Logo FedCSIS

Position Papers of the 19th Conference on Computer Science and Intelligence Systems

Annals of Computer Science and Information Systems, Volume 40

Optimal Charge Scheduling and Navigation for Multiple EV Using Deep Reinforcement Learning and Whale Optimization

,

DOI: http://dx.doi.org/10.15439/2024F905

Citation: Position Papers of the 19th Conference on Computer Science and Intelligence Systems, M. Bolanowski, M. Ganzha, L. Maciaszek, M. Paprzycki, D. Ślęzak (eds). ACSIS, Vol. 40, pages 55–60 ()

Full text

Abstract. The demand for Electric Vehicles (EVs) is increasing exponentially in recent times because of its ability to minimize energy savings and carbon emission. However, the charging process and charging option increases the challenges for EV adoption. With the growing adaptability to EVs, the need for addressing the challenges related to limited range and the availability of charging infrastructure becomes crucial. This paper presents an optimized deep learning-based charge scheduling approach in EVs for intelligent transport systems. The study leverages the Deep Reinforcement Learning (DRL) for making real-time decisions. The DRL model is trained using various features such as Battery critical percentage (SOC), time slots, nearest charge station, and availability of charging station. The features are optimized using a nature inspired Whale Optimization Algorithm (WOA), which helps in obtaining optimal charge scheduling. The proposed approach is experimentally evaluated in terms of reducing the tow counts in the selected region. Results from the experimental analysis validate the efficacy of the proposed approach in achieving optimal charge scheduling and navigation for EVs which also improve energy efficiency and reduce charging costs and charging time.

References

  1. Fescioglu-Unver, N., & Aktaş, M. Y. (2023). Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing. Renewable and Sustainable Energy Reviews, 188, 113873.
  2. Shahriar, S., Al-Ali, A. R., Osman, A. H., Dhou, S., & Nijim, M. (2020). Machine learning approaches for EV charging behavior: A review. IEEE Access, 8, 168980-168993.
  3. Yang, H., Deng, Y., Qiu, J., Li, M., Lai, M., & Dong, Z. Y. (2017). Electric vehicle route selection and charging navigation strategy based on crowd sensing. IEEE Transactions on Industrial Informatics, 13(5), 2214-2226.
  4. Zhang, X., Peng, L., Cao, Y., Liu, S., Zhou, H., & Huang, K. (2020). Towards holistic charging management for urban electric taxi via a hybrid deployment of battery charging and swap stations. Renewable Energy, 155, 703-716.
  5. Yan, L., Chen, X., Zhou, J., Chen, Y., & Wen, J. (2021). Deep reinforcement learning for continuous electric vehicles charging control with dynamic user behaviors. IEEE Transactions on Smart Grid, 12(6), 5124-5134.
  6. Rezgui, J., & Cherkaoui, S. (2017, May). Smart charge scheduling for evs based on two-way communication. In 2017 IEEE International Conference on Communications (ICC) (pp. 1-6). IEEE.
  7. Nimalsiri, N. I., Ratnam, E. L., Smith, D. B., Mediwaththe, C. P., & Halgamuge, S. K. (2021). Coordinated charge and discharge scheduling of electric vehicles for load curve shaping. IEEE Transactions on Intelligent Transportation Systems, 23(7), 7653-7665.
  8. Chung, H. M., Li, W. T., Yuen, C., Wen, C. K., & Crespi, N. (2018). Electric vehicle charge scheduling mechanism to maximize cost efficiency and user convenience. IEEE Transactions on Smart Grid, 10(3), 3020-3030.
  9. Lee, K. B., A. Ahmed, M., Kang, D. K., & Kim, Y. C. (2020). Deep reinforcement learning based optimal route and charging station selection. Energies, 13(23), 6255.
  10. Luo, L., Gu, W., Wu, Z., & Zhou, S. (2019). Joint planning of distributed generation and electric vehicle charging stations considering real-time charging navigation. Applied energy, 242, 1274-1284.
  11. Xia, F., Chen, H., Chen, L., & Qin, X. (2019). A hierarchical navigation strategy of EV fast charging based on dynamic scene. IEEE Access, 7, 29173-29184.
  12. Mo, W., Yang, C., Chen, X., Lin, K., & Duan, S. (2019). Optimal charging navigation strategy design for rapid charging electric vehicles. Energies, 12(6), 962.
  13. Mazhar, T., Asif, R. N., Malik, M. A., Nadeem, M. A., Haq, I., Iqbal, M., ... & Ashraf, S. (2023). Electric Vehicle Charging System in the Smart Grid Using Different Machine Learning Methods. Sustainability, 15(3), 2603.
  14. Panda, B., Rajabi, M. S., & Rajaee, A. (2022). Applications of Machine Learning in the Planning of Electric Vehicle Charging Stations and Charging Infrastructure: A Review. Handbook of Smart Energy Systems, 1-19.
  15. 15. Song, Y., Zhao, H., Luo, R., Huang, L., Zhang, Y., & Su, R. (2022). A sumo framework for deep reinforcement learning experiments solving electric vehicle charging dispatching problem. arXiv preprint https://arxiv.org/abs/2209.02921.
  16. 16. Zhang, X., Chan, K. W., Li, H., Wang, H., Qiu, J., & Wang, G. (2020). Deep-learning-based probabilistic forecasting of electric vehicle charging load with a novel queuing model. IEEE transactions on cybernetics, 51(6), 3157-3170.
  17. 17. Wang, R., Chen, Z., Xing, Q., Zhang, Z., & Zhang, T. (2022). A modified rainbow-based deep reinforcement learning method for optimal scheduling of charging station. Sustainability, 14(3), 1884.
  18. 18. Venkitaraman, A. K., & Kosuru, V. S. R. (2023). Hybrid deep learning mechanism for charging control and management of Electric Vehicles. European Journal of Electrical Engineering and Computer Science, 7(1), 38-46.
  19. 19. Wang, K., Wang, H., Yang, J., Feng, J., Li, Y., Zhang, S., & Okoye, M. O. (2022). Electric vehicle clusters scheduling strategy considering real-time electricity prices based on deep reinforcement learning. Energy Reports, 8, 695-703.
  20. 20. Zhang, C., Liu, Y., Wu, F., Tang, B., & Fan, W. (2020). Effective charging planning based on deep reinforcement learning for electric vehicles. IEEE Transactions on Intelligent Transportation Systems, 22(1), 542-554.
  21. 21. Wan, Z., Li, H., He, H., & Prokhorov, D. (2018). Model-free real-time EV charging scheduling based on deep reinforcement learning. IEEE Transactions on Smart Grid, 10(5), 5246-5257.
  22. 22. Sadeghianpourhamami, N., Deleu, J., & Develder, C. (2019). Definition and evaluation of model-free coordination of electrical vehicle charging with reinforcement learning. IEEE Transactions on Smart Grid, 11(1), 203-214.
  23. 23. Qian, T., Shao, C., Wang, X., & Shahidehpour, M. (2019). Deep reinforcement learning for EV charging navigation by coordinating smart grid and intelligent transportation system. IEEE transactions on smart grid, 11(2), 1714-1723.