Skip to main content

2024 | OriginalPaper | Buchkapitel

Multi-agent Reinforcement Learning for Online Placement of Mobile EV Charging Stations

verfasst von : Lo Pang-Yun Ting, Chi-Chun Lin, Shih-Hsun Lin, Yu-Lin Chu, Kun-Ta Chuang

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As global interest shifts toward sustainable transportation with the proliferation of electric vehicles (EVs), the demand for an efficient, real-time, and robust charging infrastructure becomes increasingly pronounced. This paper introduces an approach to address the imbalance between the surging EV demand and the existing charging infrastructure: the concept of Mobile Charging Stations (MCSs). The research develops an algorithm for the dynamic placement of MCSs to significantly reduce the waiting time for EV owners. The core of this research is the Two-stage Placement and Management with Multi-Agent Reinforcement Learning (2PM-MARL) for a dynamic balancing of charging demand and supply. The complexity of the problem is elaborated by showing the NP-hard nature of the MCS placement issue through a relation to the Uncapacitated Facility Location Problem (UFLP), underscoring the computational challenges and emphasizing the need for intelligent real-time solutions. Our framework is validated through comprehensive experiments using real-world charging session data. The results exhibit significant reductions in the waiting time, suggesting the potential practicality and efficiency of our proposed model.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Afshar, S., Disfani, V.R.: Optimal scheduling of electric vehicles in the presence of mobile charging stations. In: IEEE PESGM (2022) Afshar, S., Disfani, V.R.: Optimal scheduling of electric vehicles in the presence of mobile charging stations. In: IEEE PESGM (2022)
4.
Zurück zum Zitat Elghitani, F., El-Saadany, E.F.: Efficient assignment of electric vehicles to charging stations. IEEE Trans. Smart Grid 12, 761–773 (2021)CrossRef Elghitani, F., El-Saadany, E.F.: Efficient assignment of electric vehicles to charging stations. IEEE Trans. Smart Grid 12, 761–773 (2021)CrossRef
5.
Zurück zum Zitat Hardman, S., et al.: A review of consumer preferences of and interactions with electric vehicle charging infrastructure. Transp. Res. Part D: Transp. Environ. 62, 508–523 (2018)CrossRef Hardman, S., et al.: A review of consumer preferences of and interactions with electric vehicle charging infrastructure. Transp. Res. Part D: Transp. Environ. 62, 508–523 (2018)CrossRef
6.
Zurück zum Zitat Hussain, S., Kim, Y.S., Thakur, S., Breslin, J.G.: Optimization of waiting time for electric vehicles using a fuzzy inference system. IEEE T-ITS 23, 15396–15407 (2022) Hussain, S., Kim, Y.S., Thakur, S., Breslin, J.G.: Optimization of waiting time for electric vehicles using a fuzzy inference system. IEEE T-ITS 23, 15396–15407 (2022)
8.
Zurück zum Zitat Lee, K.B., Ahmed, M.A., Kang, D.K., Kim, Y.C.: Deep reinforcement learning based optimal route and charging station selection. Energies 13, 6255 (2020)CrossRef Lee, K.B., Ahmed, M.A., Kang, D.K., Kim, Y.C.: Deep reinforcement learning based optimal route and charging station selection. Energies 13, 6255 (2020)CrossRef
9.
Zurück zum Zitat Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient large-scale fleet management via multi-agent deep reinforcement learning. In: ACM SIGKDD (2018) Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient large-scale fleet management via multi-agent deep reinforcement learning. In: ACM SIGKDD (2018)
10.
Zurück zum Zitat Liu, L., Xi, Z., Zhu, K., Wang, R., Hossain, E.: Mobile charging station placements in internet of electric vehicles: a federated learning approach. IEEE T-ITS 23, 24561–24577 (2022) Liu, L., Xi, Z., Zhu, K., Wang, R., Hossain, E.: Mobile charging station placements in internet of electric vehicles: a federated learning approach. IEEE T-ITS 23, 24561–24577 (2022)
11.
Zurück zum Zitat Liu, Q., Zeng, Y., Chen, L., Zheng, X.: Social-aware optimal electric vehicle charger deployment on road network. In: ACM SIGSPATIAL (2019) Liu, Q., Zeng, Y., Chen, L., Zheng, X.: Social-aware optimal electric vehicle charger deployment on road network. In: ACM SIGSPATIAL (2019)
12.
Zurück zum Zitat Moradipari, A., Alizadeh, M.: Pricing and routing mechanisms for differentiated services in an electric vehicle public charging station network. IEEE Trans. Smart Grid 11, 1489–1499 (2019)CrossRef Moradipari, A., Alizadeh, M.: Pricing and routing mechanisms for differentiated services in an electric vehicle public charging station network. IEEE Trans. Smart Grid 11, 1489–1499 (2019)CrossRef
13.
Zurück zum Zitat Sadeghianpourhamami, N., Deleu, J., Develder, C.: Definition and evaluation of model-free coordination of electrical vehicle charging with reinforcement learning. IEEE Trans. Smart Grid 11, 203–214 (2018)CrossRef Sadeghianpourhamami, N., Deleu, J., Develder, C.: Definition and evaluation of model-free coordination of electrical vehicle charging with reinforcement learning. IEEE Trans. Smart Grid 11, 203–214 (2018)CrossRef
14.
Zurück zum Zitat Sadreddini, Z., Guner, S., Erdinç, O.: Design of a decision-based multicriteria reservation system for the EV parking lot. IEEE TTE 7, 2429–2438 (2021) Sadreddini, Z., Guner, S., Erdinç, O.: Design of a decision-based multicriteria reservation system for the EV parking lot. IEEE TTE 7, 2429–2438 (2021)
16.
Zurück zum Zitat Tang, X., et al.: Value function is all you need: a unified learning framework for ride hailing platforms. In: ACM SIGKDD (2021) Tang, X., et al.: Value function is all you need: a unified learning framework for ride hailing platforms. In: ACM SIGKDD (2021)
17.
Zurück zum Zitat Ting, L.P.Y., Wu, P.H., Chung, H.Y., Chuang, K.T.: An incentive dispatch algorithm for utilization-perfect EV charging management. In: Gama, J., Li, T., Yu, Y., Chen, E., Zheng, Y., Teng, F. (eds.) Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science(), vol. 13282, pp. 132–146. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-05981-0_11CrossRef Ting, L.P.Y., Wu, P.H., Chung, H.Y., Chuang, K.T.: An incentive dispatch algorithm for utilization-perfect EV charging management. In: Gama, J., Li, T., Yu, Y., Chen, E., Zheng, Y., Teng, F. (eds.) Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science(), vol. 13282, pp. 132–146. Springer, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-05981-0_​11CrossRef
18.
Zurück zum Zitat von Wahl, L., Tempelmeier, N., Sao, A., Demidova, E.: Reinforcement learning-based placement of charging stations in urban road networks. In: ACM SIGKDD (2022) von Wahl, L., Tempelmeier, N., Sao, A., Demidova, E.: Reinforcement learning-based placement of charging stations in urban road networks. In: ACM SIGKDD (2022)
19.
Zurück zum Zitat Yan, L., Shen, H., Kang, L., Zhao, J., Xu, C.: Reinforcement learning based scheduling for cooperative EV-to-EV dynamic wireless charging. In: IEEE MASS (2020) Yan, L., Shen, H., Kang, L., Zhao, J., Xu, C.: Reinforcement learning based scheduling for cooperative EV-to-EV dynamic wireless charging. In: IEEE MASS (2020)
20.
Zurück zum Zitat Zheng, B., et al.: Soup: spatial-temporal demand forecasting and competitive supply in transportation. IEEE TKDE 35, 2034–2047 (2023) Zheng, B., et al.: Soup: spatial-temporal demand forecasting and competitive supply in transportation. IEEE TKDE 35, 2034–2047 (2023)
Metadaten
Titel
Multi-agent Reinforcement Learning for Online Placement of Mobile EV Charging Stations
verfasst von
Lo Pang-Yun Ting
Chi-Chun Lin
Shih-Hsun Lin
Yu-Lin Chu
Kun-Ta Chuang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2262-4_23

Premium Partner