Skip to main content

2024 | OriginalPaper | Buchkapitel

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

verfasst von : Wei Zhang, Lei Lei, Lijuan Zhang

Erschienen in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Liu, C.H., Chen, Z., Tang, J., Xu, J., Piao, C.: Energy-efficient UAV control for effective and fair communication coverage: a deep reinforcement learning approach. IEEE J. Sel. Areas Commun. 36(9), 2059–2070 (2018)CrossRef Liu, C.H., Chen, Z., Tang, J., Xu, J., Piao, C.: Energy-efficient UAV control for effective and fair communication coverage: a deep reinforcement learning approach. IEEE J. Sel. Areas Commun. 36(9), 2059–2070 (2018)CrossRef
2.
Zurück zum Zitat Hanh, N.T., Binh, H.T.T., Hoai, N.X., Palaniswami, M.S.: An efficient genetic algorithm for maximizing area coverage in wireless sensor networks. Inf. Sci. 488, 58–75 (2019)MathSciNetCrossRef Hanh, N.T., Binh, H.T.T., Hoai, N.X., Palaniswami, M.S.: An efficient genetic algorithm for maximizing area coverage in wireless sensor networks. Inf. Sci. 488, 58–75 (2019)MathSciNetCrossRef
3.
Zurück zum Zitat Din, A., Ismail, M.Y., Shah, B., Babar, M., Ali, F., Baig, S.U.: A deep reinforcement learning-based multi-agent area coverage control for smart agriculture. Comput. Electr. Eng. 101, 108089 (2022)CrossRef Din, A., Ismail, M.Y., Shah, B., Babar, M., Ali, F., Baig, S.U.: A deep reinforcement learning-based multi-agent area coverage control for smart agriculture. Comput. Electr. Eng. 101, 108089 (2022)CrossRef
4.
Zurück zum Zitat Shakhatreh, H., Khreishah, A., Khalil, I.: Indoor mobile coverage problem using UAVs. IEEE Syst. J. 12(4), 3837–3848 (2018)CrossRef Shakhatreh, H., Khreishah, A., Khalil, I.: Indoor mobile coverage problem using UAVs. IEEE Syst. J. 12(4), 3837–3848 (2018)CrossRef
5.
Zurück zum Zitat Bialas, J., Doller, M.:Coverage path planning for unmanned aerial vehicles in complex 3D environments with deep reinforcement learning. In: Proceedings 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), Jinghong, China, pp. 1080-1085 (2022) Bialas, J., Doller, M.:Coverage path planning for unmanned aerial vehicles in complex 3D environments with deep reinforcement learning. In: Proceedings 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), Jinghong, China, pp. 1080-1085 (2022)
6.
Zurück zum Zitat Kimura, T., Ogura, M.: Distributed collaborative 3D-deployment of UAV base stations for on-demand coverage. In: Proceedings of IEEE INFOCOM 2020, Toronto, Canada, pp. 1748-1757 (2020) Kimura, T., Ogura, M.: Distributed collaborative 3D-deployment of UAV base stations for on-demand coverage. In: Proceedings of IEEE INFOCOM 2020, Toronto, Canada, pp. 1748-1757 (2020)
7.
Zurück zum Zitat Mou, Z., Zhang, Y., Gao, F., Wang, H., Zhang, T., Han, Z.: Deep reinforcement learning based three-dimensional area coverage with UAV swarm. IEEE J. Sel. Areas Commun. 39(10), 3160–3176 (2021)CrossRef Mou, Z., Zhang, Y., Gao, F., Wang, H., Zhang, T., Han, Z.: Deep reinforcement learning based three-dimensional area coverage with UAV swarm. IEEE J. Sel. Areas Commun. 39(10), 3160–3176 (2021)CrossRef
8.
Zurück zum Zitat Jenness, J.S.: Calculating landscape surface area from digital elevation models. Wildlife Soc. Bull. 32(3), 829–839 (2004)CrossRef Jenness, J.S.: Calculating landscape surface area from digital elevation models. Wildlife Soc. Bull. 32(3), 829–839 (2004)CrossRef
9.
Zurück zum Zitat Abramowitz, M., Stegun, I.A.: Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, vol. 56, no. 10. Dover publications, New York (1988) Abramowitz, M., Stegun, I.A.: Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, vol. 56, no. 10. Dover publications, New York (1988)
Metadaten
Titel
An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm
verfasst von
Wei Zhang
Lei Lei
Lijuan Zhang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_9

Premium Partner