Skip to main content
Top

2024 | OriginalPaper | Chapter

An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm

Authors : Wei Zhang, Lei Lei, Lijuan Zhang

Published in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This work studies the problem of dynamic coverage control of multiple Unmanned Aerial Vehicles (UAVs) in the 3 dimensional (3D) environment. In this work, an efficient multi-agent deep deterministic policy gradient-based dynamic surface coverage (MADDPG-DSC) algorithm is proposed. In MADDPG-DSC, a digital elevation-based surface area calculation method is introduced to effectively allocate the points of interest (PoIs). Next, a cooperative trajectory control policy with multi-agent deep deterministic policy gradient is developed to guide the UAVs. Comparing with existing works, MADDPG-DSC shows better performance in terms of larger coverage rate, higher connectivity and lower energy consumption.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liu, C.H., Chen, Z., Tang, J., Xu, J., Piao, C.: Energy-efficient UAV control for effective and fair communication coverage: a deep reinforcement learning approach. IEEE J. Sel. Areas Commun. 36(9), 2059–2070 (2018)CrossRef Liu, C.H., Chen, Z., Tang, J., Xu, J., Piao, C.: Energy-efficient UAV control for effective and fair communication coverage: a deep reinforcement learning approach. IEEE J. Sel. Areas Commun. 36(9), 2059–2070 (2018)CrossRef
2.
go back to reference Hanh, N.T., Binh, H.T.T., Hoai, N.X., Palaniswami, M.S.: An efficient genetic algorithm for maximizing area coverage in wireless sensor networks. Inf. Sci. 488, 58–75 (2019)MathSciNetCrossRef Hanh, N.T., Binh, H.T.T., Hoai, N.X., Palaniswami, M.S.: An efficient genetic algorithm for maximizing area coverage in wireless sensor networks. Inf. Sci. 488, 58–75 (2019)MathSciNetCrossRef
3.
go back to reference Din, A., Ismail, M.Y., Shah, B., Babar, M., Ali, F., Baig, S.U.: A deep reinforcement learning-based multi-agent area coverage control for smart agriculture. Comput. Electr. Eng. 101, 108089 (2022)CrossRef Din, A., Ismail, M.Y., Shah, B., Babar, M., Ali, F., Baig, S.U.: A deep reinforcement learning-based multi-agent area coverage control for smart agriculture. Comput. Electr. Eng. 101, 108089 (2022)CrossRef
4.
go back to reference Shakhatreh, H., Khreishah, A., Khalil, I.: Indoor mobile coverage problem using UAVs. IEEE Syst. J. 12(4), 3837–3848 (2018)CrossRef Shakhatreh, H., Khreishah, A., Khalil, I.: Indoor mobile coverage problem using UAVs. IEEE Syst. J. 12(4), 3837–3848 (2018)CrossRef
5.
go back to reference Bialas, J., Doller, M.:Coverage path planning for unmanned aerial vehicles in complex 3D environments with deep reinforcement learning. In: Proceedings 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), Jinghong, China, pp. 1080-1085 (2022) Bialas, J., Doller, M.:Coverage path planning for unmanned aerial vehicles in complex 3D environments with deep reinforcement learning. In: Proceedings 2022 IEEE International Conference on Robotics and Biomimetics (ROBIO), Jinghong, China, pp. 1080-1085 (2022)
6.
go back to reference Kimura, T., Ogura, M.: Distributed collaborative 3D-deployment of UAV base stations for on-demand coverage. In: Proceedings of IEEE INFOCOM 2020, Toronto, Canada, pp. 1748-1757 (2020) Kimura, T., Ogura, M.: Distributed collaborative 3D-deployment of UAV base stations for on-demand coverage. In: Proceedings of IEEE INFOCOM 2020, Toronto, Canada, pp. 1748-1757 (2020)
7.
go back to reference Mou, Z., Zhang, Y., Gao, F., Wang, H., Zhang, T., Han, Z.: Deep reinforcement learning based three-dimensional area coverage with UAV swarm. IEEE J. Sel. Areas Commun. 39(10), 3160–3176 (2021)CrossRef Mou, Z., Zhang, Y., Gao, F., Wang, H., Zhang, T., Han, Z.: Deep reinforcement learning based three-dimensional area coverage with UAV swarm. IEEE J. Sel. Areas Commun. 39(10), 3160–3176 (2021)CrossRef
8.
go back to reference Jenness, J.S.: Calculating landscape surface area from digital elevation models. Wildlife Soc. Bull. 32(3), 829–839 (2004)CrossRef Jenness, J.S.: Calculating landscape surface area from digital elevation models. Wildlife Soc. Bull. 32(3), 829–839 (2004)CrossRef
9.
go back to reference Abramowitz, M., Stegun, I.A.: Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, vol. 56, no. 10. Dover publications, New York (1988) Abramowitz, M., Stegun, I.A.: Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables, vol. 56, no. 10. Dover publications, New York (1988)
Metadata
Title
An Efficient Multi-agent Deep Deterministic Policy Gradient-Based 3D Dynamic Coverage Algorithm
Authors
Wei Zhang
Lei Lei
Lijuan Zhang
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_9

Premium Partner