Skip to main content

2024 | OriginalPaper | Buchkapitel

Deep Reinforcement Learning Based Secure Communication and Computing Resource Allocation for Grid Cyber-Physical System

verfasst von : Qiangqiang Sun, Gengxiong Lian, Zhiwei Cao, Xiangsheng Zeng, Zhiyao Lv, Lei Liu, Ying Ju, Tong-Xing Zheng

Erschienen in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Grid Cyber-Physical System (CPS) improves the intelligence of the grid by combining computing, communication and control technologies, but this new grid CPS system may also have some new security risks, such as new types of attacks on the connection between the physical and information networks. In this paper, we propose a deep reinforcement learning-based joint optimization scheme to improve the security and resource efficiency of multiple grid sensors by exploiting physical layer security (PLS) techniques in a scenario where a malicious eavesdropper can wiretap confidential grid information. We use Wyner’s wiretap coding scheme to prevent confidential information from being decoded and eavesdropped by malicious eavesdroppers. We minimize the system processing latency while securing the wireless communication process by jointly optimizing the transmit power of the grid sensor and the allocation of computing resource blocks. The optimization problem in this paper is formulated as a multi-agent cooperative optimal decision problem and is solved using a double deep Q-network algorithm. Simulation results demonstrate the robustness and effectiveness of the scheme in ensuring information security and reducing delay.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat He, R., Xie, H., Deng, J., Feng, T., Lai, L.L., Shahidehpour, M.: Reliability modeling and assessment of cyber space in cyber-physical power systems. IEEE Trans. Smart Grid 11(5), 3763–3773 (2020)CrossRef He, R., Xie, H., Deng, J., Feng, T., Lai, L.L., Shahidehpour, M.: Reliability modeling and assessment of cyber space in cyber-physical power systems. IEEE Trans. Smart Grid 11(5), 3763–3773 (2020)CrossRef
2.
Zurück zum Zitat Xu, L., Guo, Q., Wang, Z., Sun, H.: Modeling of time-delayed distributed cyber-physical power systems for small-signal stability analysis. IEEE Trans. Smart Grid 12(4), 3425–3437 (2021)CrossRef Xu, L., Guo, Q., Wang, Z., Sun, H.: Modeling of time-delayed distributed cyber-physical power systems for small-signal stability analysis. IEEE Trans. Smart Grid 12(4), 3425–3437 (2021)CrossRef
3.
Zurück zum Zitat Tian, M., Dong, Z., Gong, L., Wang, X.: Coordinated repair crew dispatch problem for cyber–physical distribution system. IEEE Trans. Smart Grid. 14(3), 2288–2300 (2023) Tian, M., Dong, Z., Gong, L., Wang, X.: Coordinated repair crew dispatch problem for cyber–physical distribution system. IEEE Trans. Smart Grid. 14(3), 2288–2300 (2023)
4.
Zurück zum Zitat Liu, Z., Wang, L.: Leveraging network topology optimization to strengthen power grid resilience against cyber-physical attacks. IEEE Trans. Smart Grid 12(2), 1552–1564 (2021)CrossRef Liu, Z., Wang, L.: Leveraging network topology optimization to strengthen power grid resilience against cyber-physical attacks. IEEE Trans. Smart Grid 12(2), 1552–1564 (2021)CrossRef
5.
Zurück zum Zitat Brecht, B., et al.: A security credential management system for V2X communications. IEEE Trans. Intell. Transp. Syst. 19(12), 3850–3871 (2018)CrossRef Brecht, B., et al.: A security credential management system for V2X communications. IEEE Trans. Intell. Transp. Syst. 19(12), 3850–3871 (2018)CrossRef
6.
Zurück zum Zitat Liu, Y., et al.: Physical layer security assisted computation offloading in intelligently connected vehicle networks. IEEE Trans. Wirel. Commun. 20(6), 3555–3570 (2021)CrossRef Liu, Y., et al.: Physical layer security assisted computation offloading in intelligently connected vehicle networks. IEEE Trans. Wirel. Commun. 20(6), 3555–3570 (2021)CrossRef
7.
Zurück zum Zitat He, X., Jin, R., Dai, H.: Physical-layer assisted privacy-preserving offloading in mobile-edge computing. In: ICC 2019 - 2019 IEEE International Conference on Communications (ICC), pp. 1–6. Shanghai, China (2019) He, X., Jin, R., Dai, H.: Physical-layer assisted privacy-preserving offloading in mobile-edge computing. In: ICC 2019 - 2019 IEEE International Conference on Communications (ICC), pp. 1–6. Shanghai, China (2019)
8.
Zurück zum Zitat Ju, Y., et al.: Joint secure offloading and resource allocation for vehicular edge computing network: a multi-agent deep reinforcement learning approach. IEEE Trans. Intell. Transp. Syst. 24(5), 5555–5569 (2023)CrossRef Ju, Y., et al.: Joint secure offloading and resource allocation for vehicular edge computing network: a multi-agent deep reinforcement learning approach. IEEE Trans. Intell. Transp. Syst. 24(5), 5555–5569 (2023)CrossRef
9.
Zurück zum Zitat Zhao, T., He, L., Huang, X., Li, F.: DRL-based secure video offloading in MEC-enabled IoT networks. IEEE Internet Things J. 9(19), 18710–18724 (2022)CrossRef Zhao, T., He, L., Huang, X., Li, F.: DRL-based secure video offloading in MEC-enabled IoT networks. IEEE Internet Things J. 9(19), 18710–18724 (2022)CrossRef
10.
Zurück zum Zitat Zheng, K., Jiang, G., Liu, X., Chi, K., Yao, X., Liu, J.: DRL-based offloading for computation delay minimization in wireless-powered multi-access edge computing. IEEE Trans. Commun. 71(3), 1755–1770 (2023)CrossRef Zheng, K., Jiang, G., Liu, X., Chi, K., Yao, X., Liu, J.: DRL-based offloading for computation delay minimization in wireless-powered multi-access edge computing. IEEE Trans. Commun. 71(3), 1755–1770 (2023)CrossRef
11.
Zurück zum Zitat Sha, D., Zhao, R.: DRL–based task offloading and resource allocation in multi–UAV–MEC network with SDN. In: 2021 IEEE/CIC International Conference on Communications in China (ICCC), pp. 595–600. Xiamen, China (2021) Sha, D., Zhao, R.: DRL–based task offloading and resource allocation in multi–UAV–MEC network with SDN. In: 2021 IEEE/CIC International Conference on Communications in China (ICCC), pp. 595–600. Xiamen, China (2021)
Metadaten
Titel
Deep Reinforcement Learning Based Secure Communication and Computing Resource Allocation for Grid Cyber-Physical System
verfasst von
Qiangqiang Sun
Gengxiong Lian
Zhiwei Cao
Xiangsheng Zeng
Zhiyao Lv
Lei Liu
Ying Ju
Tong-Xing Zheng
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_29

Premium Partner