Skip to main content

2024 | OriginalPaper | Buchkapitel

Multi-objective Reinforcement Learning Algorithm for Computing Offloading of Task-Dependent Workflows in 5G enabled Smart Grids

verfasst von : Yongjie Li, Jizhao Lu, Huanpeng Hou, Wenge Wang, Gongming Li

Erschienen in: Proceedings of the 13th International Conference on Computer Engineering and Networks

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computational offloading is considered a promising emerging paradigm for addressing the limited resources of edge devices in expanding power grids. However, with the advancement of intelligent technologies such as digitalized power grids, applications often consist of several interdependent subtasks, forming interconnected automated workflows. This paper focuses on the computational offloading technique within task-dependent workflows. It proposes a multi-objective optimization problem for offloading, considering both time and energy consumption. The model takes into account the constraints of task duration, communication capacity, and computational capacity. Additionally, a predictive-guided a predictive-guided multi-objective reinforcement learning algorithm based on Pareto optimization (MORLBP) is introduced. This algorithm combines the principles of multi-objective optimization, Pareto optimality theory, and deep reinforcement learning. It utilizes the quality of the Pareto front as a metric and is compared against NSGA-II and MOPSO algorithms. The proposed algorithm’s effectiveness and advancement are validated through simulations, demonstrating its efficiency and innovation in tackling the multi-objective offloading problem within task-dependent workflows.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hemanand, D., Jayalakshmi, D., Ghosh, U., Balasundaram, A., Vijayakumar, P., Sharma, P.K.: Enabling sustainable energy for smart environment using 5g wireless communication and internet of things. IEEE Wirel. Commun. 28(6), 56–61 (2021)CrossRef Hemanand, D., Jayalakshmi, D., Ghosh, U., Balasundaram, A., Vijayakumar, P., Sharma, P.K.: Enabling sustainable energy for smart environment using 5g wireless communication and internet of things. IEEE Wirel. Commun. 28(6), 56–61 (2021)CrossRef
2.
Zurück zum Zitat Kishor, A., Chakarbarty, C.: Task offloading in fog computing for using smart ant colony optimization. Wirel. Personal Commun. 1–22 (2021) Kishor, A., Chakarbarty, C.: Task offloading in fog computing for using smart ant colony optimization. Wirel. Personal Commun. 1–22 (2021)
3.
Zurück zum Zitat Liu, J., Wang, S., Wang, J., Liu, C., Yan, Y.: A task oriented computation offloading algorithm for intelligent vehicle network with mobile edge computing. IEEE Access 7, 180491–180502 (2019)CrossRef Liu, J., Wang, S., Wang, J., Liu, C., Yan, Y.: A task oriented computation offloading algorithm for intelligent vehicle network with mobile edge computing. IEEE Access 7, 180491–180502 (2019)CrossRef
4.
Zurück zum Zitat Luo, Q., Li, C., Luan, T.H., Shi, W.: Minimizing the delay and cost of computation offloading for vehicular edge computing. IEEE Trans. Serv. Comput. 15(5), 2897–2909 (2022)CrossRef Luo, Q., Li, C., Luan, T.H., Shi, W.: Minimizing the delay and cost of computation offloading for vehicular edge computing. IEEE Trans. Serv. Comput. 15(5), 2897–2909 (2022)CrossRef
5.
Zurück zum Zitat Movahedi, Z., Defude, B., et al.: An efficient population-based multi-objective task scheduling approach in fog computing systems. J. Cloud Comput. 10(1), 1–31 (2021)CrossRef Movahedi, Z., Defude, B., et al.: An efficient population-based multi-objective task scheduling approach in fog computing systems. J. Cloud Comput. 10(1), 1–31 (2021)CrossRef
6.
Zurück zum Zitat Saemi, B., Sadeghilalimi, M., Hosseinabadi, A.A.R., Mouhoub, M., Sadaoui, S.: A new optimization approach for task scheduling problem using water cycle algorithm in mobile cloud computing. In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 530–539. IEEE (2021) Saemi, B., Sadeghilalimi, M., Hosseinabadi, A.A.R., Mouhoub, M., Sadaoui, S.: A new optimization approach for task scheduling problem using water cycle algorithm in mobile cloud computing. In: 2021 IEEE Congress on Evolutionary Computation (CEC), pp. 530–539. IEEE (2021)
7.
Zurück zum Zitat Shakarami, A., Ghobaei-Arani, M., Shahidinejad, A.: A survey on the computation offloading approaches in mobile edge computing: a machine learning-based perspective. Comput. Netw. 182, 107496 (2020)CrossRef Shakarami, A., Ghobaei-Arani, M., Shahidinejad, A.: A survey on the computation offloading approaches in mobile edge computing: a machine learning-based perspective. Comput. Netw. 182, 107496 (2020)CrossRef
8.
Zurück zum Zitat Spinelli, F., Mancuso, V.: Toward enabled industrial verticals in 5g: a survey on MEC-based approaches to provisioning and flexibility. IEEE Commun. Surv. Tutor. 23(1), 596–630 (2020)CrossRef Spinelli, F., Mancuso, V.: Toward enabled industrial verticals in 5g: a survey on MEC-based approaches to provisioning and flexibility. IEEE Commun. Surv. Tutor. 23(1), 596–630 (2020)CrossRef
9.
Zurück zum Zitat Wang, J., Hu, J., Min, G., Zhan, W., Ni, Q., Georgalas, N.: Computation offloading in multi-access edge computing using a deep sequential model based on reinforcement learning. IEEE Commun. Mag. 57(5), 64–69 (2019)CrossRef Wang, J., Hu, J., Min, G., Zhan, W., Ni, Q., Georgalas, N.: Computation offloading in multi-access edge computing using a deep sequential model based on reinforcement learning. IEEE Commun. Mag. 57(5), 64–69 (2019)CrossRef
10.
Zurück zum Zitat Wang, W., Qu, R., Liao, H., Wang, Z., Zhou, Z., Wang, Z., Mumtaz, S., Guizani, M.: 5g MEC-based intelligent computation offloading in power robotic inspection. IEEE Wirel. Commun. 30(2), 66–74 (2023)CrossRef Wang, W., Qu, R., Liao, H., Wang, Z., Zhou, Z., Wang, Z., Mumtaz, S., Guizani, M.: 5g MEC-based intelligent computation offloading in power robotic inspection. IEEE Wirel. Commun. 30(2), 66–74 (2023)CrossRef
11.
Zurück zum Zitat Yan, J., Bi, S., Zhang, Y.J.A.: Offloading and resource allocation with general task graph in mobile edge computing: a deep reinforcement learning approach. IEEE Trans. Wirel. Commun. 19(8), 5404–5419 (2020)CrossRef Yan, J., Bi, S., Zhang, Y.J.A.: Offloading and resource allocation with general task graph in mobile edge computing: a deep reinforcement learning approach. IEEE Trans. Wirel. Commun. 19(8), 5404–5419 (2020)CrossRef
12.
Zurück zum Zitat Yu, Y.: Mobile edge computing towards 5g: vision, recent progress, and open challenges. China Commun. 13(Supplement2), 89–99 (2016)CrossRef Yu, Y.: Mobile edge computing towards 5g: vision, recent progress, and open challenges. China Commun. 13(Supplement2), 89–99 (2016)CrossRef
13.
Zurück zum Zitat Zhang, K., Mao, Y., Leng, S., Zhao, Q., Li, L., Peng, X., Pan, L., Maharjan, S., Zhang, Y.: Energy-efficient offloading for mobile edge computing in 5g heterogeneous networks. IEEE Access 4, 5896–5907 (2016)CrossRef Zhang, K., Mao, Y., Leng, S., Zhao, Q., Li, L., Peng, X., Pan, L., Maharjan, S., Zhang, Y.: Energy-efficient offloading for mobile edge computing in 5g heterogeneous networks. IEEE Access 4, 5896–5907 (2016)CrossRef
Metadaten
Titel
Multi-objective Reinforcement Learning Algorithm for Computing Offloading of Task-Dependent Workflows in 5G enabled Smart Grids
verfasst von
Yongjie Li
Jizhao Lu
Huanpeng Hou
Wenge Wang
Gongming Li
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-9247-8_22