Skip to main content

2021 | OriginalPaper | Buchkapitel

Machine Learning for Generic Energy Models of High Performance Computing Resources

verfasst von : Jonathan Muraña, Carmen Navarrete, Sergio Nesmachnow

Erschienen in: High Performance Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article presents an study of the generalization capabilities of forecasting techniques of empirical energy consumption models of high performance computing resources. This is a relevant subject, considering the large energy utilization of modern supercomputing facilities. Different energy models are built, considering several forecasting techniques and using information from the execution of a benchmark over different hardware. A cross-evaluation is performed and the training information of each model is gradually extended with information about other hardware. Each model is analyzed to evaluate how new information impacts on the prediction capabilities. The main results indicate that neural network approaches achieve the highest quality results when the training data of the models is expanded with minimal information from new scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Auweter, A., et al.: A case study of energy aware scheduling on SuperMUC. In: Supercomputing, pp. 394–409 (2014) Auweter, A., et al.: A case study of energy aware scheduling on SuperMUC. In: Supercomputing, pp. 394–409 (2014)
3.
Zurück zum Zitat Barreda, M., Dolz, M., Castaño, M.: Convolutional neural nets for estimating the run time and energy consumption of the sparse matrix-vector product. Int. J. High Perform. Comput. Appl. 35(3), 268–281 (2021)CrossRef Barreda, M., Dolz, M., Castaño, M.: Convolutional neural nets for estimating the run time and energy consumption of the sparse matrix-vector product. Int. J. High Perform. Comput. Appl. 35(3), 268–281 (2021)CrossRef
4.
Zurück zum Zitat Buitinck, L., et al.: API design for machine learning software: experiences from the scikit-learn project. In: Workshop: Languages for Data Mining and Machine Learning, pp. 108–122 (2013) Buitinck, L., et al.: API design for machine learning software: experiences from the scikit-learn project. In: Workshop: Languages for Data Mining and Machine Learning, pp. 108–122 (2013)
5.
Zurück zum Zitat Dayarathna, M., Wen, Y., Fan, R.: Data center energy consumption modeling: a survey. IEEE Commun. Surv. Tutorials 18(1), 732–794 (2016)CrossRef Dayarathna, M., Wen, Y., Fan, R.: Data center energy consumption modeling: a survey. IEEE Commun. Surv. Tutorials 18(1), 732–794 (2016)CrossRef
6.
Zurück zum Zitat Hähnel, M., Döbel, B., Völp, M., Härtig, H.: Measuring energy consumption for short code paths using RAPL. ACM SIGMETRICS Perform. Eval. Rev. 40(3), 13–17 (2012)CrossRef Hähnel, M., Döbel, B., Völp, M., Härtig, H.: Measuring energy consumption for short code paths using RAPL. ACM SIGMETRICS Perform. Eval. Rev. 40(3), 13–17 (2012)CrossRef
7.
Zurück zum Zitat Imes, C., Hofmeyr, S., Hoffmann, H.: Energy-efficient application resource scheduling using machine learning classifiers. In: 47th International Conference on Parallel Processing (2018) Imes, C., Hofmeyr, S., Hoffmann, H.: Energy-efficient application resource scheduling using machine learning classifiers. In: 47th International Conference on Parallel Processing (2018)
8.
Zurück zum Zitat Malmodin, J., Lundén, D.: The energy and carbon footprint of the global ICT and E&M sectors 2010–2015. Sustainability 10(9), 3027 (2018)CrossRef Malmodin, J., Lundén, D.: The energy and carbon footprint of the global ICT and E&M sectors 2010–2015. Sustainability 10(9), 3027 (2018)CrossRef
12.
Zurück zum Zitat Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef Pan, S.J., Yang, Q.: A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10), 1345–1359 (2010)CrossRef
13.
Zurück zum Zitat Rong, H., Zhang, H., Xiao, S., Li, C., Hu, C.: Optimizing energy consumption for data centers. Renew. Sustain. Energy Rev. 58, 674–691 (2016)CrossRef Rong, H., Zhang, H., Xiao, S., Li, C., Hu, C.: Optimizing energy consumption for data centers. Renew. Sustain. Energy Rev. 58, 674–691 (2016)CrossRef
14.
Zurück zum Zitat Sayadi, H., Patel, N., Sasan, A., Homayoun, H.: Machine learning-based approaches for energy-efficiency prediction and scheduling in composite cores architectures. In: International Conference on Computer Design, pp. 129–136 (2017) Sayadi, H., Patel, N., Sasan, A., Homayoun, H.: Machine learning-based approaches for energy-efficiency prediction and scheduling in composite cores architectures. In: International Conference on Computer Design, pp. 129–136 (2017)
15.
Zurück zum Zitat Schöne, R., et al.: Automatic application tuning for HPC architectures. Sci. Program. 22, 1–11 (2014) Schöne, R., et al.: Automatic application tuning for HPC architectures. Sci. Program. 22, 1–11 (2014)
16.
Zurück zum Zitat Strohmaier, E., Shan, H.: Apex-Map: a global data access benchmark to analyze hpc systems and parallel programming paradigms. In: 2005 ACM/IEEE Conference on Supercomputing, pp. 49–49 (2005) Strohmaier, E., Shan, H.: Apex-Map: a global data access benchmark to analyze hpc systems and parallel programming paradigms. In: 2005 ACM/IEEE Conference on Supercomputing, pp. 49–49 (2005)
17.
Zurück zum Zitat Terpstra, D., Jagode, H., You, H., Dongarra, J.: Collecting performance data with PAPI-C. In: Tools for High Performance Computing, pp. 157–173 (2010) Terpstra, D., Jagode, H., You, H., Dongarra, J.: Collecting performance data with PAPI-C. In: Tools for High Performance Computing, pp. 157–173 (2010)
Metadaten
Titel
Machine Learning for Generic Energy Models of High Performance Computing Resources
verfasst von
Jonathan Muraña
Carmen Navarrete
Sergio Nesmachnow
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-90539-2_21

Premium Partner