Skip to main content
Erschienen in: Arabian Journal for Science and Engineering 9/2021

22.02.2021 | Research Article-Computer Engineering and Computer Science

Prediction of Chaotic Time Series Based on SALR Model with Its Application on Heating Load Prediction

verfasst von: Minghui Zhang, Baozhu Wang, Yatong Zhou, Jihao Gu, Yuheng Wu

Erschienen in: Arabian Journal for Science and Engineering | Ausgabe 9/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the development of nonlinear science, improving the prediction performance of chaotic time series is of great significance in industrial production and daily life. Now, researchers have to develop effective models to achieve accurate prediction performance. The echo state network (ESN) has been proven to be an excellent prediction tool. However, the ESN has been criticized for not being principled enough. Thus, a novel ESN model namely self-join adjacent-feedback loop reservoir (SALR) is proposed. This model achieves the simplest topology structure on the premise of ensuring that all the connection modes of the classic ESN are available. In addition, in order to ensure the prediction performance of the network, the whale optimization algorithm was used to solve the parameter selection problems in the traditional cycle reservoir (SCR) model, the adjacent-feedback loop reservoir (ALR) model, and the SALR model. Finally, we use the proposed SALR model to solve classic benchmark chaotic time series as well as practical heating load prediction problems, and compare the SALR with the ESN, SCR, and ALR, respectively. Experimental results show that the proposed model can obtain higher accuracy with relatively low complexity than the ESN, SCR, and ALR.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lun, S.X., Yao, X.S., Qi, H.Y., et al.: A novel model of leaky integrator echo state network for time-series prediction. Neurocomputing 159(jul.2), 58–66 (2015)CrossRef Lun, S.X., Yao, X.S., Qi, H.Y., et al.: A novel model of leaky integrator echo state network for time-series prediction. Neurocomputing 159(jul.2), 58–66 (2015)CrossRef
2.
Zurück zum Zitat Al-Shammari, E.T., Keivani, A., Shamshirband, S., et al.: Prediction of heat load in district heating systems by Support Vector Machine with Firefly searching algorithm. Energy 95, 266–273 (2016)CrossRef Al-Shammari, E.T., Keivani, A., Shamshirband, S., et al.: Prediction of heat load in district heating systems by Support Vector Machine with Firefly searching algorithm. Energy 95, 266–273 (2016)CrossRef
3.
Zurück zum Zitat Jaeger, H., Haas, H.: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004) CrossRef Jaeger, H., Haas, H.: Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication. Science 304, 78–80 (2004) CrossRef
4.
Zurück zum Zitat Strauss, T., Wustlich, W., Labahn, R.: Design strategies for weight matrices of Echo state networks. Neural Comput. 24, 3246 (2012)MathSciNetMATHCrossRef Strauss, T., Wustlich, W., Labahn, R.: Design strategies for weight matrices of Echo state networks. Neural Comput. 24, 3246 (2012)MathSciNetMATHCrossRef
5.
Zurück zum Zitat Najibi, E., Rostami, H.: SCESN, SPESN, SWESN: three recurrent neural echo state networks with clustered reservoirs for prediction of nonlinear and chaotic time series. Appl. Intell. 43, 460–472 (2015)CrossRef Najibi, E., Rostami, H.: SCESN, SPESN, SWESN: three recurrent neural echo state networks with clustered reservoirs for prediction of nonlinear and chaotic time series. Appl. Intell. 43, 460–472 (2015)CrossRef
6.
Zurück zum Zitat Boccato, L., Attux, R., Von Zuben, F.J.: Self-organization and lateral interaction in echo state network reservoirs. Neurocomputing 138, 297–309 (2014)CrossRef Boccato, L., Attux, R., Von Zuben, F.J.: Self-organization and lateral interaction in echo state network reservoirs. Neurocomputing 138, 297–309 (2014)CrossRef
7.
Zurück zum Zitat Fang, Z., Wang, D.Z.: Optimization of aerodynamic characteristicson the unit body of high-speed train based on GRNN model and GA algorithm. J. Jim Univ. (Nat. Sci.) 95, 56–71 (2018) Fang, Z., Wang, D.Z.: Optimization of aerodynamic characteristicson the unit body of high-speed train based on GRNN model and GA algorithm. J. Jim Univ. (Nat. Sci.) 95, 56–71 (2018)
8.
Zurück zum Zitat Abualigah, L.M., Khader, A.T., Hanandeh, E.S.: Hybrid clustering analysis using improved Krill Herd algorithm. Appl. Intell. 73, 11–125 (2018) Abualigah, L.M., Khader, A.T., Hanandeh, E.S.: Hybrid clustering analysis using improved Krill Herd algorithm. Appl. Intell. 73, 11–125 (2018)
9.
Zurück zum Zitat Abualigah, L.M.: Feature selection and enhanced krill herd algorithm for text document clustering. Comput. Rev. 60(8), 318 (2019) Abualigah, L.M.: Feature selection and enhanced krill herd algorithm for text document clustering. Comput. Rev. 60(8), 318 (2019)
10.
Zurück zum Zitat Abualigah, L.M., Khader, A.T., Hanandeh, E.S.: A new feature selection method to improve the document clustering using particle swarm optimization algorithm. J. Comput. Sci. 25, 10 (2017) Abualigah, L.M., Khader, A.T., Hanandeh, E.S.: A new feature selection method to improve the document clustering using particle swarm optimization algorithm. J. Comput. Sci. 25, 10 (2017)
11.
Zurück zum Zitat Zhang, Y.; Lei, Y.X.: Research on Adaptive Adjustment of Cuckoo Search Algorithm. Software Guide, (2019) Zhang, Y.; Lei, Y.X.: Research on Adaptive Adjustment of Cuckoo Search Algorithm. Software Guide, (2019)
12.
Zurück zum Zitat Chouikhi, N., Ammar, B., Rokbani, N., et al.: PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef Chouikhi, N., Ammar, B., Rokbani, N., et al.: PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef
13.
Zurück zum Zitat Bala, A.; Ismail, I.; Ibrahim, R.: Cuckoo search based optimization of Echo State Network for time series prediction. In: 7th International Conference on Intelligent and Advanced System. IEEE (2018) Bala, A.; Ismail, I.; Ibrahim, R.: Cuckoo search based optimization of Echo State Network for time series prediction. In: 7th International Conference on Intelligent and Advanced System. IEEE (2018)
14.
Zurück zum Zitat Mirjalili, S., Lewis, A.: The Whale optimization algorithm. Adv. Eng. Softw. 95, 51–67 (2016)CrossRef Mirjalili, S., Lewis, A.: The Whale optimization algorithm. Adv. Eng. Softw. 95, 51–67 (2016)CrossRef
15.
Zurück zum Zitat Hof, P.R.; Gucht, E.V.: Structure of the cerebral cortex of the humpback whale, Megaptera novaeangliae (Cetacea, Mysticeti, Balaenopteridae). In: The Anatomical Record: Advances in Integrative Anatomy and Evolutionary Biology, vol. 290, pp. 1–31 (2007) Hof, P.R.; Gucht, E.V.: Structure of the cerebral cortex of the humpback whale, Megaptera novaeangliae (Cetacea, Mysticeti, Balaenopteridae). In: The Anatomical Record: Advances in Integrative Anatomy and Evolutionary Biology, vol. 290, pp. 1–31 (2007)
16.
Zurück zum Zitat Jaeger, H.: The “echo state” approach to analyzing and training recurrent neural networks-with an erratum note. Technical report GMD report, 148 (2001) Jaeger, H.: The “echo state” approach to analyzing and training recurrent neural networks-with an erratum note. Technical report GMD report, 148 (2001)
17.
Zurück zum Zitat Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009)MATHCrossRef Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Comput. Sci. Rev. 3, 127–149 (2009)MATHCrossRef
18.
Zurück zum Zitat Deng, Z.D., Zhang, Y.: Collective behavior of a small-world recurrent neural system with scale-free distribution. IEEE Trans. Neural Netw. 18, 1364–1375 (2007)CrossRef Deng, Z.D., Zhang, Y.: Collective behavior of a small-world recurrent neural system with scale-free distribution. IEEE Trans. Neural Netw. 18, 1364–1375 (2007)CrossRef
19.
Zurück zum Zitat Liu, X., Cui, H.X., Zhou, T.J., et al.: Performance evaluation of new echo state networks based on complex network. J. China Univ. Posts Telecommun. 19(001), 87–93 (2012)CrossRef Liu, X., Cui, H.X., Zhou, T.J., et al.: Performance evaluation of new echo state networks based on complex network. J. China Univ. Posts Telecommun. 19(001), 87–93 (2012)CrossRef
20.
Zurück zum Zitat Song, Q.S., Feng, Z.: Effects of connectivity structure of complex echo state network on its prediction performance for nonlinear time series. Neurocomputing 73, 2177–2185 (2010)CrossRef Song, Q.S., Feng, Z.: Effects of connectivity structure of complex echo state network on its prediction performance for nonlinear time series. Neurocomputing 73, 2177–2185 (2010)CrossRef
21.
Zurück zum Zitat Zhang, B., David, J.M., Wang, Y.: Nonlinear system modeling with random matrices: Echo State Networks revisited. IEEE Trans. Neural Netw. Learn. Syst. 23, 175–182 (2012)CrossRef Zhang, B., David, J.M., Wang, Y.: Nonlinear system modeling with random matrices: Echo State Networks revisited. IEEE Trans. Neural Netw. Learn. Syst. 23, 175–182 (2012)CrossRef
22.
Zurück zum Zitat Cui, H.. Y., Liu, X., Li, L.. X.: The architecture of dynamic reservoir in the echo state network. Chaos Interdiscipl. J. Nonlinear Sci. 22, 033–127 (2012)MathSciNetMATH Cui, H.. Y., Liu, X., Li, L.. X.: The architecture of dynamic reservoir in the echo state network. Chaos Interdiscipl. J. Nonlinear Sci. 22, 033–127 (2012)MathSciNetMATH
23.
Zurück zum Zitat Rodan, A., Tino, P.: Minimum complexity echo state network. IEEE Trans. Neural Netw. 22, 131–44 (2011)CrossRef Rodan, A., Tino, P.: Minimum complexity echo state network. IEEE Trans. Neural Netw. 22, 131–44 (2011)CrossRef
24.
Zurück zum Zitat Sun, X.C.; Cui, H.Y.; Liu, R.P.; et al.: Modeling deterministic echo state network with loop reservoir. J. Zhejiang Univ. Part C (Comput. Electron.) (English version) (2012) Sun, X.C.; Cui, H.Y.; Liu, R.P.; et al.: Modeling deterministic echo state network with loop reservoir. J. Zhejiang Univ. Part C (Comput. Electron.) (English version) (2012)
25.
Zurück zum Zitat Luisa, M., Delgado, P.: Color image quantization using the shuffled-frog leaping algorithm. Eng. Appl. Artif. Intell. 79, 142–158 (2019)CrossRef Luisa, M., Delgado, P.: Color image quantization using the shuffled-frog leaping algorithm. Eng. Appl. Artif. Intell. 79, 142–158 (2019)CrossRef
26.
Zurück zum Zitat Wang, H., Wang, W.J., Zhou, X.Y., et al.: Firefly algorithm with neighborhood attraction. Inf. Sci. 382–383, 374–387 (2017)CrossRef Wang, H., Wang, W.J., Zhou, X.Y., et al.: Firefly algorithm with neighborhood attraction. Inf. Sci. 382–383, 374–387 (2017)CrossRef
27.
Zurück zum Zitat Zhang, Z.Q., Wang, K.P., Zhu, L.X., et al.: A Pareto improved artificial Fish swarm algorithm for solving a multi-objective fuzzy disassembly line balancing problem. Expert Syst. Appl. 86, 165–176 (2017)CrossRef Zhang, Z.Q., Wang, K.P., Zhu, L.X., et al.: A Pareto improved artificial Fish swarm algorithm for solving a multi-objective fuzzy disassembly line balancing problem. Expert Syst. Appl. 86, 165–176 (2017)CrossRef
28.
Zurück zum Zitat Ameur, M.S.B., et al.: FPGA based hardware implementation of Bat Algorithm. Appl. Soft Comput. 58, 378–387 (2017) CrossRef Ameur, M.S.B., et al.: FPGA based hardware implementation of Bat Algorithm. Appl. Soft Comput. 58, 378–387 (2017) CrossRef
29.
Zurück zum Zitat Lin, Y., Gong, Y.J., Zhang, J.: An adaptive ant colony optimization algorithm for constructing cognitive diagnosis tests. Appl. Soft Comput. 52, 1–13 (2017)CrossRef Lin, Y., Gong, Y.J., Zhang, J.: An adaptive ant colony optimization algorithm for constructing cognitive diagnosis tests. Appl. Soft Comput. 52, 1–13 (2017)CrossRef
30.
Zurück zum Zitat Jiang, F., Xia, H.. y, Tran, Q.. A., et al.: A new binary hybrid particle swarm optimization with wavelet mutation. Knowl.-Based Syst. 130, 90–101 (2017)CrossRef Jiang, F., Xia, H.. y, Tran, Q.. A., et al.: A new binary hybrid particle swarm optimization with wavelet mutation. Knowl.-Based Syst. 130, 90–101 (2017)CrossRef
31.
Zurück zum Zitat Oliva, D., El Aziz, M.A., Hassanien, A.E.: Parameter estimation of photovoltaic cells using an improved chaotic whale optimization algorithm. Appl. Energy 200, 141–154 (2017)CrossRef Oliva, D., El Aziz, M.A., Hassanien, A.E.: Parameter estimation of photovoltaic cells using an improved chaotic whale optimization algorithm. Appl. Energy 200, 141–154 (2017)CrossRef
32.
Zurück zum Zitat Sarath, K., Sekar, S.: Modelling and optimal design of LLC resonant converter using whale optimization algorithm. Int. J. Model. Simul. Sci. Comput. 9, 3 (2018)CrossRef Sarath, K., Sekar, S.: Modelling and optimal design of LLC resonant converter using whale optimization algorithm. Int. J. Model. Simul. Sci. Comput. 9, 3 (2018)CrossRef
33.
Zurück zum Zitat Abdel-Basset, M., Gunasekaran, M., El-Shahat, D., et al.: A hybrid whale optimization algorithm based on local search strategy for the permutation flow shop scheduling problem. Future Gener. Comput. Syst. 85, 10 (2018) CrossRef Abdel-Basset, M., Gunasekaran, M., El-Shahat, D., et al.: A hybrid whale optimization algorithm based on local search strategy for the permutation flow shop scheduling problem. Future Gener. Comput. Syst. 85, 10 (2018) CrossRef
34.
Zurück zum Zitat Cuomo, K.M., Oppenheim, A.V., Strogatz, S.H.: Synchronization of Lorenz-based chaotic circuits with applications to communications. IEEE Trans. Circuits Syst. II Analog Digital Signal Process. 40, 626–633 (1993)CrossRef Cuomo, K.M., Oppenheim, A.V., Strogatz, S.H.: Synchronization of Lorenz-based chaotic circuits with applications to communications. IEEE Trans. Circuits Syst. II Analog Digital Signal Process. 40, 626–633 (1993)CrossRef
35.
Zurück zum Zitat Miranian, A., Abdollahzade, M.: Developing a local least-squares support vector machines-based neuro-fuzzy model for nonlinear and chaotic time series prediction. IEEE Trans. Neural Netw. Learn. Syst. 24, 207–218 (2013)CrossRef Miranian, A., Abdollahzade, M.: Developing a local least-squares support vector machines-based neuro-fuzzy model for nonlinear and chaotic time series prediction. IEEE Trans. Neural Netw. Learn. Syst. 24, 207–218 (2013)CrossRef
36.
Zurück zum Zitat Victor, M., Torres, Castillo O.: A type-2 fuzzy neural network ensemble to predict chaotic time series. Stud. Comput. Intell. 601, 185–195 (2015)CrossRef Victor, M., Torres, Castillo O.: A type-2 fuzzy neural network ensemble to predict chaotic time series. Stud. Comput. Intell. 601, 185–195 (2015)CrossRef
37.
Zurück zum Zitat Ma, Q., Shen, L.F., Chen, W.B., et al.: Functional echo state network for time series classification. Inf. Sci. 373, 1–20 (2016)MATHCrossRef Ma, Q., Shen, L.F., Chen, W.B., et al.: Functional echo state network for time series classification. Inf. Sci. 373, 1–20 (2016)MATHCrossRef
38.
Zurück zum Zitat Tian, Z.D., Gao, X.W., Li, S.J., et al.: Prediction method for network traffic based on genetic algorithm optimized Echo State Network. J. Comput. Res. Dev. 52, 1137–1145 (2015) Tian, Z.D., Gao, X.W., Li, S.J., et al.: Prediction method for network traffic based on genetic algorithm optimized Echo State Network. J. Comput. Res. Dev. 52, 1137–1145 (2015)
39.
Zurück zum Zitat Huang, J., Qian, J., Liu, L., et al.: Echo state network based predictive control with particle swarm optimization for pneumatic muscle actuator. J. Franklin Inst. 353, 2761–2782 (2016)MathSciNetMATHCrossRef Huang, J., Qian, J., Liu, L., et al.: Echo state network based predictive control with particle swarm optimization for pneumatic muscle actuator. J. Franklin Inst. 353, 2761–2782 (2016)MathSciNetMATHCrossRef
40.
Zurück zum Zitat Zhang, Y.; Qi, W.: Interval forecasting for heating load using support vector regression and error correcting Markov chains. In: Proceedings of the Eighth International Conference on Machine Learning and Cybernetics vol. 2, pp. 1106–1110 (2009) Zhang, Y.; Qi, W.: Interval forecasting for heating load using support vector regression and error correcting Markov chains. In: Proceedings of the Eighth International Conference on Machine Learning and Cybernetics vol. 2, pp. 1106–1110 (2009)
41.
Zurück zum Zitat Werner, S.E.: The Heat Load in District Heating System. Chalmers University of Technology, Goteborg (1984) Werner, S.E.: The Heat Load in District Heating System. Chalmers University of Technology, Goteborg (1984)
42.
Zurück zum Zitat Stevenson, W.: Using artificial neural nets to predict building energy parameters. ASHRAE Trans. 100, 1076–1087 (1994) Stevenson, W.: Using artificial neural nets to predict building energy parameters. ASHRAE Trans. 100, 1076–1087 (1994)
43.
Zurück zum Zitat Dong, B., Cao, C., Lee, S.: Applying support vector machines to predict building energy consumption in tropical region. Energy Build. 37, 545–553 (2005)CrossRef Dong, B., Cao, C., Lee, S.: Applying support vector machines to predict building energy consumption in tropical region. Energy Build. 37, 545–553 (2005)CrossRef
44.
Zurück zum Zitat Nielsen, H.A., Madsen, H.: Modelling the heat consumption in district heating systems using a grey-box approach. Energy Build. 38, 63–71 (2006)CrossRef Nielsen, H.A., Madsen, H.: Modelling the heat consumption in district heating systems using a grey-box approach. Energy Build. 38, 63–71 (2006)CrossRef
45.
Zurück zum Zitat Yetemen, O., Yalcin, T.: Climatic parameters and evaluation of energy consumption of the Afyon geothermal district heating system. Renew. Energy 34, 706–710 (2009)CrossRef Yetemen, O., Yalcin, T.: Climatic parameters and evaluation of energy consumption of the Afyon geothermal district heating system. Renew. Energy 34, 706–710 (2009)CrossRef
46.
Zurück zum Zitat Bacher, P.; Madsen, H.; Nielsen, H.A.: Online short-term heat load forecasting for single family houses. In: 39th Annual Conference of the IEEE Industrial Electronics Society, pp. 5741-5746 (2013) Bacher, P.; Madsen, H.; Nielsen, H.A.: Online short-term heat load forecasting for single family houses. In: 39th Annual Conference of the IEEE Industrial Electronics Society, pp. 5741-5746 (2013)
47.
Zurück zum Zitat Al-Shammari, E.T., Keivani, A., Shamshirband, S., et al.: Prediction of heat load in district heating systems by support vector machine with firefly searching algorithm. Energy 95, 266–273 (2015)CrossRef Al-Shammari, E.T., Keivani, A., Shamshirband, S., et al.: Prediction of heat load in district heating systems by support vector machine with firefly searching algorithm. Energy 95, 266–273 (2015)CrossRef
48.
Zurück zum Zitat Takens, F.: Detecting strange attractors in fluid turbulence. In: Rand, D., Young, L.S. (eds.) Dynamical Systems and Turbulence, pp. 366–381. Springer, Berlin (1981) Takens, F.: Detecting strange attractors in fluid turbulence. In: Rand, D., Young, L.S. (eds.) Dynamical Systems and Turbulence, pp. 366–381. Springer, Berlin (1981)
49.
50.
Zurück zum Zitat Chatzis, S.P., Demiris, Y.: Echo State Gaussian process. IEEE Trans. Neural Netw. 22, 1435–1445 (2011)CrossRef Chatzis, S.P., Demiris, Y.: Echo State Gaussian process. IEEE Trans. Neural Netw. 22, 1435–1445 (2011)CrossRef
Metadaten
Titel
Prediction of Chaotic Time Series Based on SALR Model with Its Application on Heating Load Prediction
verfasst von
Minghui Zhang
Baozhu Wang
Yatong Zhou
Jihao Gu
Yuheng Wu
Publikationsdatum
22.02.2021
Verlag
Springer Berlin Heidelberg
Erschienen in
Arabian Journal for Science and Engineering / Ausgabe 9/2021
Print ISSN: 2193-567X
Elektronische ISSN: 2191-4281
DOI
https://doi.org/10.1007/s13369-021-05407-y

Weitere Artikel der Ausgabe 9/2021

Arabian Journal for Science and Engineering 9/2021 Zur Ausgabe

Research Article-Computer Engineering and Computer Science

Speckle Reducing Non-local Variational Framework Based on Maximum Mean Discrepancy

Research Article-Computer Engineering and Computer Science

Toward a Software Bad Smell Prioritization Model for Software Maintainability

Research Article-Computer Engineering and Computer Science

Multi-Level Cross-Architecture Binary Code Similarity Metric

Research Article-Computer Engineering and Computer Science

An Improved Blockchain Consensus Algorithm Based on Raft

Research Article-Computer Engineering and Computer Science

A New Improved Model of Marine Predator Algorithm for Optimization Problems

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.