Skip to main content

2023 | OriginalPaper | Buchkapitel

Covariance Kernel Learning Schemes for Gaussian Process Based Prediction Using Markov Chain Monte Carlo

verfasst von : Gargi Roy, Kane Warrior, Dalia Chakrabarty

Erschienen in: Progress in Artificial Intelligence

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Probabilistic supervised learning within the Bayesian paradigm typically use Gaussian Processes (GPs) to model the sought function, and provide a means for securing reliable uncertainties in said functional learning, while offering interpretability. Prediction of the output of such a learnt function is closed-form in this approach. In this work, we present GP based learning of the functional relation between two variables, using various kinds of kernels that are called in to parametrise the covariance function of the invoked GP. However, such covariance kernels are typically parametric in the literature, with hyperparameters that are learnt from the data. Here, we discuss a new nonparametric covariance kernel, and compare its performance against existing non-stationary and stationary kernels, as well as against Deep Neural Networks. We present results on both univariate and multivariate data, to demonstrate the range of applicability of the presented learning scheme.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ali, M., Deo, R.C., Downs, N.J., Maraseni, T.: Cotton yield prediction with Markov chain monte Carlo-based simulation model integrated with genetic programing algorithm: a new hybrid copula-driven approach. Agric. Forest Meteorol. 263, 428–448 (2018)CrossRef Ali, M., Deo, R.C., Downs, N.J., Maraseni, T.: Cotton yield prediction with Markov chain monte Carlo-based simulation model integrated with genetic programing algorithm: a new hybrid copula-driven approach. Agric. Forest Meteorol. 263, 428–448 (2018)CrossRef
2.
Zurück zum Zitat Yan, B., Ren, F., Cai, M., Qiao, C.: Bayesian model based on Markov chain Monte Carlo for identifying mine water sources in submarine gold mining. J. Cleaner Prod. 253, 120008 (2020)CrossRef Yan, B., Ren, F., Cai, M., Qiao, C.: Bayesian model based on Markov chain Monte Carlo for identifying mine water sources in submarine gold mining. J. Cleaner Prod. 253, 120008 (2020)CrossRef
3.
Zurück zum Zitat Lu, H., Kim, E., Gutierrez, M.: A probabilistic q-system using the Markov chain to predict rock mass quality in tunneling. Comput. Geotech. 145, 104689 (2022)CrossRef Lu, H., Kim, E., Gutierrez, M.: A probabilistic q-system using the Markov chain to predict rock mass quality in tunneling. Comput. Geotech. 145, 104689 (2022)CrossRef
4.
Zurück zum Zitat Begoli, E., Bhattacharya, T., Kusnezov, D.: The need for uncertainty quantification in machine-assisted medical decision making. Nat. Mach. Intell. 1(1), 20–23 (2019)CrossRef Begoli, E., Bhattacharya, T., Kusnezov, D.: The need for uncertainty quantification in machine-assisted medical decision making. Nat. Mach. Intell. 1(1), 20–23 (2019)CrossRef
6.
Zurück zum Zitat Lee, C.H., Chang, K., Chen, Y.M., Tsai, J.T., Chen, Y.J., Ho, W.H.: Epidemic prediction of dengue fever based on vector compartment model and Markov chain Monte Carlo method. BMC Bioinf. 22(5), 1–11 (2021) Lee, C.H., Chang, K., Chen, Y.M., Tsai, J.T., Chen, Y.J., Ho, W.H.: Epidemic prediction of dengue fever based on vector compartment model and Markov chain Monte Carlo method. BMC Bioinf. 22(5), 1–11 (2021)
7.
Zurück zum Zitat Magotra, A., Bangar, Y.C., Yadav, A.: Neural network and Bayesian-based prediction of breeding values in beetal goat. Trop. Anim. Health Prod. 54(5), 282 (2022)CrossRef Magotra, A., Bangar, Y.C., Yadav, A.: Neural network and Bayesian-based prediction of breeding values in beetal goat. Trop. Anim. Health Prod. 54(5), 282 (2022)CrossRef
9.
Zurück zum Zitat Paciorek, C., Schervish, M.: Nonstationary covariance functions for gaussian process regression. In: Advances in Neural Information Processing Systems 16 (2003) Paciorek, C., Schervish, M.: Nonstationary covariance functions for gaussian process regression. In: Advances in Neural Information Processing Systems 16 (2003)
10.
Zurück zum Zitat Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. MIT Press, Cambridge (2006) Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. Adaptive Computation and Machine Learning. MIT Press, Cambridge (2006)
11.
Zurück zum Zitat Rastogi, R., Ghosh, S., Ghosh, A.K., Vaze, K.K., Singh, P.K.: Fatigue crack growth prediction in nuclear piping using Markov chain Monte Carlo simulation. Fatigue & Fract. Eng. Mat. & Struct. 40(1), 145–156 (2017)CrossRef Rastogi, R., Ghosh, S., Ghosh, A.K., Vaze, K.K., Singh, P.K.: Fatigue crack growth prediction in nuclear piping using Markov chain Monte Carlo simulation. Fatigue & Fract. Eng. Mat. & Struct. 40(1), 145–156 (2017)CrossRef
12.
Zurück zum Zitat Remes, S., Heinonen, M., Kaski, S.: Non-stationary spectral kernels. In: Advances in Neural Information Processing Systems 30 (2017) Remes, S., Heinonen, M., Kaski, S.: Non-stationary spectral kernels. In: Advances in Neural Information Processing Systems 30 (2017)
13.
Zurück zum Zitat Roy, G., Chakrabarty, D.: Efficient uncertainty quantification for under-constraint prediction following learning using mcmc. In: Neural Information Processing, pp. 275–287. Springer Nature Singapore, Singapore (2023) Roy, G., Chakrabarty, D.: Efficient uncertainty quantification for under-constraint prediction following learning using mcmc. In: Neural Information Processing, pp. 275–287. Springer Nature Singapore, Singapore (2023)
14.
Zurück zum Zitat Salam, A., El Hibaoui, A.: Comparison of machine learning algorithms for the power consumption prediction:-case study of Tetouan city-. In: 2018 6th International Renewable and Sustainable Energy Conference (IRSEC), pp. 1–5. IEEE (2018) Salam, A., El Hibaoui, A.: Comparison of machine learning algorithms for the power consumption prediction:-case study of Tetouan city-. In: 2018 6th International Renewable and Sustainable Energy Conference (IRSEC), pp. 1–5. IEEE (2018)
15.
Zurück zum Zitat Shen, X., Zhang, Y., Zhang, J., Wu, X.: An interval analysis scheme based on empirical error and mcmc to quantify uncertainty of wind speed. IEEE Trans. Ind. Appl. 58(6), 7754–7763 (2022)CrossRef Shen, X., Zhang, Y., Zhang, J., Wu, X.: An interval analysis scheme based on empirical error and mcmc to quantify uncertainty of wind speed. IEEE Trans. Ind. Appl. 58(6), 7754–7763 (2022)CrossRef
16.
Zurück zum Zitat Simpson, F., Lalchand, V., Rasmussen, C.E.: Marginalised gaussian processes with nested sampling. Adv. Neural. Inf. Process. Syst. 34, 13613–13625 (2021) Simpson, F., Lalchand, V., Rasmussen, C.E.: Marginalised gaussian processes with nested sampling. Adv. Neural. Inf. Process. Syst. 34, 13613–13625 (2021)
17.
Zurück zum Zitat Smith, H.J., Dinev, T., Xu, H.: Information privacy research: an interdisciplinary review. MIS Q. 989–1015 (2011) Smith, H.J., Dinev, T., Xu, H.: Information privacy research: an interdisciplinary review. MIS Q. 989–1015 (2011)
18.
Zurück zum Zitat Wang, Y., Zhou, C., Chen, Z.: An enhanced approach for load behavior and battery residual capacity prediction using Markov chain and Monte Carlo method. IEEE J. Emerg. Selected Top. Ind. Electr. 4(1), 159–167 (2023)CrossRef Wang, Y., Zhou, C., Chen, Z.: An enhanced approach for load behavior and battery residual capacity prediction using Markov chain and Monte Carlo method. IEEE J. Emerg. Selected Top. Ind. Electr. 4(1), 159–167 (2023)CrossRef
Metadaten
Titel
Covariance Kernel Learning Schemes for Gaussian Process Based Prediction Using Markov Chain Monte Carlo
verfasst von
Gargi Roy
Kane Warrior
Dalia Chakrabarty
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-49008-8_15

Premium Partner