Skip to main content

2024 | OriginalPaper | Buchkapitel

Adaptive Prediction Interval for Data Stream Regression

verfasst von : Yibin Sun, Bernhard Pfahringer, Heitor Murilo Gomes, Albert Bifet

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Prediction Interval (PI) is a powerful technique for quantifying the uncertainty of regression tasks. However, research on PI for data streams has not received much attention. Moreover, traditional PI-generating approaches are not directly applicable due to the dynamic and evolving nature of data streams. This paper presents AdaPI (ADAptive Prediction Interval), a novel method that can automatically adjust the interval width by an appropriate amount according to historical information to converge the coverage to a user-defined percentage. AdaPI can be applied to any streaming PI technique as a postprocessing step. This paper develops an incremental variant of the pervasive Mean and Variance Estimation (MVE) method for use with AdaPI. An empirical evaluation over a set of standard streaming regression tasks demonstrates AdaPI’s ability to generate compact prediction intervals with a coverage close to the desired level, outperforming alternative methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Barber, R.F., Candes, E.J., Ramdas, A., Tibshirani, R.J.: Predictive inference with the jackknife+ (2021) Barber, R.F., Candes, E.J., Ramdas, A., Tibshirani, R.J.: Predictive inference with the jackknife+ (2021)
2.
Zurück zum Zitat Bifet, A., et al.: Moa: massive online analysis, a framework for stream classification and clustering. PMLR (2010) Bifet, A., et al.: Moa: massive online analysis, a framework for stream classification and clustering. PMLR (2010)
3.
4.
Zurück zum Zitat Fanaee-T, H., Gama, J.: Event labeling combining ensemble detectors and background knowledge. Progr. Artif. Intell. 2, 113–127 (2014)CrossRef Fanaee-T, H., Gama, J.: Event labeling combining ensemble detectors and background knowledge. Progr. Artif. Intell. 2, 113–127 (2014)CrossRef
5.
Zurück zum Zitat Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetCrossRef Friedman, M.: A comparison of alternative tests of significance for the problem of m rankings. Ann. Math. Stat. 11(1), 86–92 (1940)MathSciNetCrossRef
6.
Zurück zum Zitat Gomes, H.M., Barddal, J.P., Ferreira, L.E.B., Bifet, A.: Adaptive random forests for data stream regression. In: ESANN (2018) Gomes, H.M., Barddal, J.P., Ferreira, L.E.B., Bifet, A.: Adaptive random forests for data stream regression. In: ESANN (2018)
7.
Zurück zum Zitat Gomes, H.M., Montiel, J., Mastelini, S.M., Pfahringer, B., Bifet, A.: On ensemble techniques for data stream regression. In: 2020 IJCNN. IEEE (2020) Gomes, H.M., Montiel, J., Mastelini, S.M., Pfahringer, B., Bifet, A.: On ensemble techniques for data stream regression. In: 2020 IJCNN. IEEE (2020)
8.
Zurück zum Zitat Hadjicharalambous, M., Polycarpou, M.M., Panayiotou, C.G.: Neural network-based construction of online prediction intervals. Neural Comput. Appl. 32(11), 6715–6733 (2020)CrossRef Hadjicharalambous, M., Polycarpou, M.M., Panayiotou, C.G.: Neural network-based construction of online prediction intervals. Neural Comput. Appl. 32(11), 6715–6733 (2020)CrossRef
9.
Zurück zum Zitat Hahn, G.J., Factors for calculating two-sided prediction intervals for samples from a normal distribution. J. Am. Stat. Assoc. (1969) Hahn, G.J., Factors for calculating two-sided prediction intervals for samples from a normal distribution. J. Am. Stat. Assoc. (1969)
10.
Zurück zum Zitat Hahn, G.J., Nelson, W.: A survey of prediction intervals and their applications. J. Qual. Technol. 5(4), 178–188 (1973)CrossRef Hahn, G.J., Nelson, W.: A survey of prediction intervals and their applications. J. Qual. Technol. 5(4), 178–188 (1973)CrossRef
11.
Zurück zum Zitat Ikonomovska, E., Gama, J., Džeroski, S.: Learning model trees from evolving data streams. Data Min. Knowl. Disc. 23, 128–168 (2011)MathSciNetCrossRef Ikonomovska, E., Gama, J., Džeroski, S.: Learning model trees from evolving data streams. Data Min. Knowl. Disc. 23, 128–168 (2011)MathSciNetCrossRef
12.
Zurück zum Zitat Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans. Neural Netw. 22(3), 337–346 (2010)CrossRef Khosravi, A., Nahavandi, S., Creighton, D., Atiya, A.F.: Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans. Neural Netw. 22(3), 337–346 (2010)CrossRef
13.
Zurück zum Zitat Liu, Y., Zhao, J., Wang, W., Pedrycz, W.: Prediction intervals for granular data streams based on evolving type-2 fuzzy granular neural network dynamic ensemble. IEEE Trans. Fuzzy Syst. 29(4), 874–888 (2020)CrossRef Liu, Y., Zhao, J., Wang, W., Pedrycz, W.: Prediction intervals for granular data streams based on evolving type-2 fuzzy granular neural network dynamic ensemble. IEEE Trans. Fuzzy Syst. 29(4), 874–888 (2020)CrossRef
14.
Zurück zum Zitat Nix, D.A., Weigend, A.S.: Estimating the mean and variance of the target probability distribution. In: ICNN’94. IEEE (1994) Nix, D.A., Weigend, A.S.: Estimating the mean and variance of the target probability distribution. In: ICNN’94. IEEE (1994)
15.
Zurück zum Zitat Shafer, G., Vovk, V.: A tutorial on conformal prediction. J. Mach. Learn. Res. 9(3) (2008) Shafer, G., Vovk, V.: A tutorial on conformal prediction. J. Mach. Learn. Res. 9(3) (2008)
16.
Zurück zum Zitat Shrestha, D.L., Solomatine, D.P.: Machine learning approaches for estimation of prediction interval for the model output. Neural Netw. 19(2), 225–235 (2006)CrossRef Shrestha, D.L., Solomatine, D.P.: Machine learning approaches for estimation of prediction interval for the model output. Neural Netw. 19(2), 225–235 (2006)CrossRef
17.
Zurück zum Zitat Sun, Y., Pfahringer, B., Gomes, H.M., Bifet, A.: SOKNL: a novel way of integrating k-nearest neighbours with adaptive random forest regression for data streams. Data Min. Knowl. Discov. (2022) Sun, Y., Pfahringer, B., Gomes, H.M., Bifet, A.: SOKNL: a novel way of integrating k-nearest neighbours with adaptive random forest regression for data streams. Data Min. Knowl. Discov. (2022)
18.
Zurück zum Zitat Waugh, S.G.: Extending and benchmarking cascade-correlation: extensions to the cascade-correlation architecture and benchmarking of feed-forward supervised artificial neural networks. Ph.D. thesis, University of Tasmania (1995) Waugh, S.G.: Extending and benchmarking cascade-correlation: extensions to the cascade-correlation architecture and benchmarking of feed-forward supervised artificial neural networks. Ph.D. thesis, University of Tasmania (1995)
19.
Zurück zum Zitat Xu, C., Xie, Y.: Conformal prediction interval for dynamic time-series. In: International Conference on Machine Learning, pp. 11559–11569. PMLR (2021) Xu, C., Xie, Y.: Conformal prediction interval for dynamic time-series. In: International Conference on Machine Learning, pp. 11559–11569. PMLR (2021)
20.
Zurück zum Zitat Zhao, J., Wang, W., Sheng, C., Zhao, J., Wang, W., Sheng, C.: Industrial prediction intervals with data uncertainty. In: Data-Driven Prediction for Industrial Processes and Their Applications, pp. 159–222 (2018) Zhao, J., Wang, W., Sheng, C., Zhao, J., Wang, W., Sheng, C.: Industrial prediction intervals with data uncertainty. In: Data-Driven Prediction for Industrial Processes and Their Applications, pp. 159–222 (2018)
21.
Zurück zum Zitat Zhao, X., Barber, S., Taylor, C.C., Milan, Z.: Interval forecasts based on regression trees for streaming data. Adv. Data Anal. Classif. 15, 5–36 (2021)MathSciNetCrossRef Zhao, X., Barber, S., Taylor, C.C., Milan, Z.: Interval forecasts based on regression trees for streaming data. Adv. Data Anal. Classif. 15, 5–36 (2021)MathSciNetCrossRef
Metadaten
Titel
Adaptive Prediction Interval for Data Stream Regression
verfasst von
Yibin Sun
Bernhard Pfahringer
Heitor Murilo Gomes
Albert Bifet
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2259-4_10

Premium Partner