Skip to main content
Erschienen in:
Buchtitelbild

2024 | OriginalPaper | Buchkapitel

A Novel Bayes’ Theorem for Upper Probabilities

verfasst von : Michele Caprio, Yusuf Sale, Eyke Hüllermeier, Insup Lee

Erschienen in: Epistemic Uncertainty in Artificial Intelligence

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In their seminal 1990 paper, Wasserman and Kadane establish an upper bound for the Bayes’ posterior probability of a measurable set A, when the prior lies in a class of probability measures \(\mathcal {P}\) and the likelihood is precise. They also give a sufficient condition for such upper bound to hold with equality. In this paper, we introduce a generalization of their result by additionally addressing uncertainty related to the likelihood. We give an upper bound for the posterior probability when both the prior and the likelihood belong to a set of probabilities. Furthermore, we give a sufficient condition for this upper bound to become an equality. This result is interesting on its own, and has the potential of being applied to various fields of engineering (e.g. model predictive control), machine learning, and artificial intelligence.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Recall that in the weak\(^\star \) topology, a net \((P_\alpha )_{\alpha \in I}\) converges to P if and only if \(P_\alpha (A) \rightarrow P(A)\), for all \(A \in \mathcal {F}\). See also results presented in [29, Appendix D3].
 
Literatur
1.
Zurück zum Zitat Augustin, T., Coolen, F.P.A., De Cooman, G., Troffaes, M.C.M. (eds.): Introduction to Imprecise Probabilities. Wiley Series in Probability and Statistics, Wiley, Hoboken (2014) Augustin, T., Coolen, F.P.A., De Cooman, G., Troffaes, M.C.M. (eds.): Introduction to Imprecise Probabilities. Wiley Series in Probability and Statistics, Wiley, Hoboken (2014)
2.
Zurück zum Zitat Berger, J.O.: The robust Bayesian viewpoint. In: Kadane, J.B. (ed.) Robustness of Bayesian Analyses. North-Holland, Amsterdam (1984) Berger, J.O.: The robust Bayesian viewpoint. In: Kadane, J.B. (ed.) Robustness of Bayesian Analyses. North-Holland, Amsterdam (1984)
4.
Zurück zum Zitat Caprio, M., Gong, R.: Dynamic imprecise probability kinematics. In: Proceedings of Machine Learning Research, vol. 215, pp. 72–83 (2023) Caprio, M., Gong, R.: Dynamic imprecise probability kinematics. In: Proceedings of Machine Learning Research, vol. 215, pp. 72–83 (2023)
6.
Zurück zum Zitat Cerreia-Vioglio, S., Maccheroni, F., Marinacci, M.: Ergodic theorems for lower probabilities. Proc. Am. Math. Soc. 144, 3381–3396 (2015)MathSciNetCrossRef Cerreia-Vioglio, S., Maccheroni, F., Marinacci, M.: Ergodic theorems for lower probabilities. Proc. Am. Math. Soc. 144, 3381–3396 (2015)MathSciNetCrossRef
8.
Zurück zum Zitat Depeweg, S., Hernandez-Lobato, J.M., Doshi-Velez, F., Udluft, S.: Decomposition of uncertainty in Bayesian deep learning for efficient and risk-sensitive learning. In: Dy, J., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 80, pp. 1184–1193. PMLR (2018) Depeweg, S., Hernandez-Lobato, J.M., Doshi-Velez, F., Udluft, S.: Decomposition of uncertainty in Bayesian deep learning for efficient and risk-sensitive learning. In: Dy, J., Krause, A. (eds.) Proceedings of the 35th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 80, pp. 1184–1193. PMLR (2018)
10.
Zurück zum Zitat Epstein, L.G., Wang, T.: Intertemporal asset pricing under Knightian uncertainty. Econometrica 62(2), 283–322 (1994)CrossRef Epstein, L.G., Wang, T.: Intertemporal asset pricing under Knightian uncertainty. Econometrica 62(2), 283–322 (1994)CrossRef
11.
Zurück zum Zitat de Finetti, B.: Theory of Probability, vol. 1. Wiley, New York (1974) de Finetti, B.: Theory of Probability, vol. 1. Wiley, New York (1974)
12.
Zurück zum Zitat de Finetti, B.: Theory of Probability, vol. 2. Wiley, New York (1975) de Finetti, B.: Theory of Probability, vol. 2. Wiley, New York (1975)
13.
Zurück zum Zitat Giacomini, R., Kitagawa, T.: Robust Bayesian inference for set-identified models. Econometrica 89(4), 1519–1556 (2021)MathSciNetCrossRef Giacomini, R., Kitagawa, T.: Robust Bayesian inference for set-identified models. Econometrica 89(4), 1519–1556 (2021)MathSciNetCrossRef
14.
Zurück zum Zitat Gilboa, I., Marinacci, M.: Ambiguity and the Bayesian paradigm. In: Acemoglu, D., Arellano, M., Dekel, E. (eds.) Advances in Economics and Econometrics, Tenth World Congress, vol. 1. Cambridge University Press, Cambridge (2013) Gilboa, I., Marinacci, M.: Ambiguity and the Bayesian paradigm. In: Acemoglu, D., Arellano, M., Dekel, E. (eds.) Advances in Economics and Econometrics, Tenth World Congress, vol. 1. Cambridge University Press, Cambridge (2013)
15.
Zurück zum Zitat Gong, R., Meng, X.L.: Judicious judgment meets unsettling updating: dilation, sure loss, and Simpson’s paradox. Stat. Sci. 36(2), 169–190 (2021)MathSciNetCrossRef Gong, R., Meng, X.L.: Judicious judgment meets unsettling updating: dilation, sure loss, and Simpson’s paradox. Stat. Sci. 36(2), 169–190 (2021)MathSciNetCrossRef
16.
Zurück zum Zitat Grünwald, P., van Ommen, T.: Inconsistency of Bayesian inference for misspecified linear models, and a proposal for repairing it. Bayesian Anal. 12(4), 1069–1103 (2017)MathSciNetCrossRef Grünwald, P., van Ommen, T.: Inconsistency of Bayesian inference for misspecified linear models, and a proposal for repairing it. Bayesian Anal. 12(4), 1069–1103 (2017)MathSciNetCrossRef
17.
Zurück zum Zitat Huber, P.J., Ronchetti, E.M.: Robust Statistics. Wiley Series in Probability and Statistics, 2nd edn. Wiley, Hoboken (2009)CrossRef Huber, P.J., Ronchetti, E.M.: Robust Statistics. Wiley Series in Probability and Statistics, 2nd edn. Wiley, Hoboken (2009)CrossRef
18.
Zurück zum Zitat Hüllermeier, E., Waegeman, W.: Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach. Learn. 3(110), 457–506 (2021)MathSciNetCrossRef Hüllermeier, E., Waegeman, W.: Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods. Mach. Learn. 3(110), 457–506 (2021)MathSciNetCrossRef
20.
Zurück zum Zitat Kendall, A., Gal, Y.: What uncertainties do we need in Bayesian deep learning for computer vision? In: Advances in Neural Information Processing Systems, vol. 30 (2017) Kendall, A., Gal, Y.: What uncertainties do we need in Bayesian deep learning for computer vision? In: Advances in Neural Information Processing Systems, vol. 30 (2017)
21.
Zurück zum Zitat Klibanoff, P., Hanany, E.: Updating preferences with multiple priors. Theor. Econ. 2(3), 261–298 (2007) Klibanoff, P., Hanany, E.: Updating preferences with multiple priors. Theor. Econ. 2(3), 261–298 (2007)
22.
Zurück zum Zitat Marinacci, M., Montrucchio, L.: Introduction to the mathematics of ambiguity. In: Gilboa, I. (ed.) Uncertainty in Economic Theory: A Collection of Essays in Honor of David Schmeidler’s 65th Birthday. Routledge, London (2004) Marinacci, M., Montrucchio, L.: Introduction to the mathematics of ambiguity. In: Gilboa, I. (ed.) Uncertainty in Economic Theory: A Collection of Essays in Honor of David Schmeidler’s 65th Birthday. Routledge, London (2004)
23.
Zurück zum Zitat Rakovi, S.V., Levine, W.S.: Handbook of Model Predictive Control, 1st edn. Birkhäuser, Basel (2018) Rakovi, S.V., Levine, W.S.: Handbook of Model Predictive Control, 1st edn. Birkhäuser, Basel (2018)
24.
Zurück zum Zitat Rudin, W.: Principles of Mathematical Analysis, 3rd edn. McGraw-Hill, New York (1976) Rudin, W.: Principles of Mathematical Analysis, 3rd edn. McGraw-Hill, New York (1976)
25.
Zurück zum Zitat Sale, Y., Caprio, M., Hüllermeier, E.: Is the volume of a credal set a good measure for epistemic uncertainty? In: Evans, R.J., Shpitser, I. (eds.) Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence. Proceedings of Machine Learning Research, vol. 216, pp. 1795–1804. PMLR (2023) Sale, Y., Caprio, M., Hüllermeier, E.: Is the volume of a credal set a good measure for epistemic uncertainty? In: Evans, R.J., Shpitser, I. (eds.) Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence. Proceedings of Machine Learning Research, vol. 216, pp. 1795–1804. PMLR (2023)
26.
Zurück zum Zitat Smith, L., Gal, Y.: Understanding measures of uncertainty for adversarial example detection. arXiv preprint arXiv:1803.08533 (2018) Smith, L., Gal, Y.: Understanding measures of uncertainty for adversarial example detection. arXiv preprint arXiv:​1803.​08533 (2018)
27.
Zurück zum Zitat Troffaes, M.C., de Cooman, G.: Lower Previsions. Wiley, Chichester (2014)CrossRef Troffaes, M.C., de Cooman, G.: Lower Previsions. Wiley, Chichester (2014)CrossRef
28.
Zurück zum Zitat Walley, P.: Coherent lower (and upper) probabilities. Technical report, University of Warwick, Coventry (1981) Walley, P.: Coherent lower (and upper) probabilities. Technical report, University of Warwick, Coventry (1981)
29.
Zurück zum Zitat Walley, P.: Statistical Reasoning with Imprecise Probabilities, Monographs on Statistics and Applied Probability, vol. 42. Chapman and Hall, London (1991)CrossRef Walley, P.: Statistical Reasoning with Imprecise Probabilities, Monographs on Statistics and Applied Probability, vol. 42. Chapman and Hall, London (1991)CrossRef
30.
31.
Zurück zum Zitat Wimmer, L., Sale, Y., Hofman, P., Bischl, B., Hüllermeier, E.: Quantifying aleatoric and epistemic uncertainty in machine learning: are conditional entropy and mutual information appropriate measures? In: Evans, R.J., Shpitser, I. (eds.) Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence. Proceedings of Machine Learning Research, vol. 216, pp. 2282–2292. PMLR (2023) Wimmer, L., Sale, Y., Hofman, P., Bischl, B., Hüllermeier, E.: Quantifying aleatoric and epistemic uncertainty in machine learning: are conditional entropy and mutual information appropriate measures? In: Evans, R.J., Shpitser, I. (eds.) Proceedings of the Thirty-Ninth Conference on Uncertainty in Artificial Intelligence. Proceedings of Machine Learning Research, vol. 216, pp. 2282–2292. PMLR (2023)
Metadaten
Titel
A Novel Bayes’ Theorem for Upper Probabilities
verfasst von
Michele Caprio
Yusuf Sale
Eyke Hüllermeier
Insup Lee
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-57963-9_1

Premium Partner