Skip to main content

2024 | OriginalPaper | Buchkapitel

SeeM: A Shared Latent Variable Model for Unsupervised Multi-view Anomaly Detection

verfasst von : Phuong Nguyen, Tuan M. V. Le

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

There have been multiple attempts to tackle the problem of identifying abnormal instances that have inconsistent behaviors in multi-view data (i.e., multi-view anomalies) but the problem still remains a challenge. In this paper, we propose an unsupervised approach with probabilistic latent variable models to detect multi-view anomalies in multi-view data. In our proposed model, we assume that views of an instance are generated from a shared latent variable that uniformly represents that instance. Since the latent variable is shared across views, an abnormal instance that exhibits inconsistencies across different views would have a lower likelihood. This is because, using a single latent variable, the model could not explain well all views that are inconsistent. Therefore, the likelihood of instances based on the proposed shared latent variable model can be used to detect multi-view anomalies. We derive a variational inference algorithm for learning the model parameters that scales well to large datasets. We compare our proposed method with several state-of-the-art methods for multi-view anomaly detection on several datasets. The results show that our method outperforms the existing methods in detecting multi-view anomalies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
Experimentally, non-linear neural networks work well for our problem in most of datasets. In the experiments, we use \(\mu _{\theta }^{(v)}(z_n)=\text {Linear}(\text {ReLU}(\text {Linear}(z_n)))\).
 
3
In our experiments, \(\alpha =1\) and \(\sigma =0.001\) work well for most of the datasets.
 
4
\(L=1\) works well in our experiments.
 
5
We use Adam optimization algorithm.
 
20
We use the implementations from scikit-learn.
 
Literatur
1.
Zurück zum Zitat Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: Lof: identifying density-based local outliers. In: ACM sigmod record. vol. 29, pp. 93–104. ACM (2000) Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: Lof: identifying density-based local outliers. In: ACM sigmod record. vol. 29, pp. 93–104. ACM (2000)
2.
Zurück zum Zitat Chen, M.S., Huang, L., Wang, C.D., Huang, D.: Multi-view clustering in latent embedding space. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3513–3520 (2020) Chen, M.S., Huang, L., Wang, C.D., Huang, D.: Multi-view clustering in latent embedding space. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3513–3520 (2020)
3.
Zurück zum Zitat Cheng, L., Wang, Y., Liu, X.: Neighborhood consensus networks for unsupervised multi-view outlier detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 7099–7106 (2021) Cheng, L., Wang, Y., Liu, X.: Neighborhood consensus networks for unsupervised multi-view outlier detection. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 7099–7106 (2021)
4.
Zurück zum Zitat Frey, B.J., Dueck, D.: Mixture modeling by affinity propagation. In: Advances in Neural Information Processing Systems 18 (2005) Frey, B.J., Dueck, D.: Mixture modeling by affinity propagation. In: Advances in Neural Information Processing Systems 18 (2005)
5.
Zurück zum Zitat Geng, Y., Han, Z., Zhang, C., Hu, Q.: Uncertainty-aware multi-view representation learning. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 35, pp. 7545–7553 (2021) Geng, Y., Han, Z., Zhang, C., Hu, Q.: Uncertainty-aware multi-view representation learning. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 35, pp. 7545–7553 (2021)
6.
Zurück zum Zitat Goyal, S., Raghunathan, A., Jain, M., Simhadri, H.V., Jain, P.: Drocc: deep robust one-class classification. ArXiv abs/2002.12718 (2020) Goyal, S., Raghunathan, A., Jain, M., Simhadri, H.V., Jain, P.: Drocc: deep robust one-class classification. ArXiv abs/2002.12718 (2020)
7.
Zurück zum Zitat Handong, Z., Yun, F.: Dual-regularized multi-view outlier detection. In: IJCAI, pp. 4077–4083 (2015) Handong, Z., Yun, F.: Dual-regularized multi-view outlier detection. In: IJCAI, pp. 4077–4083 (2015)
8.
Zurück zum Zitat Iwata, T., Yamada, M.: Multi-view anomaly detection via robust probabilistic latent variable models. In: Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29 (2016) Iwata, T., Yamada, M.: Multi-view anomaly detection via robust probabilistic latent variable models. In: Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 29 (2016)
9.
Zurück zum Zitat Ji, Y.X., et al.: Multi-view outlier detection in deep intact space. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 1132–1137. IEEE (2019) Ji, Y.X., et al.: Multi-view outlier detection in deep intact space. In: 2019 IEEE International Conference on Data Mining (ICDM), pp. 1132–1137. IEEE (2019)
10.
Zurück zum Zitat Kingma, D., Welling, M.: Auto-encoding variational bayes (12 2014) Kingma, D., Welling, M.: Auto-encoding variational bayes (12 2014)
11.
Zurück zum Zitat Li, K., Li, S., Ding, Z., Zhang, W., Fu, Y.: Latent discriminant subspace representations for multi-view outlier detection. In: Proceedings of the AAAI Conference on Artificial Intelligence 32(1) (Apr 2018) Li, K., Li, S., Ding, Z., Zhang, W., Fu, Y.: Latent discriminant subspace representations for multi-view outlier detection. In: Proceedings of the AAAI Conference on Artificial Intelligence 32(1) (Apr 2018)
12.
Zurück zum Zitat Li, S., Shao, M., Fu, Y.: Multi-view low-rank analysis for outlier detection. In: Proceedings of the SIAM International Conference on Data Mining (2015) Li, S., Shao, M., Fu, Y.: Multi-view low-rank analysis for outlier detection. In: Proceedings of the SIAM International Conference on Data Mining (2015)
13.
Zurück zum Zitat Lin, Y., Gou, Y., Liu, Z., Li, B., Lv, J., Peng, X.: Completer: incomplete multi-view clustering via contrastive prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11174–11183 (2021) Lin, Y., Gou, Y., Liu, Z., Li, B., Lv, J., Peng, X.: Completer: incomplete multi-view clustering via contrastive prediction. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 11174–11183 (2021)
14.
Zurück zum Zitat Liu, A.Y., Lam, D.N.: Using consensus clustering for multi-view anomaly detection. In: 2012 IEEE Symposium on Security and Privacy Workshops, pp. 117–124 (2012) Liu, A.Y., Lam, D.N.: Using consensus clustering for multi-view anomaly detection. In: 2012 IEEE Symposium on Security and Privacy Workshops, pp. 117–124 (2012)
15.
Zurück zum Zitat Liu, F.T., Ting, K.M., Zhou, Z.H.: Isolation forest. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 413–422 (2008) Liu, F.T., Ting, K.M., Zhou, Z.H.: Isolation forest. In: 2008 Eighth IEEE International Conference on Data Mining, pp. 413–422 (2008)
16.
Zurück zum Zitat Marcos Alvarez, A., Yamada, M., Kimura, A., Iwata, T.: Clustering-based anomaly detection in multi-view data. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, pp. 1545–1548 (2013) Marcos Alvarez, A., Yamada, M., Kimura, A., Iwata, T.: Clustering-based anomaly detection in multi-view data. In: Proceedings of the 22nd ACM International Conference on Information and Knowledge Management, pp. 1545–1548 (2013)
17.
Zurück zum Zitat Peng, X., Huang, Z., Lv, J., Zhu, H., Zhou, J.T.: Comic: Multi-view clustering without parameter selection. In: International Conference on Machine Learning, pp. 5092–5101. PMLR (2019) Peng, X., Huang, Z., Lv, J., Zhu, H., Zhou, J.T.: Comic: Multi-view clustering without parameter selection. In: International Conference on Machine Learning, pp. 5092–5101. PMLR (2019)
18.
Zurück zum Zitat Rezende, D.J., Mohamed, S., Wierstra, D.: Stochastic backpropagation and approximate inference in deep generative models. In: International Conference on Machine Learning, pp. 1278–1286. PMLR (2014) Rezende, D.J., Mohamed, S., Wierstra, D.: Stochastic backpropagation and approximate inference in deep generative models. In: International Conference on Machine Learning, pp. 1278–1286. PMLR (2014)
19.
Zurück zum Zitat Seeland, M., Mäder, P.: Multi-view classification with convolutional neural networks. PLoS ONE 16(1), e0245230 (2021)CrossRef Seeland, M., Mäder, P.: Multi-view classification with convolutional neural networks. PLoS ONE 16(1), e0245230 (2021)CrossRef
20.
Zurück zum Zitat Sheng, X.R., Zhan, D.C., Lu, S., Jiang, Y.: Multi-view anomaly detection: neighborhood in locality matters. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 33, pp. 4894–4901 (2019) Sheng, X.R., Zhan, D.C., Lu, S., Jiang, Y.: Multi-view anomaly detection: neighborhood in locality matters. In: Proceedings of the AAAI Conference on Artificial Intelligence. vol. 33, pp. 4894–4901 (2019)
21.
Zurück zum Zitat Wang, X., Peng, D., Hu, P., Sang, Y.: Adversarial correlated autoencoder for unsupervised multi-view representation learning. Knowledge-Based Systems (2019) Wang, X., Peng, D., Hu, P., Sang, Y.: Adversarial correlated autoencoder for unsupervised multi-view representation learning. Knowledge-Based Systems (2019)
22.
Zurück zum Zitat Wang, Y., Chen, C., Lai, J., Fu, L., Zhou, Y., Zheng, Z.: A self-representation method with local similarity preserving for fast multi-view outlier detection. ACM Trans. Knowl. Discov. Data 17(1), 1–20 (2023) Wang, Y., Chen, C., Lai, J., Fu, L., Zhou, Y., Zheng, Z.: A self-representation method with local similarity preserving for fast multi-view outlier detection. ACM Trans. Knowl. Discov. Data 17(1), 1–20 (2023)
23.
Zurück zum Zitat Wang, Z., Fan, M., Muknahallipatna, S., Lan, C.: Inductive multi-view semi-supervised anomaly detection via probabilistic modeling. In: 2019 IEEE International Conference on Big Knowledge (ICBK), pp. 257–264. IEEE (2019) Wang, Z., Fan, M., Muknahallipatna, S., Lan, C.: Inductive multi-view semi-supervised anomaly detection via probabilistic modeling. In: 2019 IEEE International Conference on Big Knowledge (ICBK), pp. 257–264. IEEE (2019)
24.
Zurück zum Zitat Wang, Z., Lan, C.: Towards a hierarchical bayesian model of multi-view anomaly detection. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, pp. 2420–2426 (7 2020), main track Wang, Z., Lan, C.: Towards a hierarchical bayesian model of multi-view anomaly detection. In: Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20, pp. 2420–2426 (7 2020), main track
25.
Zurück zum Zitat Wang, Z., et al.: Learning probabilistic latent structure for outlier detection from multi-view data. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 53–65 (2021) Wang, Z., et al.: Learning probabilistic latent structure for outlier detection from multi-view data. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 53–65 (2021)
26.
Zurück zum Zitat Xie, X., Sun, S.: Multi-view support vector machines with the consensus and complementarity information. IEEE TKDE 32(12), 2401–2413 (2019) Xie, X., Sun, S.: Multi-view support vector machines with the consensus and complementarity information. IEEE TKDE 32(12), 2401–2413 (2019)
27.
Zurück zum Zitat Xu, C., Guan, Z., Zhao, W., Niu, Y., Wang, Q., Wang, Z.: Deep multi-view concept learning. In: IJCAI, pp. 2898–2904. Stockholm (2018) Xu, C., Guan, Z., Zhao, W., Niu, Y., Wang, Q., Wang, Z.: Deep multi-view concept learning. In: IJCAI, pp. 2898–2904. Stockholm (2018)
28.
Zurück zum Zitat Xu, H., Pang, G., Wang, Y., Wang, Y.: Deep isolation forest for anomaly detection. IEEE Transactions on Knowledge and Data Engineering, pp. 1–14 (2023) Xu, H., Pang, G., Wang, Y., Wang, Y.: Deep isolation forest for anomaly detection. IEEE Transactions on Knowledge and Data Engineering, pp. 1–14 (2023)
29.
Zurück zum Zitat Xu, J., Li, W., Liu, X., Zhang, D., Liu, J., Han, J.: Deep embedded complementary and interactive information for multi-view classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 6494–6501 (2020) Xu, J., Li, W., Liu, X., Zhang, D., Liu, J., Han, J.: Deep embedded complementary and interactive information for multi-view classification. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 6494–6501 (2020)
30.
Zurück zum Zitat Zhao, H., Liu, H., Ding, Z., Fu, Y.: Consensus regularized multi-view outlier detection. IEEE Trans. Image Process. 27(1), 236–248 (2017)MathSciNetCrossRef Zhao, H., Liu, H., Ding, Z., Fu, Y.: Consensus regularized multi-view outlier detection. IEEE Trans. Image Process. 27(1), 236–248 (2017)MathSciNetCrossRef
31.
Zurück zum Zitat Zhao, J., Xie, X., Xu, X., Sun, S.: Multi-view learning overview: Recent progress and new challenges. Inform. Fusion 38, 43–54 (2017)CrossRef Zhao, J., Xie, X., Xu, X., Sun, S.: Multi-view learning overview: Recent progress and new challenges. Inform. Fusion 38, 43–54 (2017)CrossRef
Metadaten
Titel
SeeM: A Shared Latent Variable Model for Unsupervised Multi-view Anomaly Detection
verfasst von
Phuong Nguyen
Tuan M. V. Le
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2242-6_7

Premium Partner