Skip to main content

2024 | OriginalPaper | Buchkapitel

TOPOMA: Time-Series Orthogonal Projection Operator with Moving Average for Interpretable and Training-Free Anomaly Detection

verfasst von : Shanfeng Hu, Ying Huang

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present TOPOMA, a time-series orthogonal projection operator with moving average that can identify anomalous points for multivariate time-series, without requiring any labels nor training. Despite intensive research the problem has received, it remains challenging due to 1) scarcity of labels, 2) occurrence of non-stationarity in online streaming, and 3) trust issues posed by the black-box nature of deep learning models. We tackle these issues by avoiding training a complex model on historical data as in previous work, rather we track a moving average estimate of variable subspaces that can compute the deviation of each time step via orthogonal projection onto the subspace. Further, we propose to replace the popular yet less principled global thresholding function of anomaly scores used in previous work with an adaptive one that can bound the occurrence of anomalous events to a given small probability. Our algorithm is shown to compare favourably with deep learning methods while being transparent to interpret.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Ahmed, C.M., Palleti, V.R., Mathur, A.P.: WADI: a water distribution testbed for research in the design of secure cyber physical systems. In: Proceedings of the 3rd International Workshop on Cyber-Physical Systems for Smart Water Networks, pp. 25–28 (2017) Ahmed, C.M., Palleti, V.R., Mathur, A.P.: WADI: a water distribution testbed for research in the design of secure cyber physical systems. In: Proceedings of the 3rd International Workshop on Cyber-Physical Systems for Smart Water Networks, pp. 25–28 (2017)
4.
Zurück zum Zitat Asatiani, A., et al.: Challenges of explaining the behavior of black-box AI systems. MIS Q. Exec. 19(4), 259–278 (2020)CrossRef Asatiani, A., et al.: Challenges of explaining the behavior of black-box AI systems. MIS Q. Exec. 19(4), 259–278 (2020)CrossRef
5.
Zurück zum Zitat Aydin, I., Karaköse, M., Akin, E.: A robust anomaly detection in pantograph-catenary system based on mean-shift tracking and foreground detection. In: 2013 IEEE International Conference on Systems, Man, and Cybernetics, pp. 4444–4449. IEEE (2013) Aydin, I., Karaköse, M., Akin, E.: A robust anomaly detection in pantograph-catenary system based on mean-shift tracking and foreground detection. In: 2013 IEEE International Conference on Systems, Man, and Cybernetics, pp. 4444–4449. IEEE (2013)
6.
Zurück zum Zitat Boniol, P., Linardi, M., Roncallo, F., Palpanas, T.: Automated anomaly detection in large sequences. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp. 1834–1837. IEEE (2020) Boniol, P., Linardi, M., Roncallo, F., Palpanas, T.: Automated anomaly detection in large sequences. In: 2020 IEEE 36th International Conference on Data Engineering (ICDE), pp. 1834–1837. IEEE (2020)
7.
Zurück zum Zitat Cook, A.A., Mısırlı, G., Fan, Z.: Anomaly detection for IOT time-series data: a survey. IEEE Internet Things J. 7(7), 6481–6494 (2019)CrossRef Cook, A.A., Mısırlı, G., Fan, Z.: Anomaly detection for IOT time-series data: a survey. IEEE Internet Things J. 7(7), 6481–6494 (2019)CrossRef
8.
Zurück zum Zitat Deng, A., Hooi, B.: Graph neural network-based anomaly detection in multivariate time series. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 4027–4035 (2021) Deng, A., Hooi, B.: Graph neural network-based anomaly detection in multivariate time series. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 4027–4035 (2021)
9.
Zurück zum Zitat Desforges, M., Jacob, P., Cooper, J.: Applications of probability density estimation to the detection of abnormal conditions in engineering. Proc. Inst. Mech. Eng. C J. Mech. Eng. Sci. 212(8), 687–703 (1998)CrossRef Desforges, M., Jacob, P., Cooper, J.: Applications of probability density estimation to the detection of abnormal conditions in engineering. Proc. Inst. Mech. Eng. C J. Mech. Eng. Sci. 212(8), 687–703 (1998)CrossRef
10.
Zurück zum Zitat Görnitz, N., Kloft, M., Rieck, K., Brefeld, U.: Toward supervised anomaly detection. J. Artif. Intell. Res. 46, 235–262 (2013)MathSciNetCrossRef Görnitz, N., Kloft, M., Rieck, K., Brefeld, U.: Toward supervised anomaly detection. J. Artif. Intell. Res. 46, 235–262 (2013)MathSciNetCrossRef
11.
Zurück zum Zitat Hogben, L.: Handbook of linear algebra. CRC press (2006) Hogben, L.: Handbook of linear algebra. CRC press (2006)
12.
Zurück zum Zitat Joshi, M.V., Agarwal, R.C., Kumar, V.: Predicting rare classes: can boosting make any weak learner strong? In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 297–306 (2002) Joshi, M.V., Agarwal, R.C., Kumar, V.: Predicting rare classes: can boosting make any weak learner strong? In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 297–306 (2002)
14.
Zurück zum Zitat Lazarevic, A., Kumar, V.: Feature bagging for outlier detection. In: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pp. 157–166 (2005) Lazarevic, A., Kumar, V.: Feature bagging for outlier detection. In: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pp. 157–166 (2005)
15.
Zurück zum Zitat Li, D., Chen, D., Jin, B., Shi, L., Goh, J., Ng, S.-K.: MAD-GAN: multivariate anomaly detection for time series data with generative adversarial networks. In: Tetko, I.V., Kůrková, V., Karpov, P., Theis, F. (eds.) ICANN 2019. LNCS, vol. 11730, pp. 703–716. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-30490-4_56CrossRef Li, D., Chen, D., Jin, B., Shi, L., Goh, J., Ng, S.-K.: MAD-GAN: multivariate anomaly detection for time series data with generative adversarial networks. In: Tetko, I.V., Kůrková, V., Karpov, P., Theis, F. (eds.) ICANN 2019. LNCS, vol. 11730, pp. 703–716. Springer, Cham (2019). https://​doi.​org/​10.​1007/​978-3-030-30490-4_​56CrossRef
16.
Zurück zum Zitat Liang, H., et al.: Robust unsupervised anomaly detection via multi-time scale DCGANS with forgetting mechanism for industrial multivariate time series. Neurocomputing 423, 444–462 (2021)CrossRef Liang, H., et al.: Robust unsupervised anomaly detection via multi-time scale DCGANS with forgetting mechanism for industrial multivariate time series. Neurocomputing 423, 444–462 (2021)CrossRef
17.
Zurück zum Zitat Liu, Y., Lin, Y., Xiao, Q., Hu, G., Wang, J.: Self-adversarial variational autoencoder with spectral residual for time series anomaly detection. Neurocomputing 458, 349–363 (2021)CrossRef Liu, Y., Lin, Y., Xiao, Q., Hu, G., Wang, J.: Self-adversarial variational autoencoder with spectral residual for time series anomaly detection. Neurocomputing 458, 349–363 (2021)CrossRef
18.
Zurück zum Zitat Ma, D., Yuan, Y., Wang, Q.: Hyperspectral anomaly detection via discriminative feature learning with multiple-dictionary sparse representation. Remote Sens. 10(5), 745 (2018)CrossRef Ma, D., Yuan, Y., Wang, Q.: Hyperspectral anomaly detection via discriminative feature learning with multiple-dictionary sparse representation. Remote Sens. 10(5), 745 (2018)CrossRef
19.
Zurück zum Zitat Mathur, A.P., Tippenhauer, N.O.: SWaT: a water treatment testbed for research and training on ICS security. In: 2016 International Workshop on Cyber-physical systems for Smart Water Networks (CySWater), pp. 31–36. IEEE (2016) Mathur, A.P., Tippenhauer, N.O.: SWaT: a water treatment testbed for research and training on ICS security. In: 2016 International Workshop on Cyber-physical systems for Smart Water Networks (CySWater), pp. 31–36. IEEE (2016)
20.
Zurück zum Zitat Namuduri, S., Narayanan, B.N., Davuluru, V.S.P., Burton, L., Bhansali, S.: Deep learning methods for sensor based predictive maintenance and future perspectives for electrochemical sensors. J. Electrochem. Soc. 167(3), 037552 (2020)CrossRef Namuduri, S., Narayanan, B.N., Davuluru, V.S.P., Burton, L., Bhansali, S.: Deep learning methods for sensor based predictive maintenance and future perspectives for electrochemical sensors. J. Electrochem. Soc. 167(3), 037552 (2020)CrossRef
21.
Zurück zum Zitat Park, D., Hoshi, Y., Kemp, C.C.: A multimodal anomaly detector for robot-assisted feeding using an LSTM-based variational autoencoder. IEEE Robot. Autom. Lett. 3(3), 1544–1551 (2018)CrossRef Park, D., Hoshi, Y., Kemp, C.C.: A multimodal anomaly detector for robot-assisted feeding using an LSTM-based variational autoencoder. IEEE Robot. Autom. Lett. 3(3), 1544–1551 (2018)CrossRef
22.
Zurück zum Zitat Saw, J.G., Yang, M.C., Mo, T.C.: Chebyshev inequality with estimated mean and variance. Am. Stat. 38(2), 130–132 (1984)MathSciNetCrossRef Saw, J.G., Yang, M.C., Mo, T.C.: Chebyshev inequality with estimated mean and variance. Am. Stat. 38(2), 130–132 (1984)MathSciNetCrossRef
23.
Zurück zum Zitat Shyu, M.L., Chen, S.C., Sarinnapakorn, K., Chang, L.: A novel anomaly detection scheme based on principal component classifier. MIAMI UNIV CORAL GABLES FL DEPT OF ELECTRICAL AND COMPUTER ENGINEERING, Tech. rep. (2003) Shyu, M.L., Chen, S.C., Sarinnapakorn, K., Chang, L.: A novel anomaly detection scheme based on principal component classifier. MIAMI UNIV CORAL GABLES FL DEPT OF ELECTRICAL AND COMPUTER ENGINEERING, Tech. rep. (2003)
24.
Zurück zum Zitat Tang, Z., Chen, Z., Bao, Y., Li, H.: Convolutional neural network-based data anomaly detection method using multiple information for structural health monitoring. Struct. Control. Health Monit. 26(1), e2296 (2019)CrossRef Tang, Z., Chen, Z., Bao, Y., Li, H.: Convolutional neural network-based data anomaly detection method using multiple information for structural health monitoring. Struct. Control. Health Monit. 26(1), e2296 (2019)CrossRef
25.
Zurück zum Zitat Welford, B.: Note on a method for calculating corrected sums of squares and products. Technometrics 4(3), 419–420 (1962)MathSciNetCrossRef Welford, B.: Note on a method for calculating corrected sums of squares and products. Technometrics 4(3), 419–420 (1962)MathSciNetCrossRef
26.
Zurück zum Zitat Xia, X., et al.: GAN-based anomaly detection: a review. Neurocomputing (2022) Xia, X., et al.: GAN-based anomaly detection: a review. Neurocomputing (2022)
27.
Zurück zum Zitat Zavrtanik, V., Kristan, M., Skočaj, D.: Draem-a discriminatively trained reconstruction embedding for surface anomaly detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8330–8339 (2021) Zavrtanik, V., Kristan, M., Skočaj, D.: Draem-a discriminatively trained reconstruction embedding for surface anomaly detection. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 8330–8339 (2021)
28.
Zurück zum Zitat Zhou, C., Paffenroth, R.C.: Anomaly detection with robust deep autoencoders. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 665–674 (2017) Zhou, C., Paffenroth, R.C.: Anomaly detection with robust deep autoencoders. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 665–674 (2017)
29.
Zurück zum Zitat Zhou, Y., Liang, X., Zhang, W., Zhang, L., Song, X.: VAE-based deep SVDD for anomaly detection. Neurocomputing 453, 131–140 (2021)CrossRef Zhou, Y., Liang, X., Zhang, W., Zhang, L., Song, X.: VAE-based deep SVDD for anomaly detection. Neurocomputing 453, 131–140 (2021)CrossRef
30.
Zurück zum Zitat Zong, B., et al.: Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: International Conference on Learning Representations (2018) Zong, B., et al.: Deep autoencoding gaussian mixture model for unsupervised anomaly detection. In: International Conference on Learning Representations (2018)
Metadaten
Titel
TOPOMA: Time-Series Orthogonal Projection Operator with Moving Average for Interpretable and Training-Free Anomaly Detection
verfasst von
Shanfeng Hu
Ying Huang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2242-6_5

Premium Partner