Skip to main content
Erschienen in:
Buchtitelbild

2024 | OriginalPaper | Buchkapitel

Re-thinking Human Activity Recognition with Hierarchy-Aware Label Relationship Modeling

verfasst von : Jingwei Zuo, Hakim Hacid

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Human Activity Recognition (HAR) has been studied for decades, from data collection, learning models, to post-processing and result interpretations. However, the inherent hierarchy in the activities remains relatively under-explored, despite its significant impact on model performance and interpretation. In this paper, we propose H-HAR, by rethinking the HAR tasks from a fresh perspective by delving into their intricate global label relationships. Rather than building multiple classifiers separately for multi-layered activities, we explore the efficacy of a flat model enhanced with graph-based label relationship modeling. Being hierarchy-aware, the graph-based label modeling enhances the fundamental HAR model, by incorporating intricate label relationships into the model. We validate the proposal with a multi-label classifier on complex human activity data. The results highlight the advantages of the proposal, which can be vertically integrated into advanced HAR models to further enhance their performances.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banerjee, S., Akkaya, C., Perez-Sorrosal, F., Tsioutsiouliklis, K.: Hierarchical transfer learning for multi-label text classification. In: ACL, pp. 6295–6300 (2019) Banerjee, S., Akkaya, C., Perez-Sorrosal, F., Tsioutsiouliklis, K.: Hierarchical transfer learning for multi-label text classification. In: ACL, pp. 6295–6300 (2019)
3.
Zurück zum Zitat Chen, H., Ma, Q., Lin, Z., Yan, J.: Hierarchy-aware label semantics matching network for hierarchical text classification. In: ACL, pp. 4370–4379 (2021) Chen, H., Ma, Q., Lin, Z., Yan, J.: Hierarchy-aware label semantics matching network for hierarchical text classification. In: ACL, pp. 4370–4379 (2021)
4.
Zurück zum Zitat Debache, I., Jeantet, L., Chevallier, D., Bergouignan, A., Sueur, C.: A lean and performant hierarchical model for human activity recognition using body-mounted sensors. Sensors 20(11), 3090 (2020)CrossRef Debache, I., Jeantet, L., Chevallier, D., Bergouignan, A., Sueur, C.: A lean and performant hierarchical model for human activity recognition using body-mounted sensors. Sensors 20(11), 3090 (2020)CrossRef
5.
Zurück zum Zitat Dumais, S., Chen, H.: Hierarchical classification of web content. In: SIGIR, pp. 256–263 (2000) Dumais, S., Chen, H.: Hierarchical classification of web content. In: SIGIR, pp. 256–263 (2000)
6.
Zurück zum Zitat Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., Krishnan, D.: Supervised contrastive learning. NeurIPS 33, 18661–18673 (2020) Khosla, P., Teterwak, P., Wang, C., Sarna, A., Tian, Y., Isola, P., Maschinot, A., Liu, C., Krishnan, D.: Supervised contrastive learning. NeurIPS 33, 18661–18673 (2020)
7.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2017) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2017)
8.
Zurück zum Zitat Leutheuser, H., Schuldhaus, D., Eskofier, B.M.: Hierarchical, multi-sensor based classification of daily life activities: comparison with state-of-the-art algorithms using a benchmark dataset. PLoS ONE 8(10), e75196 (2013)CrossRef Leutheuser, H., Schuldhaus, D., Eskofier, B.M.: Hierarchical, multi-sensor based classification of daily life activities: comparison with state-of-the-art algorithms using a benchmark dataset. PLoS ONE 8(10), e75196 (2013)CrossRef
9.
Zurück zum Zitat Reyes-Ortiz, J.L., Oneto, L., Samà, A., Parra, X., Anguita, D.: Transition-aware human activity recognition using smartphones. Neurocomputing 171, 754–767 (2016)CrossRef Reyes-Ortiz, J.L., Oneto, L., Samà, A., Parra, X., Anguita, D.: Transition-aware human activity recognition using smartphones. Neurocomputing 171, 754–767 (2016)CrossRef
10.
Zurück zum Zitat Shimura, K., Li, J., Fukumoto, F.: HFT-CNN: learning hierarchical category structure for multi-label short text categorization. In: ACL, pp. 811–816 (2018) Shimura, K., Li, J., Fukumoto, F.: HFT-CNN: learning hierarchical category structure for multi-label short text categorization. In: ACL, pp. 811–816 (2018)
11.
Zurück zum Zitat Thu, N.T.H., Han, D.S.: HiHAR: a hierarchical hybrid deep learning architecture for wearable sensor-based human activity recognition. IEEE Access 9, 145271–145281 (2021)CrossRef Thu, N.T.H., Han, D.S.: HiHAR: a hierarchical hybrid deep learning architecture for wearable sensor-based human activity recognition. IEEE Access 9, 145271–145281 (2021)CrossRef
12.
Zurück zum Zitat Tonioni, A., Di Stefano, L.: Domain invariant hierarchical embedding for grocery products recognition. CVIU 182, 81–92 (2019) Tonioni, A., Di Stefano, L.: Domain invariant hierarchical embedding for grocery products recognition. CVIU 182, 81–92 (2019)
13.
Zurück zum Zitat Wang, Z., Wang, P., Huang, L., Sun, X., Wang, H.: Incorporating hierarchy into text encoder: a contrastive learning approach for hierarchical text classification. In: ACL, pp. 7109–7119 (2022) Wang, Z., Wang, P., Huang, L., Sun, X., Wang, H.: Incorporating hierarchy into text encoder: a contrastive learning approach for hierarchical text classification. In: ACL, pp. 7109–7119 (2022)
14.
Zurück zum Zitat Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph wavenet for deep spatial-temporal graph modeling. In: IJCAI, pp. 1907–1913 (2019) Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph wavenet for deep spatial-temporal graph modeling. In: IJCAI, pp. 1907–1913 (2019)
15.
Zurück zum Zitat Zhang, S., McCullagh, P., Nugent, C., Zheng, H.: Activity monitoring using a smart phone’s accelerometer with hierarchical classification. In: 2010 Sixth International Conference on Intelligent Environments, pp. 158–163. IEEE (2010) Zhang, S., McCullagh, P., Nugent, C., Zheng, H.: Activity monitoring using a smart phone’s accelerometer with hierarchical classification. In: 2010 Sixth International Conference on Intelligent Environments, pp. 158–163. IEEE (2010)
16.
Zurück zum Zitat Zhang, X., Zhou, F., Lin, Y., Zhang, S.: Embedding label structures for fine-grained feature representation. In: CVPR, pp. 1114–1123 (2016) Zhang, X., Zhou, F., Lin, Y., Zhang, S.: Embedding label structures for fine-grained feature representation. In: CVPR, pp. 1114–1123 (2016)
17.
Zurück zum Zitat Zheng, Y.: Human activity recognition based on the hierarchical feature selection and classification framework. J. Elect. Comput. Eng. 2015, 34–34 (2015) Zheng, Y.: Human activity recognition based on the hierarchical feature selection and classification framework. J. Elect. Comput. Eng. 2015, 34–34 (2015)
18.
Zurück zum Zitat Zhou, J., et al.: Hierarchy-aware global model for hierarchical text classification. In: ACL, pp. 1106–1117 (2020) Zhou, J., et al.: Hierarchy-aware global model for hierarchical text classification. In: ACL, pp. 1106–1117 (2020)
19.
Zurück zum Zitat Zuo, J., Arvanitakis, G., Hacid, H.: On handling catastrophic forgetting for incremental learning of human physical activity on the edge. In: EDBT (2023) Zuo, J., Arvanitakis, G., Hacid, H.: On handling catastrophic forgetting for incremental learning of human physical activity on the edge. In: EDBT (2023)
20.
Zurück zum Zitat Zuo, J., Arvanitakis, G., Ndhlovu, M., Hacid, H.: Magneto: edge AI for human activity recognition - privacy and personalization. In: EDBT (2024) Zuo, J., Arvanitakis, G., Ndhlovu, M., Hacid, H.: Magneto: edge AI for human activity recognition - privacy and personalization. In: EDBT (2024)
21.
Zurück zum Zitat Zuo, J., Zeitouni, K., Taher, Y.: Exploring interpretable features for large time series with se4tec. In: EDBT (2019) Zuo, J., Zeitouni, K., Taher, Y.: Exploring interpretable features for large time series with se4tec. In: EDBT (2019)
22.
Zurück zum Zitat Zuo, J., Zeitouni, K., Taher, Y.: SMATE: semi-supervised spatio-temporal representation learning on multivariate time series. In: ICDM, pp. 1565–1570 (2021) Zuo, J., Zeitouni, K., Taher, Y.: SMATE: semi-supervised spatio-temporal representation learning on multivariate time series. In: ICDM, pp. 1565–1570 (2021)
23.
Zurück zum Zitat Zuo, J., Zeitouni, K., Taher, Y., Garcia-Rodriguez, S.: Graph convolutional networks for traffic forecasting with missing values. DMKD 37(2), 913–947 (2023)MathSciNet Zuo, J., Zeitouni, K., Taher, Y., Garcia-Rodriguez, S.: Graph convolutional networks for traffic forecasting with missing values. DMKD 37(2), 913–947 (2023)MathSciNet
Metadaten
Titel
Re-thinking Human Activity Recognition with Hierarchy-Aware Label Relationship Modeling
verfasst von
Jingwei Zuo
Hakim Hacid
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2262-4_1

Premium Partner