Skip to main content

2024 | OriginalPaper | Buchkapitel

ImMC-CSFL: Imbalanced Multi-view Clustering Algorithm Based on Common-Specific Feature Learning

verfasst von : Xiaocui Li, Yu Xiao, Xinyu Zhang, Qingyu Shi, Xiance Tang

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Clustering as one of the main research methods in data mining, with the generation of multi-view data, multi-view clustering has become the research hotspot at present. Many excellent multi-view clustering algorithms have been proposed to solve various practical problems. These algorithms mainly achieve multi-view feature fusion by maximizing the consistency between views. However, in practical applications, multi-view data’ initial feature is often imbalanced, resulting in poor performance of existing multi-view clustering algorithms. Additionally, imbalanced multi-view data exhibits significant differences in feature across different views, which better reflects the complementarity of multi-view data. Therefore, it is important to fully extract feature from different views of imbalanced multi-view data. This paper proposes an imbalanced multi-view clustering algorithm based on common specific feature learning, ImMC-CSFL. Two deep networks are used to extract common and specific feature on each view, the GAN network is introduced to maximize the extraction of common feature from multi-view data, and orthogonal constraints are used to maximize the extraction of specific feature from different views. Finally, the learned imbalanced multi-view feature is input for clustering. The experiment result on three different multi-view datasets UCI Digits, BDGP, and CCV showed that our proposed algorithm had better clustering performance, and the effectiveness and robustness were verified through experiment analysis of different modules.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huang, Z., Zhou, J., Peng, X., et al.: Multi-view Spectral Clustering Network. IJCAI, pp. 2563–2569 (2019) Huang, Z., Zhou, J., Peng, X., et al.: Multi-view Spectral Clustering Network. IJCAI, pp. 2563–2569 (2019)
2.
Zurück zum Zitat Zhu, X., Zhang, S., He, W., et al.: One-step multi-view spectral clustering. IEEE Trans. Knowl. Data Eng.Knowl. Data Eng. 31(10), 2022–2034 (2019)CrossRef Zhu, X., Zhang, S., He, W., et al.: One-step multi-view spectral clustering. IEEE Trans. Knowl. Data Eng.Knowl. Data Eng. 31(10), 2022–2034 (2019)CrossRef
3.
Zurück zum Zitat Yin, H., Hu, W., Li, F., et al.: One-step multi-view spectral clustering by learning common and specific nonnegative embeddings. Int. J. Mach. Learn. Cybern.Cybern. 12(7), 2121–2134 (2021)CrossRef Yin, H., Hu, W., Li, F., et al.: One-step multi-view spectral clustering by learning common and specific nonnegative embeddings. Int. J. Mach. Learn. Cybern.Cybern. 12(7), 2121–2134 (2021)CrossRef
4.
Zurück zum Zitat Jia, Y., Liu, H., Hou, J., et al.: Multi-view spectral clustering tailored tensor low-rank representation. IEEE Trans. Circuits Syst. Video Technol. 31(12), 4784–4797 (2021)CrossRef Jia, Y., Liu, H., Hou, J., et al.: Multi-view spectral clustering tailored tensor low-rank representation. IEEE Trans. Circuits Syst. Video Technol. 31(12), 4784–4797 (2021)CrossRef
5.
Zurück zum Zitat El Hajjar, S., Dornaika, F., Abdallahde, F., et al.: Multi-view spectral clustering via constrained nonnegative embedding. Inf. Fusion 78, 209–217 (2022) El Hajjar, S., Dornaika, F., Abdallahde, F., et al.: Multi-view spectral clustering via constrained nonnegative embedding. Inf. Fusion 78, 209–217 (2022)
6.
Zurück zum Zitat Gao, H., Nie, mF., Li, X., et al.: Multi-view subspace clustering. In: ICCV 2015, pp. 4238–4246 (2015) Gao, H., Nie, mF., Li, X., et al.: Multi-view subspace clustering. In: ICCV 2015, pp. 4238–4246 (2015)
7.
Zurück zum Zitat Brbic, M., Kopriva, I.: Multi-view low-rank sparse subspace clustering. Pattern Recognit. 73, 247–258 (2018)CrossRef Brbic, M., Kopriva, I.: Multi-view low-rank sparse subspace clustering. Pattern Recognit. 73, 247–258 (2018)CrossRef
8.
Zurück zum Zitat Li, R., Zhang, C., Hu, Q., et al.: Flexible multi-view representation learning for subspace clustering. IJCAI 2019, pp. 2916–2922 (2019) Li, R., Zhang, C., Hu, Q., et al.: Flexible multi-view representation learning for subspace clustering. IJCAI 2019, pp. 2916–2922 (2019)
9.
Zurück zum Zitat Zhang, C., Hu, Q., Fu, H., et al.: Generalized latent multi-view subspace clustering. IEEE Trans. Pattern Anal. Mach. Intell.Intell. 42(1), 86–99 (2020)CrossRef Zhang, C., Hu, Q., Fu, H., et al.: Generalized latent multi-view subspace clustering. IEEE Trans. Pattern Anal. Mach. Intell.Intell. 42(1), 86–99 (2020)CrossRef
10.
Zurück zum Zitat Kang, Z., Zhou, W., Zhao, Z., et al.: Large-scale multi-view subspace clustering in linear time. In: AAAI 2020, pp. 4412–4419 (2020) Kang, Z., Zhou, W., Zhao, Z., et al.: Large-scale multi-view subspace clustering in linear time. In: AAAI 2020, pp. 4412–4419 (2020)
11.
Zurück zum Zitat Liu, J., Wang, C., Gao, J., et al.: Multi-view clustering via joint nonnegative matrix factorization. In: SDM 2013, 252–260 (2013) Liu, J., Wang, C., Gao, J., et al.: Multi-view clustering via joint nonnegative matrix factorization. In: SDM 2013, 252–260 (2013)
12.
Zurück zum Zitat Zhang, Y., Kong, X.W., Wang, Z.F., et al.: Cluster analysis based on multi-view matrix decomposition. J. Autom. 2018(44).12, 2160–2169 (2018) Zhang, Y., Kong, X.W., Wang, Z.F., et al.: Cluster analysis based on multi-view matrix decomposition. J. Autom. 2018(44).12, 2160–2169 (2018)
13.
Zurück zum Zitat Mekthanavanh, V., Li, T., Meng, H., et al.: Social web video clustering based on multi-view clustering via nonnegative matrix factorization. Int. J. Mach. Learn. Cybern.Cybern. 10(10), 2779–2790 (2019)CrossRef Mekthanavanh, V., Li, T., Meng, H., et al.: Social web video clustering based on multi-view clustering via nonnegative matrix factorization. Int. J. Mach. Learn. Cybern.Cybern. 10(10), 2779–2790 (2019)CrossRef
14.
Zurück zum Zitat Nie, F., Shi, S., Li, X.: Auto-weighted multi-view co-clustering via fast matrix factorization. Pattern Recogn.Recogn. 102, 107207 (2020)CrossRef Nie, F., Shi, S., Li, X.: Auto-weighted multi-view co-clustering via fast matrix factorization. Pattern Recogn.Recogn. 102, 107207 (2020)CrossRef
15.
Zurück zum Zitat Liu, S.S., Lin, L.: Integrative clustering of multi-view data by nonnegative matrix factorization. ArXiv, abs/2110.13240 (2021) Liu, S.S., Lin, L.: Integrative clustering of multi-view data by nonnegative matrix factorization. ArXiv, abs/2110.13240 (2021)
16.
Zurück zum Zitat Liu, X., Dou, Y., Yin, J., et al.: Multiple kernel k-means clustering with matrix-induced regularization. In: AAAI 2016, pp. 1888–1894 Liu, X., Dou, Y., Yin, J., et al.: Multiple kernel k-means clustering with matrix-induced regularization. In: AAAI 2016, pp. 1888–1894
17.
Zurück zum Zitat Zhou, S., Liu, X., Li, M., et al.: Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans. Neural Networks Learn. Syst. 31(4), 1351–1362 (2020)MathSciNetCrossRef Zhou, S., Liu, X., Li, M., et al.: Multiple kernel clustering with neighbor-kernel subspace segmentation. IEEE Trans. Neural Networks Learn. Syst. 31(4), 1351–1362 (2020)MathSciNetCrossRef
18.
Zurück zum Zitat Liu, X., Wang, L., Zhu, X., et al.: Absent Multiple Kernel Learning Algorithms. IEEE Trans. Pattern Anal. Mach. Intell.Intell. 42(6), 1303–1316 (2020)CrossRef Liu, X., Wang, L., Zhu, X., et al.: Absent Multiple Kernel Learning Algorithms. IEEE Trans. Pattern Anal. Mach. Intell.Intell. 42(6), 1303–1316 (2020)CrossRef
19.
Zurück zum Zitat Zhang, X., Ren, Z., Sun, H., et al.: Multiple kernel low-rank representation-based robust multi-view subspace clustering. Inf. Sci. 551, 324–340 (2021)MathSciNetCrossRef Zhang, X., Ren, Z., Sun, H., et al.: Multiple kernel low-rank representation-based robust multi-view subspace clustering. Inf. Sci. 551, 324–340 (2021)MathSciNetCrossRef
20.
Zurück zum Zitat Li, Z., Wang, Q., Tao, Z., Gao, Q., Yang, Z.: Deep adversarial multi-view clustering network. In: Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, China, pp. 2952–2958 (2019) Li, Z., Wang, Q., Tao, Z., Gao, Q., Yang, Z.: Deep adversarial multi-view clustering network. In: Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, China, pp. 2952–2958 (2019)
21.
Zurück zum Zitat Rai, N., Negi, S., Chaudhury, S., Deshmukh, O.: Partial multi-view clustering using graph regularized NMF. In: 23rd International Conference on Pattern Recognition, Cancún, Mexico, pp. 2192–2197 (2016) Rai, N., Negi, S., Chaudhury, S., Deshmukh, O.: Partial multi-view clustering using graph regularized NMF. In: 23rd International Conference on Pattern Recognition, Cancún, Mexico, pp. 2192–2197 (2016)
22.
Zurück zum Zitat Cai, X., Wang, H., Huang, H., Ding, C.H.Q.: Joint stage recognition and anatomical annotation of drosophila gene expression patterns. Bioinform. 28(12), 16–24 (2012)CrossRef Cai, X., Wang, H., Huang, H., Ding, C.H.Q.: Joint stage recognition and anatomical annotation of drosophila gene expression patterns. Bioinform. 28(12), 16–24 (2012)CrossRef
23.
Zurück zum Zitat Jiang, Y., Ye, G., Chang, S., Ellis, D.P.W., Loui, A.C.: Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: 1st International Conference on Multimedia Retrieval, Trento, Italy, pp. 1–8 (2011) Jiang, Y., Ye, G., Chang, S., Ellis, D.P.W., Loui, A.C.: Consumer video understanding: a benchmark database and an evaluation of human and machine performance. In: 1st International Conference on Multimedia Retrieval, Trento, Italy, pp. 1–8 (2011)
24.
Zurück zum Zitat Ng, Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing Systems, Vancouver, Canada, pp. 849–856 (2001) Ng, Y., Jordan, M.I., Weiss, Y.: On spectral clustering: analysis and an algorithm. In: Advances in Neural Information Processing Systems, Vancouver, Canada, pp. 849–856 (2001)
25.
Zurück zum Zitat Kumar, A., Rai, P., III, H.D.: Co-regularized multi-view spectral clustering. In: Annual Conference on Neural Information Processing Systems, Granada, Spain, pp. 1413–1421 (2011) Kumar, A., Rai, P., III, H.D.: Co-regularized multi-view spectral clustering. In: Annual Conference on Neural Information Processing Systems, Granada, Spain, pp. 1413–1421 (2011)
26.
Zurück zum Zitat Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, USA, pp. 3730–3737 (2018) Luo, S., Zhang, C., Zhang, W., Cao, X.: Consistent and specific multi-view subspace clustering. In: Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, Louisiana, USA, pp. 3730–3737 (2018)
28.
Zurück zum Zitat Andrew, G., Arora, R., Bilmes, J.A., Livescu, K.: Deep canonical correlation analysis. In: 30th International Conference on Machine Learning, Atlanta, GA, USA, vol. 28 of JMLR Workshop and Conference Proceedings, pp. 1247–1255 (2013) Andrew, G., Arora, R., Bilmes, J.A., Livescu, K.: Deep canonical correlation analysis. In: 30th International Conference on Machine Learning, Atlanta, GA, USA, vol. 28 of JMLR Workshop and Conference Proceedings, pp. 1247–1255 (2013)
29.
Zurück zum Zitat Abavisani, M., Patel, V.M.: Deep multimodal subspace clustering networks. J. Sel. Topics Signal Processing 12(6), 1601–1614 (2018)CrossRef Abavisani, M., Patel, V.M.: Deep multimodal subspace clustering networks. J. Sel. Topics Signal Processing 12(6), 1601–1614 (2018)CrossRef
Metadaten
Titel
ImMC-CSFL: Imbalanced Multi-view Clustering Algorithm Based on Common-Specific Feature Learning
verfasst von
Xiaocui Li
Yu Xiao
Xinyu Zhang
Qingyu Shi
Xiance Tang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2242-6_18

Premium Partner