Skip to main content

2024 | OriginalPaper | Buchkapitel

Enhancing Continuous Domain Adaptation with Multi-path Transfer Curriculum

verfasst von : Hanbing Liu, Jingge Wang, Xuan Zhang, Ye Guo, Yang Li

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Addressing the large distribution gap between training and testing data has long been a challenge in machine learning, giving rise to fields such as transfer learning and domain adaptation. Recently, Continuous Domain Adaptation (CDA) has emerged as an effective technique, closing this gap by utilizing a series of intermediate domains. This paper contributes a novel CDA method, W-MPOT, which rigorously addresses the domain ordering and error accumulation problems overlooked by previous studies. Specifically, we construct a transfer curriculum over the source and intermediate domains based on Wasserstein distance, motivated by theoretical analysis of CDA. Then we transfer the source model to the target domain through multiple valid paths in the curriculum using a modified version of continuous optimal transport. A bidirectional path consistency constraint is introduced to mitigate the impact of accumulated mapping errors during continuous transfer. We extensively evaluate W-MPOT on multiple datasets, achieving up to 54.1% accuracy improvement on multi-session Alzheimer MR image classification and 94.7% MSE reduction on battery capacity estimation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Bùi, M.N., Combettes, P.L.: Bregman forward-backward operator splitting. Set-Valued Variat. Anal. 29, 583–603 (2021)MathSciNetCrossRef Bùi, M.N., Combettes, P.L.: Bregman forward-backward operator splitting. Set-Valued Variat. Anal. 29, 583–603 (2021)MathSciNetCrossRef
2.
Zurück zum Zitat Courty, N., Flamary, R., Tuia, D., Rakotomamonjy, A.: Optimal transport for domain adaptation (2016) Courty, N., Flamary, R., Tuia, D., Rakotomamonjy, A.: Optimal transport for domain adaptation (2016)
3.
Zurück zum Zitat Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. Adv. Neural Inf. Process. Syst. 26 (2013) Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. Adv. Neural Inf. Process. Syst. 26 (2013)
4.
Zurück zum Zitat Durak, L., Aldirmaz, S.: Adaptive fractional fourier domain filtering. Signal Process. 90(4), 1188–1196 (2010)CrossRef Durak, L., Aldirmaz, S.: Adaptive fractional fourier domain filtering. Signal Process. 90(4), 1188–1196 (2010)CrossRef
5.
Zurück zum Zitat Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015) Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015)
6.
Zurück zum Zitat Hoffman, J., Darrell, T., Saenko, K.: Continuous manifold based adaptation for evolving visual domains. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 867–874 (2014) Hoffman, J., Darrell, T., Saenko, K.: Continuous manifold based adaptation for evolving visual domains. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 867–874 (2014)
7.
Zurück zum Zitat Kumar, A., Ma, T., Liang, P.: Understanding self-training for gradual domain adaptation. In: International Conference on Machine Learning, pp. 5468–5479. PMLR (2020) Kumar, A., Ma, T., Liang, P.: Understanding self-training for gradual domain adaptation. In: International Conference on Machine Learning, pp. 5468–5479. PMLR (2020)
8.
Zurück zum Zitat Liang, J., Hu, D., Feng, J.: Do we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation. In: International Conference on Machine Learning, pp. 6028–6039. PMLR (2020) Liang, J., Hu, D., Feng, J.: Do we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation. In: International Conference on Machine Learning, pp. 6028–6039. PMLR (2020)
9.
Zurück zum Zitat Liu, H., Long, M., Wang, J., Wang, Y.: Learning to adapt to evolving domains. Adv. Neural. Inf. Process. Syst. 33, 22338–22348 (2020) Liu, H., Long, M., Wang, J., Wang, Y.: Learning to adapt to evolving domains. Adv. Neural. Inf. Process. Syst. 33, 22338–22348 (2020)
10.
Zurück zum Zitat Ortiz-Jiménez, G., El Gheche, M., Simou, E., Maretić, H.P., Frossard, P.: Forward-backward splitting for optimal transport based problems. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5405–5409. IEEE (2020) Ortiz-Jiménez, G., El Gheche, M., Simou, E., Maretić, H.P., Frossard, P.: Forward-backward splitting for optimal transport based problems. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5405–5409. IEEE (2020)
11.
Zurück zum Zitat Petersen, R.C., et al.: Alzheimer’s disease neuroimaging initiative (adni): clinical characterization. Neurology 74(3), 201–209 (2010)CrossRef Petersen, R.C., et al.: Alzheimer’s disease neuroimaging initiative (adni): clinical characterization. Neurology 74(3), 201–209 (2010)CrossRef
12.
Zurück zum Zitat Shen, J., Qu, Y., Zhang, W., Yu, Y.: Wasserstein distance guided representation learning for domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018) Shen, J., Qu, Y., Zhang, W., Yu, Y.: Wasserstein distance guided representation learning for domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
13.
Zurück zum Zitat Sun, B., Feng, J., Saenko, K.: Correlation alignment for unsupervised domain adaptation. In: Domain Adaptation in Computer Vision Applications, pp. 153–171 (2017) Sun, B., Feng, J., Saenko, K.: Correlation alignment for unsupervised domain adaptation. In: Domain Adaptation in Computer Vision Applications, pp. 153–171 (2017)
14.
Zurück zum Zitat Villani, C., Villani, C.: The wasserstein distances. In: Optimal Transport: Old and New, pp. 93–111 (2009) Villani, C., Villani, C.: The wasserstein distances. In: Optimal Transport: Old and New, pp. 93–111 (2009)
15.
Zurück zum Zitat Wang, Y., et al.: An empirical study of selection bias in pinterest ads retrieval. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 5174–5183 (2023) Wang, Y., et al.: An empirical study of selection bias in pinterest ads retrieval. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 5174–5183 (2023)
16.
Zurück zum Zitat Xu, Y., Jiang, Z., Men, A., Liu, Y., Chen, Q.: Delving into the continuous domain adaptation. In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 6039–6049 (2022) Xu, Y., Jiang, Z., Men, A., Liu, Y., Chen, Q.: Delving into the continuous domain adaptation. In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 6039–6049 (2022)
17.
Zurück zum Zitat Zhao, H., Des Combes, R.T., Zhang, K., Gordon, G.: On learning invariant representations for domain adaptation. In: International Conference on Machine Learning, pp. 7523–7532. PMLR (2019) Zhao, H., Des Combes, R.T., Zhang, K., Gordon, G.: On learning invariant representations for domain adaptation. In: International Conference on Machine Learning, pp. 7523–7532. PMLR (2019)
18.
Zurück zum Zitat Zhou, S., Wang, L., Zhang, S., Wang, Z., Zhu, W.: Active gradual domain adaptation: dataset and approach. IEEE Trans. Multimedia 24, 1210–1220 (2022)CrossRef Zhou, S., Wang, L., Zhang, S., Wang, Z., Zhu, W.: Active gradual domain adaptation: dataset and approach. IEEE Trans. Multimedia 24, 1210–1220 (2022)CrossRef
19.
Zurück zum Zitat Zhou, Z., et al.: A fast screening framework for second-life batteries based on an improved bisecting k-means algorithm combined with fast pulse test. J. Energy Storage 31, 101739 (2020)CrossRef Zhou, Z., et al.: A fast screening framework for second-life batteries based on an improved bisecting k-means algorithm combined with fast pulse test. J. Energy Storage 31, 101739 (2020)CrossRef
Metadaten
Titel
Enhancing Continuous Domain Adaptation with Multi-path Transfer Curriculum
verfasst von
Hanbing Liu
Jingge Wang
Xuan Zhang
Ye Guo
Yang Li
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2253-2_23

Premium Partner