Skip to main content
Top

2024 | OriginalPaper | Chapter

Enhancing Continuous Domain Adaptation with Multi-path Transfer Curriculum

Authors : Hanbing Liu, Jingge Wang, Xuan Zhang, Ye Guo, Yang Li

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Addressing the large distribution gap between training and testing data has long been a challenge in machine learning, giving rise to fields such as transfer learning and domain adaptation. Recently, Continuous Domain Adaptation (CDA) has emerged as an effective technique, closing this gap by utilizing a series of intermediate domains. This paper contributes a novel CDA method, W-MPOT, which rigorously addresses the domain ordering and error accumulation problems overlooked by previous studies. Specifically, we construct a transfer curriculum over the source and intermediate domains based on Wasserstein distance, motivated by theoretical analysis of CDA. Then we transfer the source model to the target domain through multiple valid paths in the curriculum using a modified version of continuous optimal transport. A bidirectional path consistency constraint is introduced to mitigate the impact of accumulated mapping errors during continuous transfer. We extensively evaluate W-MPOT on multiple datasets, achieving up to 54.1% accuracy improvement on multi-session Alzheimer MR image classification and 94.7% MSE reduction on battery capacity estimation.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
1.
go back to reference Bùi, M.N., Combettes, P.L.: Bregman forward-backward operator splitting. Set-Valued Variat. Anal. 29, 583–603 (2021)MathSciNetCrossRef Bùi, M.N., Combettes, P.L.: Bregman forward-backward operator splitting. Set-Valued Variat. Anal. 29, 583–603 (2021)MathSciNetCrossRef
2.
go back to reference Courty, N., Flamary, R., Tuia, D., Rakotomamonjy, A.: Optimal transport for domain adaptation (2016) Courty, N., Flamary, R., Tuia, D., Rakotomamonjy, A.: Optimal transport for domain adaptation (2016)
3.
go back to reference Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. Adv. Neural Inf. Process. Syst. 26 (2013) Cuturi, M.: Sinkhorn distances: lightspeed computation of optimal transport. Adv. Neural Inf. Process. Syst. 26 (2013)
4.
go back to reference Durak, L., Aldirmaz, S.: Adaptive fractional fourier domain filtering. Signal Process. 90(4), 1188–1196 (2010)CrossRef Durak, L., Aldirmaz, S.: Adaptive fractional fourier domain filtering. Signal Process. 90(4), 1188–1196 (2010)CrossRef
5.
go back to reference Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015) Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189. PMLR (2015)
6.
go back to reference Hoffman, J., Darrell, T., Saenko, K.: Continuous manifold based adaptation for evolving visual domains. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 867–874 (2014) Hoffman, J., Darrell, T., Saenko, K.: Continuous manifold based adaptation for evolving visual domains. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 867–874 (2014)
7.
go back to reference Kumar, A., Ma, T., Liang, P.: Understanding self-training for gradual domain adaptation. In: International Conference on Machine Learning, pp. 5468–5479. PMLR (2020) Kumar, A., Ma, T., Liang, P.: Understanding self-training for gradual domain adaptation. In: International Conference on Machine Learning, pp. 5468–5479. PMLR (2020)
8.
go back to reference Liang, J., Hu, D., Feng, J.: Do we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation. In: International Conference on Machine Learning, pp. 6028–6039. PMLR (2020) Liang, J., Hu, D., Feng, J.: Do we really need to access the source data? source hypothesis transfer for unsupervised domain adaptation. In: International Conference on Machine Learning, pp. 6028–6039. PMLR (2020)
9.
go back to reference Liu, H., Long, M., Wang, J., Wang, Y.: Learning to adapt to evolving domains. Adv. Neural. Inf. Process. Syst. 33, 22338–22348 (2020) Liu, H., Long, M., Wang, J., Wang, Y.: Learning to adapt to evolving domains. Adv. Neural. Inf. Process. Syst. 33, 22338–22348 (2020)
10.
go back to reference Ortiz-Jiménez, G., El Gheche, M., Simou, E., Maretić, H.P., Frossard, P.: Forward-backward splitting for optimal transport based problems. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5405–5409. IEEE (2020) Ortiz-Jiménez, G., El Gheche, M., Simou, E., Maretić, H.P., Frossard, P.: Forward-backward splitting for optimal transport based problems. In: ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5405–5409. IEEE (2020)
11.
go back to reference Petersen, R.C., et al.: Alzheimer’s disease neuroimaging initiative (adni): clinical characterization. Neurology 74(3), 201–209 (2010)CrossRef Petersen, R.C., et al.: Alzheimer’s disease neuroimaging initiative (adni): clinical characterization. Neurology 74(3), 201–209 (2010)CrossRef
12.
go back to reference Shen, J., Qu, Y., Zhang, W., Yu, Y.: Wasserstein distance guided representation learning for domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018) Shen, J., Qu, Y., Zhang, W., Yu, Y.: Wasserstein distance guided representation learning for domain adaptation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
13.
go back to reference Sun, B., Feng, J., Saenko, K.: Correlation alignment for unsupervised domain adaptation. In: Domain Adaptation in Computer Vision Applications, pp. 153–171 (2017) Sun, B., Feng, J., Saenko, K.: Correlation alignment for unsupervised domain adaptation. In: Domain Adaptation in Computer Vision Applications, pp. 153–171 (2017)
14.
go back to reference Villani, C., Villani, C.: The wasserstein distances. In: Optimal Transport: Old and New, pp. 93–111 (2009) Villani, C., Villani, C.: The wasserstein distances. In: Optimal Transport: Old and New, pp. 93–111 (2009)
15.
go back to reference Wang, Y., et al.: An empirical study of selection bias in pinterest ads retrieval. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 5174–5183 (2023) Wang, Y., et al.: An empirical study of selection bias in pinterest ads retrieval. In: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 5174–5183 (2023)
16.
go back to reference Xu, Y., Jiang, Z., Men, A., Liu, Y., Chen, Q.: Delving into the continuous domain adaptation. In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 6039–6049 (2022) Xu, Y., Jiang, Z., Men, A., Liu, Y., Chen, Q.: Delving into the continuous domain adaptation. In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 6039–6049 (2022)
17.
go back to reference Zhao, H., Des Combes, R.T., Zhang, K., Gordon, G.: On learning invariant representations for domain adaptation. In: International Conference on Machine Learning, pp. 7523–7532. PMLR (2019) Zhao, H., Des Combes, R.T., Zhang, K., Gordon, G.: On learning invariant representations for domain adaptation. In: International Conference on Machine Learning, pp. 7523–7532. PMLR (2019)
18.
go back to reference Zhou, S., Wang, L., Zhang, S., Wang, Z., Zhu, W.: Active gradual domain adaptation: dataset and approach. IEEE Trans. Multimedia 24, 1210–1220 (2022)CrossRef Zhou, S., Wang, L., Zhang, S., Wang, Z., Zhu, W.: Active gradual domain adaptation: dataset and approach. IEEE Trans. Multimedia 24, 1210–1220 (2022)CrossRef
19.
go back to reference Zhou, Z., et al.: A fast screening framework for second-life batteries based on an improved bisecting k-means algorithm combined with fast pulse test. J. Energy Storage 31, 101739 (2020)CrossRef Zhou, Z., et al.: A fast screening framework for second-life batteries based on an improved bisecting k-means algorithm combined with fast pulse test. J. Energy Storage 31, 101739 (2020)CrossRef
Metadata
Title
Enhancing Continuous Domain Adaptation with Multi-path Transfer Curriculum
Authors
Hanbing Liu
Jingge Wang
Xuan Zhang
Ye Guo
Yang Li
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2253-2_23

Premium Partner