Skip to main content

2024 | OriginalPaper | Buchkapitel

Mask Adaptive Spatial-Temporal Recurrent Neural Network for Traffic Forecasting

verfasst von : Xingbang Hu, Shuo Zhang, Wenbo Zhang, Hejiao Huang

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

How to model the spatial-temporal graph is a crucial problem for the accuracy of traffic forecasting. Existing GNN-based work mostly captures spatial dependencies by using a pre-defined graph for close nodes and a self-adaptive graph for distant nodes. However, the pre-defined graphs cannot accurately represent the genuine spatial dependency due to the complexity of traffic conditions. Furthermore, existing methods cannot effectively capture the spatial heterogeneity and temporal periodicity in traffic data. Additionally, small errors in each time step will greatly amplify in the long sequence prediction for a sequence-to-sequence model. To address these issues, we propose a novel framework, MASTRNN, for traffic forecasting. Firstly, a novel mask-adaptive matrix is proposed to enhance the pre-defined graph, which is learned through node embedding. Secondly, we assign identity embeddings to each node and each time step in order to capture the spatial heterogeneity and temporal periodicity, respectively. Thirdly, a multi-head attention layer is employed between the encoder and decoder to alleviate the problem of error propagation. Experimental results on three real-world traffic network datasets demonstrate that MASTRNN outperforms the state-of-the-art baselines.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zheng, C., Fan, X., Wang, C., Qi, J.: GMAN: a graph multi-attention network for traffic prediction. In: AAAI, pp. 1234–1241 (2020) Zheng, C., Fan, X., Wang, C., Qi, J.: GMAN: a graph multi-attention network for traffic prediction. In: AAAI, pp. 1234–1241 (2020)
2.
Zurück zum Zitat Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In: ICLR (2018) Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: data-driven traffic forecasting. In: ICLR (2018)
3.
Zurück zum Zitat Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks: theoretical basis and empirical results. J. Transp. Eng. 32(1), 4–24 (2020) Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks: theoretical basis and empirical results. J. Transp. Eng. 32(1), 4–24 (2020)
4.
Zurück zum Zitat Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph WaveNet for deep spatial-temporal graph modeling. In: IJCAI (2019) Wu, Z., Pan, S., Long, G., Jiang, J., Zhang, C.: Graph WaveNet for deep spatial-temporal graph modeling. In: IJCAI (2019)
5.
Zurück zum Zitat Li, Q., Han, Z., Wu, X.M.: Deeper insights into graph convolutional networks for semi-supervised learning. In: AAAI (2018) Li, Q., Han, Z., Wu, X.M.: Deeper insights into graph convolutional networks for semi-supervised learning. In: AAAI (2018)
6.
Zurück zum Zitat Hochreiter, S., et al.: Gradient flow in recurrent nets: the difficulty of learning long-term dependencies (2001) Hochreiter, S., et al.: Gradient flow in recurrent nets: the difficulty of learning long-term dependencies (2001)
7.
Zurück zum Zitat Graves, A.: Long short-term memory. Supervised sequence labelling with recurrent neural networks, pp. 37–45 (2012) Graves, A.: Long short-term memory. Supervised sequence labelling with recurrent neural networks, pp. 37–45 (2012)
8.
Zurück zum Zitat Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. In: NIPS (2014) Chung, J., Gulcehre, C., Cho, K., Bengio, Y.: Empirical evaluation of gated recurrent neural networks on sequence modeling. In: NIPS (2014)
10.
Zurück zum Zitat Van Den Oord, A., et al.: WaveNet: a generative model for raw audio. In: 9th ISCA Speech Synthesis Workshop, pp. 125–125 (2016) Van Den Oord, A., et al.: WaveNet: a generative model for raw audio. In: 9th ISCA Speech Synthesis Workshop, pp. 125–125 (2016)
11.
Zurück zum Zitat Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017) Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
12.
Zurück zum Zitat Zhou, H., et al.: Informer: beyond efficient transformer for long sequence time-series forecasting. In: AAAI, pp. 1106–11115 (2021) Zhou, H., et al.: Informer: beyond efficient transformer for long sequence time-series forecasting. In: AAAI, pp. 1106–11115 (2021)
13.
Zurück zum Zitat Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., Jin, R.: FedFormer: frequency enhanced decomposed transformer for long-term series forecasting. In: ICML, pp. 7268–27286 (2022) Zhou, T., Ma, Z., Wen, Q., Wang, X., Sun, L., Jin, R.: FedFormer: frequency enhanced decomposed transformer for long-term series forecasting. In: ICML, pp. 7268–27286 (2022)
14.
Zurück zum Zitat Yu, B., Yin, H., Zhu, Z.: FedFormer: Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting. In: IJCAI, pp. 634–3640 (2018) Yu, B., Yin, H., Zhu, Z.: FedFormer: Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting. In: IJCAI, pp. 634–3640 (2018)
15.
Zurück zum Zitat Guo, S., Lin, Y., Wan, H., Li, X., Cong, G.: Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE Trans. Knowl. Data Eng. 34(11), 5415–5428 (2021)CrossRef Guo, S., Lin, Y., Wan, H., Li, X., Cong, G.: Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE Trans. Knowl. Data Eng. 34(11), 5415–5428 (2021)CrossRef
16.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2018) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2018)
17.
Zurück zum Zitat Li, F., et al.: Dynamic graph convolutional recurrent network for traffic prediction: benchmark and solution. ACM Trans. Knowl. Discov. Data 17(1), 1–21 (2023)MathSciNet Li, F., et al.: Dynamic graph convolutional recurrent network for traffic prediction: benchmark and solution. ACM Trans. Knowl. Discov. Data 17(1), 1–21 (2023)MathSciNet
18.
Zurück zum Zitat Jiang, R., et al.: Spatio-temporal meta-graph learning for traffic forecasting. In: AAAI, pp. 8078–8086 (2023) Jiang, R., et al.: Spatio-temporal meta-graph learning for traffic forecasting. In: AAAI, pp. 8078–8086 (2023)
19.
Zurück zum Zitat Wang, X., et al.: Traffic flow prediction via spatial temporal graph neural network. In: Proceedings of the Web Conference 2020, pp. 1082–1092 (2020) Wang, X., et al.: Traffic flow prediction via spatial temporal graph neural network. In: Proceedings of the Web Conference 2020, pp. 1082–1092 (2020)
20.
Zurück zum Zitat Shao, Z., et al.: Decoupled dynamic spatial-temporal graph neural network for traffic forecasting. Proc. VLDB Endowment 15(11), 2733–2746 (2022)CrossRef Shao, Z., et al.: Decoupled dynamic spatial-temporal graph neural network for traffic forecasting. Proc. VLDB Endowment 15(11), 2733–2746 (2022)CrossRef
21.
Zurück zum Zitat Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., Zhang, C.: Connecting the dots: multivariate time series forecasting with graph neural networks. In: SIGKDD, pp. 753–763 (2020) Wu, Z., Pan, S., Long, G., Jiang, J., Chang, X., Zhang, C.: Connecting the dots: multivariate time series forecasting with graph neural networks. In: SIGKDD, pp. 753–763 (2020)
22.
Zurück zum Zitat Shuman, D.I., Narang, S.K., Frossard, P., Ortega, A., Vandergheynst, P.: The emerging field of signal processing on graphs: extending high-dimensional data analysis to networks and other irregular domains. IEEE Sign. Process. Mag. 30(3), 83–98 (2013)CrossRef Shuman, D.I., Narang, S.K., Frossard, P., Ortega, A., Vandergheynst, P.: The emerging field of signal processing on graphs: extending high-dimensional data analysis to networks and other irregular domains. IEEE Sign. Process. Mag. 30(3), 83–98 (2013)CrossRef
23.
Zurück zum Zitat Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, vol. 27 (2014) Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, vol. 27 (2014)
24.
Zurück zum Zitat Shao, Z., Zhang, Z., Wang, F., Wei, W., Xu, Y.: Spatial-temporal identity: a simple yet effective baseline for multivariate time series forecasting. In: CIKM, pp. 4454–4458 (2022) Shao, Z., Zhang, Z., Wang, F., Wei, W., Xu, Y.: Spatial-temporal identity: a simple yet effective baseline for multivariate time series forecasting. In: CIKM, pp. 4454–4458 (2022)
25.
Zurück zum Zitat Liang, Y., Shao, Z., Wang, F., Zhang, Z., Sun, T., Xu, Y.: BasicTS: an open source fair multivariate time series prediction benchmark. In: International Symposium on Benchmarking, Measuring and Optimization, pp. 87–101 (2022) Liang, Y., Shao, Z., Wang, F., Zhang, Z., Sun, T., Xu, Y.: BasicTS: an open source fair multivariate time series prediction benchmark. In: International Symposium on Benchmarking, Measuring and Optimization, pp. 87–101 (2022)
Metadaten
Titel
Mask Adaptive Spatial-Temporal Recurrent Neural Network for Traffic Forecasting
verfasst von
Xingbang Hu
Shuo Zhang
Wenbo Zhang
Hejiao Huang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2262-4_21

Premium Partner