Skip to main content

2024 | OriginalPaper | Buchkapitel

Spatial-Temporal Bipartite Graph Attention Network for Traffic Forecasting

verfasst von : Dimuthu Lakmal, Kushani Perera, Renata Borovica-Gajic, Shanika Karunasekera

Erschienen in: Advances in Knowledge Discovery and Data Mining

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Accurate traffic forecasting is pivotal for an efficient data-driven transportation system. The intricate nature of spatial-temporal dependencies and non-linearity present in traffic data has posed a significant challenge to the modeling of accurate traffic forecasting systems. Lately, there has been a significant effort to develop complex Spatial-Temporal Graph Neural Networks (STGNN) that predominantly utilize various Graph Neural Networks (GNN) and attention-based encoder-decoder architectures due to their ability to capture non-linear dependencies in spatial and temporal domains effectively. However, conventional GNNs limit explicit propagation of past information among nodes, while attention-based models such as transformers do not support finer-grained attention score distribution. In this study, we address the aforementioned issues and introduce a novel STGNN namely, Spatio-Temporal Bipartite Graph Attention Network (STBGAT) that allows explicit modeling of past information propagation among nodes. Further, we present a heterogeneous cross-attention mechanism in a transformer to compute finer-grained feature-wise attention distribution enabling the model to capture richer and more expressive temporal dependencies. Our experiments reveal that the proposed architecture outperforms the state-of-the-art approaches proposed in recent literature.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bai, L., Yao, L., Kanhere, S.S., Wang, X., Liu, W., Yang, Z.: Spatio-temporal graph convolutional and recurrent networks for citywide passenger demand prediction. In: Proceedings of the 28th ACM CIKM, pp. 2293–2296 (2019) Bai, L., Yao, L., Kanhere, S.S., Wang, X., Liu, W., Yang, Z.: Spatio-temporal graph convolutional and recurrent networks for citywide passenger demand prediction. In: Proceedings of the 28th ACM CIKM, pp. 2293–2296 (2019)
2.
Zurück zum Zitat Chen, C., Petty, K., Skabardonis, A., Varaiya, P., Jia, Z.: Freeway performance measurement system: mining loop detector data. TRR 1748(1), 96–102 (2001) Chen, C., Petty, K., Skabardonis, A., Varaiya, P., Jia, Z.: Freeway performance measurement system: mining loop detector data. TRR 1748(1), 96–102 (2001)
3.
Zurück zum Zitat Giorgino, T.: Computing and visualizing dynamic time warping alignments in r: the dtw package. J. Stat. Softw. 31, 1–24 (2009)CrossRef Giorgino, T.: Computing and visualizing dynamic time warping alignments in r: the dtw package. J. Stat. Softw. 31, 1–24 (2009)CrossRef
4.
Zurück zum Zitat Guo, S., Lin, Y., Wan, H., Li, X., Cong, G.: Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE TKDE 34(11), 5415–5428 (2021) Guo, S., Lin, Y., Wan, H., Li, X., Cong, G.: Learning dynamics and heterogeneity of spatial-temporal graph data for traffic forecasting. IEEE TKDE 34(11), 5415–5428 (2021)
5.
Zurück zum Zitat He, H., Ye, K., Xu, C.Z.: Multi-feature urban traffic prediction based on unconstrained graph attention network. In: 2021 IEEE BigData, pp. 1409–1417 (2021) He, H., Ye, K., Xu, C.Z.: Multi-feature urban traffic prediction based on unconstrained graph attention network. In: 2021 IEEE BigData, pp. 1409–1417 (2021)
6.
Zurück zum Zitat Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRef
7.
Zurück zum Zitat Huang, R., Huang, C., Liu, Y., Dai, G., Kong, W.: Lsgcn: Long short-term traffic prediction with graph convolutional networks. In: IJCAI, vol. 7, pp. 2355–2361 (2020) Huang, R., Huang, C., Liu, Y., Dai, G., Kong, W.: Lsgcn: Long short-term traffic prediction with graph convolutional networks. In: IJCAI, vol. 7, pp. 2355–2361 (2020)
8.
Zurück zum Zitat Jagadish, H.V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J.M., Ramakrishnan, R., Shahabi, C.: Big data and its technical challenges. Commun. ACM 57(7), 86–94 (2014)CrossRef Jagadish, H.V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J.M., Ramakrishnan, R., Shahabi, C.: Big data and its technical challenges. Commun. ACM 57(7), 86–94 (2014)CrossRef
9.
Zurück zum Zitat Jiang, J., Han, C., Zhao, W.X., Wang, J.: Pdformer: propagation delay-aware dynamic long-range transformer for traffic flow prediction. arXiv preprint arXiv:2301.07945 (2023) Jiang, J., Han, C., Zhao, W.X., Wang, J.: Pdformer: propagation delay-aware dynamic long-range transformer for traffic flow prediction. arXiv preprint arXiv:​2301.​07945 (2023)
11.
Zurück zum Zitat Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016) Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:​1609.​02907 (2016)
12.
Zurück zum Zitat Kong, X., Xing, W., Wei, X., Bao, P., Zhang, J., Lu, W.: Stgat: spatial-temporal graph attention networks for traffic flow forecasting. IEEE Access 8, 134363–134372 (2020)CrossRef Kong, X., Xing, W., Wei, X., Bao, P., Zhang, J., Lu, W.: Stgat: spatial-temporal graph attention networks for traffic flow forecasting. IEEE Access 8, 134363–134372 (2020)CrossRef
13.
Zurück zum Zitat Lablack, M., Shen, Y.: Spatio-temporal graph mixformer for traffic forecasting. Expert Syst. Appl. 228, 120281 (2023)CrossRef Lablack, M., Shen, Y.: Spatio-temporal graph mixformer for traffic forecasting. Expert Syst. Appl. 228, 120281 (2023)CrossRef
14.
Zurück zum Zitat Li, W., Wang, X., Zhang, Y., Wu, Q.: Traffic flow prediction over muti-sensor data correlation with graph convolution network. Neurocomputing 427, 50–63 (2021)CrossRef Li, W., Wang, X., Zhang, Y., Wu, Q.: Traffic flow prediction over muti-sensor data correlation with graph convolution network. Neurocomputing 427, 50–63 (2021)CrossRef
15.
Zurück zum Zitat Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 (2017) Li, Y., Yu, R., Shahabi, C., Liu, Y.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:​1707.​01926 (2017)
16.
Zurück zum Zitat Li, Y., Moura, J.M.: Forecaster: a graph transformer for forecasting spatial and time-dependent data. In: ECAI 2020, pp. 1293–1300. IOS Press (2020) Li, Y., Moura, J.M.: Forecaster: a graph transformer for forecasting spatial and time-dependent data. In: ECAI 2020, pp. 1293–1300. IOS Press (2020)
17.
Zurück zum Zitat Lu, Z., Lv, W., Cao, Y., Xie, Z., Peng, H., Du, B.: Lstm variants meet graph neural networks for road speed prediction. Neurocomputing 400, 34–45 (2020)CrossRef Lu, Z., Lv, W., Cao, Y., Xie, Z., Peng, H., Du, B.: Lstm variants meet graph neural networks for road speed prediction. Neurocomputing 400, 34–45 (2020)CrossRef
18.
Zurück zum Zitat Lütkepohl, H.: Vector autoregressive models. Handbook of research methods and applications in empirical macroeconomics 30 (2013) Lütkepohl, H.: Vector autoregressive models. Handbook of research methods and applications in empirical macroeconomics 30 (2013)
19.
Zurück zum Zitat Roy, A., Roy, K.K., Ali, A.A., Amin, M.A., Rahman, A.M.: Unified spatio-temporal modeling for traffic forecasting using graph neural network. In: 2021 IJCNN, pp. 1–8. IEEE (2021) Roy, A., Roy, K.K., Ali, A.A., Amin, M.A., Rahman, A.M.: Unified spatio-temporal modeling for traffic forecasting using graph neural network. In: 2021 IJCNN, pp. 1–8. IEEE (2021)
20.
Zurück zum Zitat Shao, Z., Zhang, Z., Wang, F., Xu, Y.: Pre-training enhanced spatial-temporal graph neural network for multivariate time series forecasting. In: Proc. 28th ACM SIGKDD Conf. Know. Disc. Data Min., pp. 1567–1577 (2022) Shao, Z., Zhang, Z., Wang, F., Xu, Y.: Pre-training enhanced spatial-temporal graph neural network for multivariate time series forecasting. In: Proc. 28th ACM SIGKDD Conf. Know. Disc. Data Min., pp. 1567–1577 (2022)
21.
Zurück zum Zitat Tian, Y., Zhang, K., Li, J., Lin, X., Yang, B.: Lstm-based traffic flow prediction with missing data. Neurocomputing 318, 297–305 (2018)CrossRef Tian, Y., Zhang, K., Li, J., Lin, X., Yang, B.: Lstm-based traffic flow prediction with missing data. Neurocomputing 318, 297–305 (2018)CrossRef
22.
Zurück zum Zitat Vaswani, A., et al.: Attention is all you need. Adv. NIPS 30 (2017) Vaswani, A., et al.: Attention is all you need. Adv. NIPS 30 (2017)
23.
Zurück zum Zitat Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y., et al.: Graph attention networks. Stat 1050(20), 10–48550 (2017) Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y., et al.: Graph attention networks. Stat 1050(20), 10–48550 (2017)
24.
Zurück zum Zitat Wang, X., et al.: Traffic flow prediction via spatial temporal graph neural network. In: Proc. web conf. 2020, pp. 1082–1092 (2020) Wang, X., et al.: Traffic flow prediction via spatial temporal graph neural network. In: Proc. web conf. 2020, pp. 1082–1092 (2020)
25.
Zurück zum Zitat Williams, B.M., Hoel, L.A.: Modeling and forecasting vehicular traffic flow as a seasonal arima process: theoretical basis and empirical results. J. Trans. Eng. 129(6), 664–672 (2003)CrossRef Williams, B.M., Hoel, L.A.: Modeling and forecasting vehicular traffic flow as a seasonal arima process: theoretical basis and empirical results. J. Trans. Eng. 129(6), 664–672 (2003)CrossRef
26.
Zurück zum Zitat Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks. IEEE TNNLS 32(1), 4–24 (2020)MathSciNet Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., Philip, S.Y.: A comprehensive survey on graph neural networks. IEEE TNNLS 32(1), 4–24 (2020)MathSciNet
27.
Zurück zum Zitat Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting Yu, B., Yin, H., Zhu, Z.: Spatio-temporal graph convolutional networks: A deep learning framework for traffic forecasting
28.
Zurück zum Zitat Yu, H., Wu, Z., Wang, S., Wang, Y., Ma, X.: Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 17(7), 1501 (2017)CrossRef Yu, H., Wu, Z., Wang, S., Wang, Y., Ma, X.: Spatiotemporal recurrent convolutional networks for traffic prediction in transportation networks. Sensors 17(7), 1501 (2017)CrossRef
29.
Zurück zum Zitat Zheng, C., Fan, X., Wang, C., Qi, J.: Gman: a graph multi-attention network for traffic prediction. In: Proc. of the AAAI Conf. on Art. Intell., vol. 34, pp. 1234–1241 (2020) Zheng, C., Fan, X., Wang, C., Qi, J.: Gman: a graph multi-attention network for traffic prediction. In: Proc. of the AAAI Conf. on Art. Intell., vol. 34, pp. 1234–1241 (2020)
Metadaten
Titel
Spatial-Temporal Bipartite Graph Attention Network for Traffic Forecasting
verfasst von
Dimuthu Lakmal
Kushani Perera
Renata Borovica-Gajic
Shanika Karunasekera
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2253-2_6

Premium Partner