Skip to main content

2024 | OriginalPaper | Buchkapitel

Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles

verfasst von : Miao Fan, Yi Yao, Jianping Zhang, Xiangbo Song, Daihui Wu

Erschienen in: Spatial Data and Intelligence

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

High-definition (HD) map is a fundamental component of autonomous driving systems, as it can provide precise environmental information about driving scenes. Recent work on vectorized map generation could produce merely \(65\%\) local map elements around the ego-vehicle at runtime by one tour with onboard sensors, leaving a puzzle of how to construct a global HD map projected in the world coordinate system under high-quality standards. To address the issue, we present GNMap as an end-to-end generative neural network to automatically construct HD maps with multiple vectorized tiles which are locally produced by autonomous vehicles through several tours. It leverages a multi-layer and attention-based autoencoder as the shared network, of which parameters are learned from two different tasks (i.e., pretraining and finetuning, respectively) to ensure both the completeness of generated maps and the correctness of element categories. Abundant qualitative evaluations are conducted on a real-world dataset and experimental results show that GNMap can surpass the SOTA method by more than \(5\%\) F1 score, reaching the level of industrial usage with a small amount of manual modification. We have already deployed it at Navinfo Co., Ltd., serving as an indispensable software to automatically build HD maps for autonomous driving systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Besl, P., McKay, N.D.: A method for registration of 3D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)CrossRef Besl, P., McKay, N.D.: A method for registration of 3D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)CrossRef
2.
Zurück zum Zitat Biber, P., Straßer, W.: The normal distributions transform: a new approach to laser scan matching. In: Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2743–2748 (2003) Biber, P., Straßer, W.: The normal distributions transform: a new approach to laser scan matching. In: Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2743–2748 (2003)
3.
Zurück zum Zitat Borodacz, K., Szczepański, C., Popowski, S.: Review and selection of commercially available IMU for a short time inertial navigation. Aircr. Eng. Aerosp. Technol. 94, 45–59 (2021)CrossRef Borodacz, K., Szczepański, C., Popowski, S.: Review and selection of commercially available IMU for a short time inertial navigation. Aircr. Eng. Aerosp. Technol. 94, 45–59 (2021)CrossRef
4.
Zurück zum Zitat Boubakri, A., Gammar, S.M., Brahim, M.B., Filali, F.: High definition map update for autonomous and connected vehicles: a survey. In: 2022 International Wireless Communications and Mobile Computing (IWCMC), pp. 1148–1153 (2022) Boubakri, A., Gammar, S.M., Brahim, M.B., Filali, F.: High definition map update for autonomous and connected vehicles: a survey. In: 2022 International Wireless Communications and Mobile Computing (IWCMC), pp. 1148–1153 (2022)
5.
Zurück zum Zitat Dellaert, F., Kaess, M.: Factor graphs for robot perception. Found. Trends Robot. 6 (2017) Dellaert, F., Kaess, M.: Factor graphs for robot perception. Found. Trends Robot. 6 (2017)
6.
Zurück zum Zitat Ding, W., Qiao, L., Qiu, X., Zhang, C.: PivotNet: vectorized pivot learning for end-to-end HD map construction. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3672–3682 (2023) Ding, W., Qiao, L., Qiu, X., Zhang, C.: PivotNet: vectorized pivot learning for end-to-end HD map construction. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 3672–3682 (2023)
7.
Zurück zum Zitat Elghazaly, G., Frank, R., Harvey, S., Safko, S.: High-definition maps: comprehensive survey, challenges, and future perspectives. IEEE Open J. Intell. Transp. Syst. 4, 527–550 (2023)CrossRef Elghazaly, G., Frank, R., Harvey, S., Safko, S.: High-definition maps: comprehensive survey, challenges, and future perspectives. IEEE Open J. Intell. Transp. Syst. 4, 527–550 (2023)CrossRef
8.
Zurück zum Zitat Kaplan, E.D.: Understanding GPS: principles and applications (1996) Kaplan, E.D.: Understanding GPS: principles and applications (1996)
9.
Zurück zum Zitat Li, Q., Wang, Y., Wang, Y., Zhao, H.: HDMapNet: An online HD map construction and evaluation framework. In: 2022 International Conference on Robotics and Automation (ICRA), pp. 4628–4634. IEEE (2022) Li, Q., Wang, Y., Wang, Y., Zhao, H.: HDMapNet: An online HD map construction and evaluation framework. In: 2022 International Conference on Robotics and Automation (ICRA), pp. 4628–4634. IEEE (2022)
10.
Zurück zum Zitat Liao, B., Chen, S., Wang, X., Cheng, T., Zhang, Q., Liu, W., Huang, C.: MapTR: structured modeling and learning for online vectorized HD map construction. In: The Eleventh International Conference on Learning Representations (2023) Liao, B., Chen, S., Wang, X., Cheng, T., Zhang, Q., Liu, W., Huang, C.: MapTR: structured modeling and learning for online vectorized HD map construction. In: The Eleventh International Conference on Learning Representations (2023)
11.
Zurück zum Zitat Liu, R., Wang, J., Zhang, B.: High definition map for automated driving: overview and analysis. J. Navig. 73, 324–341 (2020)CrossRef Liu, R., Wang, J., Zhang, B.: High definition map for automated driving: overview and analysis. J. Navig. 73, 324–341 (2020)CrossRef
12.
Zurück zum Zitat Liu, Y., Yuan, T., Wang, Y., Wang, Y., Zhao, H.: VectorMapNet: end-to-end vectorized HD map learning. In: International Conference on Machine Learning, pp. 22352–22369. PMLR (2023) Liu, Y., Yuan, T., Wang, Y., Wang, Y., Zhao, H.: VectorMapNet: end-to-end vectorized HD map learning. In: International Conference on Machine Learning, pp. 22352–22369. PMLR (2023)
13.
Zurück zum Zitat Mi, L., et al.: HDMapGen: a hierarchical graph generative model of high definition maps. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4225–4234 (2021) Mi, L., et al.: HDMapGen: a hierarchical graph generative model of high definition maps. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4225–4234 (2021)
14.
Zurück zum Zitat Qiao, L., Ding, W., Qiu, X., Zhang, C.: End-to-end vectorized HD-map construction with piecewise Bezier curve. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13218–13228 (2023) Qiao, L., Ding, W., Qiu, X., Zhang, C.: End-to-end vectorized HD-map construction with piecewise Bezier curve. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 13218–13228 (2023)
15.
Zurück zum Zitat Reynolds, D.A., et al.: Gaussian mixture models. Encycl. Biomet. 741(659-663) (2009) Reynolds, D.A., et al.: Gaussian mixture models. Encycl. Biomet. 741(659-663) (2009)
16.
Zurück zum Zitat Roriz, R., Cabral, J., Gomes, T.: Automotive lidar technology: a survey. IEEE Trans. Intell. Transp. Syst. 23, 6282–6297 (2021)CrossRef Roriz, R., Cabral, J., Gomes, T.: Automotive lidar technology: a survey. IEEE Trans. Intell. Transp. Syst. 23, 6282–6297 (2021)CrossRef
17.
Zurück zum Zitat Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., Rus, D.: LIO-SAM: tightly-coupled lidar inertial odometry via smoothing and mapping. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5135–5142 (2020) Shan, T., Englot, B., Meyers, D., Wang, W., Ratti, C., Rus, D.: LIO-SAM: tightly-coupled lidar inertial odometry via smoothing and mapping. In: 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5135–5142 (2020)
18.
Zurück zum Zitat Shin, J., Rameau, F., Jeong, H., Kum, D.: Instagram: instance-level graph modeling for vectorized HD map learning. arXiv preprint arXiv:2301.04470 (2023) Shin, J., Rameau, F., Jeong, H., Kum, D.: Instagram: instance-level graph modeling for vectorized HD map learning. arXiv preprint arXiv:​2301.​04470 (2023)
19.
Zurück zum Zitat Voita, E., Talbot, D., Moiseev, F., Sennrich, R., Titov, I.: Analyzing multi-head self-attention: specialized heads do the heavy lifting, the rest can be pruned. In: Korhonen, A., Traum, D., Màrquez, L. (eds.) Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5797–5808. Association for Computational Linguistics, Florence (2019) Voita, E., Talbot, D., Moiseev, F., Sennrich, R., Titov, I.: Analyzing multi-head self-attention: specialized heads do the heavy lifting, the rest can be pruned. In: Korhonen, A., Traum, D., Màrquez, L. (eds.) Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5797–5808. Association for Computational Linguistics, Florence (2019)
20.
Zurück zum Zitat Zhang, J., Singh, S.: LOAM: Lidar odometry and mapping in real-time. In: Robotics: Science and Systems (2014) Zhang, J., Singh, S.: LOAM: Lidar odometry and mapping in real-time. In: Robotics: Science and Systems (2014)
Metadaten
Titel
Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles
verfasst von
Miao Fan
Yi Yao
Jianping Zhang
Xiangbo Song
Daihui Wu
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2966-1_22

Premium Partner