Skip to main content

2024 | OriginalPaper | Buchkapitel

Review of Three-Dimensional Reconstruction Based on Hyperspectral Imaging

verfasst von : Lezhou Feng, Ruotong Zou, Chao Sun, Xinwei Dong, Xiaoming Ding, Guowei Che

Erschienen in: Communications, Signal Processing, and Systems

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the past few decades, with the continuous progress in devices and research, both hyperspectral imaging technology and three-dimensional reconstruction techniques have made significant advancements. In recent years, three-dimensional reconstruction based on hyperspectral imaging has shown remarkable results. Unlike traditional three-dimensional reconstruction techniques based on RGB images that only capture the geometric information of the target object, the spectral diversity provided by hyperspectral images allows for the reconstruction of three-dimensional models with higher accuracy and better visual effects. Consequently, an increasing number of researchers have started to explore the field of three-dimensional reconstruction based on hyperspectral imaging. This article provides a comprehensive review of the specific steps involved in three-dimensional reconstruction based on hyperspectral imaging, including traditional algorithms used in the reconstruction process. Furthermore, it introduces the latest research on implementing three-dimensional reconstruction of hyperspectral images with the assistance of deep learning techniques.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Duan P, Hu S, Kang X et al (2022) Shadow removal of hyperspectral remote sensing images with multiexposure fusion. IEEE Trans Geosci Remote Sens 60:1–11 Duan P, Hu S, Kang X et al (2022) Shadow removal of hyperspectral remote sensing images with multiexposure fusion. IEEE Trans Geosci Remote Sens 60:1–11
2.
Zurück zum Zitat Zhang L, Jin J, Wang L et al (2023) Elimination of leaf angle impacts on plant reflectance spectra using fusion of hyperspectral images and 3D point clouds. Sensors 23(1):44CrossRef Zhang L, Jin J, Wang L et al (2023) Elimination of leaf angle impacts on plant reflectance spectra using fusion of hyperspectral images and 3D point clouds. Sensors 23(1):44CrossRef
3.
Zurück zum Zitat Xue Q, Li H, Lu F et al (2022) Underwater hyperspectral imaging system for deep-sea exploration. Front Phys 10:1096CrossRef Xue Q, Li H, Lu F et al (2022) Underwater hyperspectral imaging system for deep-sea exploration. Front Phys 10:1096CrossRef
4.
Zurück zum Zitat Pu C, Huang H, Luo L (2021) Classfication of hyperspectral image with attention mechanism-based dual-path convolutional network. IEEE Geosci Remote Sens Lett 19:1–5 Pu C, Huang H, Luo L (2021) Classfication of hyperspectral image with attention mechanism-based dual-path convolutional network. IEEE Geosci Remote Sens Lett 19:1–5
5.
Zurück zum Zitat Pereira JFQ, Pimentel MF, Honorato RS et al (2021) Hierarchical method and hyperspectral images for classification of blood stains on colored and printed fabrics. Chemom Intell Lab Syst 210:104253CrossRef Pereira JFQ, Pimentel MF, Honorato RS et al (2021) Hierarchical method and hyperspectral images for classification of blood stains on colored and printed fabrics. Chemom Intell Lab Syst 210:104253CrossRef
6.
Zurück zum Zitat Yoon J (2022) Hyperspectral imaging for clinical applications. BioChip J 16(1):1–12CrossRef Yoon J (2022) Hyperspectral imaging for clinical applications. BioChip J 16(1):1–12CrossRef
7.
Zurück zum Zitat Nieto JI, Monteiro ST, Viejo D (2010) 3D geological modelling using laser and hyperspectral data. In: 2010 IEEE international geoscience and remote sensing symposium, pp 4568–4571. IEEE Nieto JI, Monteiro ST, Viejo D (2010) 3D geological modelling using laser and hyperspectral data. In: 2010 IEEE international geoscience and remote sensing symposium, pp 4568–4571. IEEE
8.
Zurück zum Zitat Liang J, Zia A, Zhou J et al (2013) 3D plant modelling via hyperspectral imaging. In: Proceedings of the IEEE international conference on computer vision workshops, pp 172–177 Liang J, Zia A, Zhou J et al (2013) 3D plant modelling via hyperspectral imaging. In: Proceedings of the IEEE international conference on computer vision workshops, pp 172–177
9.
Zurück zum Zitat Zia A, Liang J, Zhou J et al (2015) 3D reconstruction from hyperspectral images. In: 2015 IEEE winter conference on applications of computer vision, pp 318–325. IEEE Zia A, Liang J, Zhou J et al (2015) 3D reconstruction from hyperspectral images. In: 2015 IEEE winter conference on applications of computer vision, pp 318–325. IEEE
10.
Zurück zum Zitat Ma T, Xing Y, Gong D et al (2022) A deep learning-based hyperspectral keypoint representation method and its application for 3D reconstruction. IEEE Access 10:85266–85277CrossRef Ma T, Xing Y, Gong D et al (2022) A deep learning-based hyperspectral keypoint representation method and its application for 3D reconstruction. IEEE Access 10:85266–85277CrossRef
11.
Zurück zum Zitat Boardman JW (1989) Inversion of imaging spectrometry data using singular value decomposition. In: 12th Canadian symposium on remote sensing geoscience and remote sensing symposium, vol 4, pp 2069–2072. IEEE Boardman JW (1989) Inversion of imaging spectrometry data using singular value decomposition. In: 12th Canadian symposium on remote sensing geoscience and remote sensing symposium, vol 4, pp 2069–2072. IEEE
12.
Zurück zum Zitat Goetz AFH, Vane G, Solomon JE et al (1985) Imaging spectrometry for earth remote sensing. Science 228(4704):1147–1153 Goetz AFH, Vane G, Solomon JE et al (1985) Imaging spectrometry for earth remote sensing. Science 228(4704):1147–1153
13.
Zurück zum Zitat Clark RN, King TVV, Klejwa M et al (1990) High spectral resolution reflectance spectroscopy of minerals. J Geophys Res: Solid Earth 95(B8):12653–12680CrossRef Clark RN, King TVV, Klejwa M et al (1990) High spectral resolution reflectance spectroscopy of minerals. J Geophys Res: Solid Earth 95(B8):12653–12680CrossRef
15.
Zurück zum Zitat Wehr A, Lohr U (1999) Airborne laser scanning—an introduction and overview. ISPRS J Photogramm Remote Sens 54(2–3):68–82CrossRef Wehr A, Lohr U (1999) Airborne laser scanning—an introduction and overview. ISPRS J Photogramm Remote Sens 54(2–3):68–82CrossRef
16.
Zurück zum Zitat Mouroulis P, Green RO, Chrien TG (2000) Design of pushbroom imaging spectrometers for optimum recovery of spectroscopic and spatial information. Appl Opt 39(13):2210–2220CrossRef Mouroulis P, Green RO, Chrien TG (2000) Design of pushbroom imaging spectrometers for optimum recovery of spectroscopic and spatial information. Appl Opt 39(13):2210–2220CrossRef
17.
Zurück zum Zitat Hill B (2002) The history of multispectral imaging at Aachen university of technology. Spect Vision 2–8 Hill B (2002) The history of multispectral imaging at Aachen university of technology. Spect Vision 2–8
18.
Zurück zum Zitat Shogenji R, Kitamura Y, Yamada K et al (2004) Multispectral imaging using compact compound optics. Opt Express 12(8):1643–1655CrossRef Shogenji R, Kitamura Y, Yamada K et al (2004) Multispectral imaging using compact compound optics. Opt Express 12(8):1643–1655CrossRef
19.
Zurück zum Zitat Sima A, Livens S, Dierckx W et al (2014) Spatially variable filters—expanding the spectral dimension of compact cameras for remotely piloted aircraft systems. In: 2014 IEEE geoscience and remote sensing symposium, pp 1983–1986. IEEE Sima A, Livens S, Dierckx W et al (2014) Spatially variable filters—expanding the spectral dimension of compact cameras for remotely piloted aircraft systems. In: 2014 IEEE geoscience and remote sensing symposium, pp 1983–1986. IEEE
20.
Zurück zum Zitat Hirai A, Inoue T, Itoh K et al (1994) Application of measurement multiple-image fourier of fast phenomena transform spectral imaging to measurement of fast phenomena. Opt Rev 1:205–207CrossRef Hirai A, Inoue T, Itoh K et al (1994) Application of measurement multiple-image fourier of fast phenomena transform spectral imaging to measurement of fast phenomena. Opt Rev 1:205–207CrossRef
21.
Zurück zum Zitat Brady DJ, Gehm ME (2006) Compressive imaging spectrometers using coded apertures. Visual Inf Process XV SPIE 6246:80–88 Brady DJ, Gehm ME (2006) Compressive imaging spectrometers using coded apertures. Visual Inf Process XV SPIE 6246:80–88
23.
Zurück zum Zitat Bao J, Bawendi MG (2015) A colloidal quantum dot spectrometer. Nature 523(7558):67–70CrossRef Bao J, Bawendi MG (2015) A colloidal quantum dot spectrometer. Nature 523(7558):67–70CrossRef
24.
Zurück zum Zitat Guan H, Niu H (2022) Feature extraction of foul action of football players based on machine vision. Mob Inf Syst Guan H, Niu H (2022) Feature extraction of foul action of football players based on machine vision. Mob Inf Syst
25.
Zurück zum Zitat Carpenter HJ, Ghayesh MH, Zander AC et al (2022) Automated coronary optical coherence tomography feature extraction with application to three-dimensional reconstruction. Tomography 8(3):1307–1349CrossRef Carpenter HJ, Ghayesh MH, Zander AC et al (2022) Automated coronary optical coherence tomography feature extraction with application to three-dimensional reconstruction. Tomography 8(3):1307–1349CrossRef
26.
Zurück zum Zitat Harris C, Stephens M (1988) A combined corner and edge detector. In: Alvey vision conference, vol 15, no 50, pp 10–5244 Harris C, Stephens M (1988) A combined corner and edge detector. In: Alvey vision conference, vol 15, no 50, pp 10–5244
27.
Zurück zum Zitat Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60:91–110CrossRef Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60:91–110CrossRef
28.
Zurück zum Zitat Mehta T, Bhensdadia C (2019) Adaptive near duplicate image retrieval using SURF and CNN features. Int J Intell Eng Syst 12(5):104–115 Mehta T, Bhensdadia C (2019) Adaptive near duplicate image retrieval using SURF and CNN features. Int J Intell Eng Syst 12(5):104–115
29.
Zurück zum Zitat Abdel-Hakim AE, Farag AA (2006) CSIFT: a SIFT descriptor with color invariant characteristics. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol 2, pp 1978–1983. IEEE Abdel-Hakim AE, Farag AA (2006) CSIFT: a SIFT descriptor with color invariant characteristics. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol 2, pp 1978–1983. IEEE
30.
Zurück zum Zitat Guiqin Y, Chang X, Jiang Z (2019) A fast aerial images mosaic method based on ORB feature and homography matrix. In: 2019 International conference on computer, information and telecommunication systems (CITS), pp 1–5. IEEE Guiqin Y, Chang X, Jiang Z (2019) A fast aerial images mosaic method based on ORB feature and homography matrix. In: 2019 International conference on computer, information and telecommunication systems (CITS), pp 1–5. IEEE
31.
Zurück zum Zitat Guoshen D, Yanli Q, Weining Y (2021) Feature extraction and matching of F-SIFT based on spectral image space. Opt Precis Eng 29(5):1180–1189CrossRef Guoshen D, Yanli Q, Weining Y (2021) Feature extraction and matching of F-SIFT based on spectral image space. Opt Precis Eng 29(5):1180–1189CrossRef
32.
Zurück zum Zitat Yi KM, Trulls E, Lepetit V et al (2016) Lift: Learned invariant feature transform. In: Computer vision–ECCV 2016: 14th European conference, Amsterdam, the Netherlands, October 11-14, 2016, proceedings, Part VI 14, pp 467–483. Springer International Publishing Yi KM, Trulls E, Lepetit V et al (2016) Lift: Learned invariant feature transform. In: Computer vision–ECCV 2016: 14th European conference, Amsterdam, the Netherlands, October 11-14, 2016, proceedings, Part VI 14, pp 467–483. Springer International Publishing
33.
34.
Zurück zum Zitat DeTone D, Malisiewicz T, Rabinovich A (2018) Superpoint: Self-supervised interest point detection and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 224–236 DeTone D, Malisiewicz T, Rabinovich A (2018) Superpoint: Self-supervised interest point detection and description. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 224–236
35.
Zurück zum Zitat Marr D, Poggio T (1979) A computational theory of human stereo vision. In: Proceedings of the royal society of London. Series B. biological sciences 204(1156):301–328 Marr D, Poggio T (1979) A computational theory of human stereo vision. In: Proceedings of the royal society of London. Series B. biological sciences 204(1156):301–328
36.
Zurück zum Zitat Li W, Wang S, Xie W et al (2023) Large scale medical image online three-dimensional reconstruction based on WebGL using four tier client server architecture. Inf Vis 22(2):100–114CrossRef Li W, Wang S, Xie W et al (2023) Large scale medical image online three-dimensional reconstruction based on WebGL using four tier client server architecture. Inf Vis 22(2):100–114CrossRef
37.
Zurück zum Zitat Sampaio GS, Silva LA, Marengoni M (2021) 3D reconstruction of non-rigid plants and sensor data fusion for agriculture phenotyping. Sensors 21(12):4115CrossRef Sampaio GS, Silva LA, Marengoni M (2021) 3D reconstruction of non-rigid plants and sensor data fusion for agriculture phenotyping. Sensors 21(12):4115CrossRef
38.
Zurück zum Zitat Zhang D, Xu F, Pun CM et al (2021) Virtual reality aided high-quality 3D reconstruction by remote drones. ACM Trans Internet Tech (TOIT) 22(1):1–20CrossRef Zhang D, Xu F, Pun CM et al (2021) Virtual reality aided high-quality 3D reconstruction by remote drones. ACM Trans Internet Tech (TOIT) 22(1):1–20CrossRef
39.
Zurück zum Zitat Abdelazeem M, Elamin A, Afifi A et al (2021) Multi-sensor point cloud data fusion for precise 3D mapping. Egyptian J Remote Sens Space Sci 24(3):835–844 Abdelazeem M, Elamin A, Afifi A et al (2021) Multi-sensor point cloud data fusion for precise 3D mapping. Egyptian J Remote Sens Space Sci 24(3):835–844
40.
Zurück zum Zitat Mada SK, Smith ML, Smith LN et al (2003) Overview of passive and active vision techniques for hand-held 3D data acquisition opto-Ireland 2002: optical metrology, imaging, and machine vision. SPIE 4877:16–27 Mada SK, Smith ML, Smith LN et al (2003) Overview of passive and active vision techniques for hand-held 3D data acquisition opto-Ireland 2002: optical metrology, imaging, and machine vision. SPIE 4877:16–27
41.
42.
Zurück zum Zitat Deliry SI, Avdan U (2021) Accuracy of unmanned aerial systems photogrammetry and structure from motion in surveying and mapping: a review. J Indian Soc Remote Sens 49(8):1997–2017CrossRef Deliry SI, Avdan U (2021) Accuracy of unmanned aerial systems photogrammetry and structure from motion in surveying and mapping: a review. J Indian Soc Remote Sens 49(8):1997–2017CrossRef
43.
Zurück zum Zitat Pepe M, Alfio VS, Costantino D (2022) UAV platforms and the SfM-MVS approach in the 3D surveys and modelling: a review in the cultural heritage field. Appl Sci 12(24):12886CrossRef Pepe M, Alfio VS, Costantino D (2022) UAV platforms and the SfM-MVS approach in the 3D surveys and modelling: a review in the cultural heritage field. Appl Sci 12(24):12886CrossRef
Metadaten
Titel
Review of Three-Dimensional Reconstruction Based on Hyperspectral Imaging
verfasst von
Lezhou Feng
Ruotong Zou
Chao Sun
Xinwei Dong
Xiaoming Ding
Guowei Che
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-99-7502-0_51

Neuer Inhalt