Skip to main content

2024 | OriginalPaper | Buchkapitel

Denoising Real-World Low Light Surveillance Videos Based on Trilateral Filter

verfasst von : Peng Xu, Ping Zheng, Lijuan Zheng, Xiong Zhang, Yan Shang, Haoxiang Zhang, Yiming Geng, Jiacong Gao, He Jiang

Erschienen in: Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, a real-world denoising method for surveillance videos based on the trilateral filter is proposed. The algorithm is faced with challenges, including the absence of “ground truth” images and the complexity of the spatio-temporal distribution of the noise signal. However, experimental results have demonstrated that noise on stationary objects in such situations can be easily eliminated by averaging neighboring frames. Consequently, effective noise removal throughout the entire video can be achieved by accurately tracking and filtering moving objects along their trajectories. The model can be broadly divided into four steps. Firstly, coarse motion vectors are obtained through bilateral motion estimation. Secondly, the error vectors are judged and corrected using an amplitude-phase filter. Thirdly, these vectors are refined by performing a full searching in a small area. Finally, the noise is removed by applying a trilateral filter along the trajectory. The effectiveness of our model has been confirmed through numerous experiments, showcasing superior performance in both visualization and quantitative testing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Anaya, J., et al.: RENOIR - a dataset for real low-light image noise reduction. J. Vis. Commun. Image Representation 51, 144–154 (2014)CrossRef Anaya, J., et al.: RENOIR - a dataset for real low-light image noise reduction. J. Vis. Commun. Image Representation 51, 144–154 (2014)CrossRef
2.
Zurück zum Zitat Karnati, V., et al.: Fast non-local algorithm for image denoising. In: Proceedings of the IEEE International Conference on Image Processing (ICIP), pp. 3873–3876 (2009) Karnati, V., et al.: Fast non-local algorithm for image denoising. In: Proceedings of the IEEE International Conference on Image Processing (ICIP), pp. 3873–3876 (2009)
3.
Zurück zum Zitat Cai, J.-F., et al.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20, 1956–1982 (2008)MathSciNetCrossRef Cai, J.-F., et al.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20, 1956–1982 (2008)MathSciNetCrossRef
4.
Zurück zum Zitat Choi, B.-T., et al.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consum. Electron. 46, 603–609 (2000)CrossRef Choi, B.-T., et al.: New frame rate up-conversion using bi-directional motion estimation. IEEE Trans. Consum. Electron. 46, 603–609 (2000)CrossRef
5.
Zurück zum Zitat Dabov, K., et al.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 2080–2095 (2007)MathSciNetCrossRef Dabov, K., et al.: Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Trans. Image Process. 16, 2080–2095 (2007)MathSciNetCrossRef
6.
Zurück zum Zitat Dong, W., et al.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22, 1620–1630 (2013)MathSciNetCrossRef Dong, W., et al.: Nonlocally centralized sparse representation for image restoration. IEEE Trans. Image Process. 22, 1620–1630 (2013)MathSciNetCrossRef
7.
Zurück zum Zitat Chuang, Y.-Y., et al.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 1–10 (2002) Chuang, Y.-Y., et al.: Fast bilateral filtering for the display of high-dynamic-range images. ACM Trans. Graph. 1–10 (2002)
8.
Zurück zum Zitat Gu, S., et al.: Weighted nuclear norm minimization with application to image denoising. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862–2869 (2014) Gu, S., et al.: Weighted nuclear norm minimization with application to image denoising. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 2862–2869 (2014)
9.
Zurück zum Zitat Guo, Y., et al.: Frame rate up-conversion using linear quadratic motion estimation and trilateral filtering motion smoothing. J. Display Technol. 12, 89–98 (2016) Guo, Y., et al.: Frame rate up-conversion using linear quadratic motion estimation and trilateral filtering motion smoothing. J. Display Technol. 12, 89–98 (2016)
10.
Zurück zum Zitat He, K., et al.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1397–1409 (2010)CrossRef He, K., et al.: Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1397–1409 (2010)CrossRef
11.
Zurück zum Zitat He, K., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2015) He, K., et al.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2015)
12.
Zurück zum Zitat Kang, S., et al.: Dual motion estimation for frame rate up-conversion. IEEE Trans. Circuits Syst. Video Technol. 20, 1909–1914 (2010)CrossRef Kang, S., et al.: Dual motion estimation for frame rate up-conversion. IEEE Trans. Circuits Syst. Video Technol. 20, 1909–1914 (2010)CrossRef
13.
Zurück zum Zitat Knaus, C., Zwicker, M.: Dual-domain image denoising. In: Proceedings of the IEEE International Conference on Image Processing, pp. 440–444 (2013) Knaus, C., Zwicker, M.: Dual-domain image denoising. In: Proceedings of the IEEE International Conference on Image Processing, pp. 440–444 (2013)
14.
Zurück zum Zitat Maggioni, M., et al.: Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms. IEEE Trans. Image Process. 21, 3952–3966 (2012)MathSciNetCrossRef Maggioni, M., et al.: Video denoising, deblocking, and enhancement through separable 4-D nonlocal spatiotemporal transforms. IEEE Trans. Image Process. 21, 3952–3966 (2012)MathSciNetCrossRef
15.
Zurück zum Zitat Maggioni, M., et al.: Nonlocal transform-domain filter for volumetric data denoising and reconstruction. IEEE Trans. Image Process. 22, 119–133 (2013)MathSciNetCrossRef Maggioni, M., et al.: Nonlocal transform-domain filter for volumetric data denoising and reconstruction. IEEE Trans. Image Process. 22, 119–133 (2013)MathSciNetCrossRef
16.
Zurück zum Zitat Maggioni, M., et al.: Joint removal of random and fixed-pattern noise through spatiotemporal video filtering. IEEE Trans. Image Process. 23, 4282–4296 (2014)MathSciNetCrossRef Maggioni, M., et al.: Joint removal of random and fixed-pattern noise through spatiotemporal video filtering. IEEE Trans. Image Process. 23, 4282–4296 (2014)MathSciNetCrossRef
17.
Zurück zum Zitat Orchard, M., et al.: Overlapped block motion compensation: an estimation-theoretic approach. IEEE Trans. Image Process. 5, 693–699 (1994)CrossRef Orchard, M., et al.: Overlapped block motion compensation: an estimation-theoretic approach. IEEE Trans. Image Process. 5, 693–699 (1994)CrossRef
18.
Zurück zum Zitat Paris, S., et al.: A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vis. 81, 24–52 (2006)CrossRef Paris, S., et al.: A fast approximation of the bilateral filter using a signal processing approach. Int. J. Comput. Vis. 81, 24–52 (2006)CrossRef
19.
Zurück zum Zitat Plötz, T., et al.: Benchmarking denoising algorithms with real photographs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2750–2759 (2017) Plötz, T., et al.: Benchmarking denoising algorithms with real photographs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2750–2759 (2017)
20.
Zurück zum Zitat Tomasi, C., et al.: Bilateral filtering for gray and color images. In: Proceedings of the IEEE Conference on Computer Vision (ICCV), pp. 839–846 (1998) Tomasi, C., et al.: Bilateral filtering for gray and color images. In: Proceedings of the IEEE Conference on Computer Vision (ICCV), pp. 839–846 (1998)
21.
Zurück zum Zitat Vedaldi, A., et al.: MatConvNet: convolutional neural networks for MATLAB. In: Proceedings of the ACM Conference on Multimedia, pp. 689–692 (2015) Vedaldi, A., et al.: MatConvNet: convolutional neural networks for MATLAB. In: Proceedings of the ACM Conference on Multimedia, pp. 689–692 (2015)
22.
Zurück zum Zitat Vinh, T.Q., et al.: Frame rate up-conversion using forward-backward jointing motion estimation and spatio-temporal motion vector smoothing. In: Proceedings of the International Conference on Computer Engineering & Systems, pp. 605–609 (2009) Vinh, T.Q., et al.: Frame rate up-conversion using forward-backward jointing motion estimation and spatio-temporal motion vector smoothing. In: Proceedings of the International Conference on Computer Engineering & Systems, pp. 605–609 (2009)
23.
Zurück zum Zitat Wang, Z., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRef Wang, Z., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRef
25.
Zurück zum Zitat Xu, J., et al.: Multi-channel weighted nuclear norm minimization for real color image denoising. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 1105–1113 (2017) Xu, J., et al.: Multi-channel weighted nuclear norm minimization for real color image denoising. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 1105–1113 (2017)
26.
Zurück zum Zitat Xu, J., et al.: Patch group based nonlocal self similarity prior learning for image denoising. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 244–252 (2015) Xu, J., et al.: Patch group based nonlocal self similarity prior learning for image denoising. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 244–252 (2015)
27.
Zurück zum Zitat Dabov, K., et al.: BM3D Image Denoising with Shape Adaptive Principal Component Analysis (2009) Dabov, K., et al.: BM3D Image Denoising with Shape Adaptive Principal Component Analysis (2009)
28.
Zurück zum Zitat Yoo, D.-G., et al.: Direction-select motion estimation for motion compensated frame rate up conversion. J. Display Technol. 9, 840–850 (2013)CrossRef Yoo, D.-G., et al.: Direction-select motion estimation for motion compensated frame rate up conversion. J. Display Technol. 9, 840–850 (2013)CrossRef
29.
Zurück zum Zitat Zhang, K., et al.: Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans. Image Process. 26, 3142–3155 (2016)MathSciNetCrossRef Zhang, K., et al.: Beyond a Gaussian denoiser: residual learning of deep CNN for image denoising. IEEE Trans. Image Process. 26, 3142–3155 (2016)MathSciNetCrossRef
30.
Zurück zum Zitat Zhang, K., et al.: FFDNet: toward a fast and flexible solution for CNN-based image denoising. IEEE Trans. Image Process. 27, 4608–4622 (2017)MathSciNetCrossRef Zhang, K., et al.: FFDNet: toward a fast and flexible solution for CNN-based image denoising. IEEE Trans. Image Process. 27, 4608–4622 (2017)MathSciNetCrossRef
31.
Zurück zum Zitat Zoran, D., et al.: From learning models of natural image patches to whole image restoration. In: Proceedings of the International Conference on Computer Vision, pp. 479–486 (2011) Zoran, D., et al.: From learning models of natural image patches to whole image restoration. In: Proceedings of the International Conference on Computer Vision, pp. 479–486 (2011)
Metadaten
Titel
Denoising Real-World Low Light Surveillance Videos Based on Trilateral Filter
verfasst von
Peng Xu
Ping Zheng
Lijuan Zheng
Xiong Zhang
Yan Shang
Haoxiang Zhang
Yiming Geng
Jiacong Gao
He Jiang
Copyright-Jahr
2024
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2757-5_64

Premium Partner