Skip to main content
Erschienen in: Fire Technology 5/2021

08.05.2021

Multi-Scale Prediction For Fire Detection Using Convolutional Neural Network

verfasst von: Myeongho Jeon, Han-Soo Choi, Junho Lee, Myungjoo Kang

Erschienen in: Fire Technology | Ausgabe 5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The automation of fire detection systems can reduce the loss of life and property by allowing a fast and accurate response to fire accidents. Although visual techniques have some advantages over sensor-based methods, conventional image processing-based methods frequently cause false alarms. Recent studies on convolutional neural networks have overcome these limitations and exhibited an outstanding performance in fire detection tasks. Nevertheless, previous studies have only used single-scale feature maps for fire image classification, which are insufficiently robust to fires of various sizes in the images. To address this issue, we propose a multi-scale prediction framework that exploits the feature maps of all the scales obtained by the deeply stacked convolutional layers. To utilize the feature maps of various scales in the final prediction, this paper proposes a feature-squeeze block. The feature-squeeze block squeezes the feature maps spatially and channel-wise to effectively use the information from the multi-scale prediction. Extensive evaluations demonstrate that the proposed method outperforms the state-of-the-art convolutional neural networks-based methods. As a result of the experiment, the proposed method shows 97.89% for F1-score and 0.0227 for false positive rate in the average of evaluations for multiple.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. In: 2004 International conference on image processing, 2004 (ICIP’04), vol. 3, pp. 1707–1710. IEEE Chen TH, Wu PH, Chiou YC (2004) An early fire-detection method based on image processing. In: 2004 International conference on image processing, 2004 (ICIP’04), vol. 3, pp. 1707–1710. IEEE
2.
Zurück zum Zitat Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Safety J 41(4):285–289CrossRef Marbach G, Loepfe M, Brupbacher T (2006) An image processing technique for fire detection in video images. Fire Safety J 41(4):285–289CrossRef
3.
Zurück zum Zitat Celik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Safety J 44(2):147–158CrossRef Celik T, Demirel H (2009) Fire detection in video sequences using a generic color model. Fire Safety J 44(2):147–158CrossRef
4.
Zurück zum Zitat Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef Celik T (2010) Fast and efficient method for fire detection using image processing. ETRI J 32(6):881–890CrossRef
5.
Zurück zum Zitat Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185CrossRef Celik T, Demirel H, Ozkaramanli H, Uyguroglu M (2007) Fire detection using statistical color model in video sequences. J Vis Commun Image Represent 18(2):176–185CrossRef
6.
Zurück zum Zitat Rinsurongkawong S, Ekpanyapong M, Dailey MN (2012) Fire detection for early fire alarm based on optical flow video processing. In: 2012 9th International conference on electrical engineering/electronics, computer, telecommunications and information technology, pp. 1-4, IEEE. Rinsurongkawong S, Ekpanyapong M, Dailey MN (2012) Fire detection for early fire alarm based on optical flow video processing. In: 2012 9th International conference on electrical engineering/electronics, computer, telecommunications and information technology, pp. 1-4, IEEE.
7.
Zurück zum Zitat Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Safety J 44(3):322–329CrossRef Ko BC, Cheong KH, Nam JY (2009) Fire detection based on vision sensor and support vector machines. Fire Safety J 44(3):322–329CrossRef
8.
Zurück zum Zitat Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In 2015 Chinese Automation Congress (CAC), pp. 633-637. IEEE Zhou Q, Yang X, Bu L (2015) Analysis of shape features of flame and interference image in video fire detection. In 2015 Chinese Automation Congress (CAC), pp. 633-637. IEEE
9.
Zurück zum Zitat Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Safety J 79:37–43CrossRef Kong SG, Jin D, Li S, Kim H (2016) Fast fire flame detection in surveillance video using logistic regression and temporal smoothing. Fire Safety J 79:37–43CrossRef
10.
Zurück zum Zitat Mao W, Wang W, Dou Z, Li Y (2018) Fire recognition based on multi-channel convolutional neural network. Fire Technol 54(2):531–554CrossRef Mao W, Wang W, Dou Z, Li Y (2018) Fire recognition based on multi-channel convolutional neural network. Fire Technol 54(2):531–554CrossRef
11.
Zurück zum Zitat Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: A specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:1905.11922. Jadon A, Omama M, Varshney A, Ansari MS, Sharma R (2019) Firenet: A specialized lightweight fire & smoke detection model for real-time IoT applications. arXiv preprint arXiv:​1905.​11922.
12.
Zurück zum Zitat Saeed F, Paul A, gaikumar P, Nayyar A (2019) Convolutional neural network based early fire detection. Multimed Tools Appl 79:9083–9099CrossRef Saeed F, Paul A, gaikumar P, Nayyar A (2019) Convolutional neural network based early fire detection. Multimed Tools Appl 79:9083–9099CrossRef
13.
Zurück zum Zitat Frizzi S, Kaabi R, Bouchouicha M, Ginoux JM, Moreau E, Fnaiech F (2016) Convolutional neural network for video fire and smoke detection. In: IECON 2016-42nd annual conference of the IEEE industrial electronics society, pp. 877-882, IEEE Frizzi S, Kaabi R, Bouchouicha M, Ginoux JM, Moreau E, Fnaiech F (2016) Convolutional neural network for video fire and smoke detection. In: IECON 2016-42nd annual conference of the IEEE industrial electronics society, pp. 877-882, IEEE
14.
Zurück zum Zitat Dunnings AJ, Breckon TP (2018) Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. In: 2018 25th IEEE International conference on image processing (ICIP), pp. 1558-1562, IEEE Dunnings AJ, Breckon TP (2018) Experimentally defined convolutional neural network architecture variants for non-temporal real-time fire detection. In: 2018 25th IEEE International conference on image processing (ICIP), pp. 1558-1562, IEEE
15.
Zurück zum Zitat Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: 2016 International forum on management, education and information technology application. Atlantis Press Zhang Q, Xu J, Xu L, Guo H (2016) Deep convolutional neural networks for forest fire detection. In: 2016 International forum on management, education and information technology application. Atlantis Press
16.
Zurück zum Zitat Sharma J, Granmo OC, Goodwin M, Fidje JT (2017) Deep convolutional neural networks for fire detection in images. Int Conf Eng Appl Neural Netw. Springer, Cham, pp 183–193CrossRef Sharma J, Granmo OC, Goodwin M, Fidje JT (2017) Deep convolutional neural networks for fire detection in images. Int Conf Eng Appl Neural Netw. Springer, Cham, pp 183–193CrossRef
17.
Zurück zum Zitat Maksymiv O, Rak T, Peleshko D (2017) Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence. In: 2017 14th international conference the experience of designing and application of CAD Systems in microelectronics (CADSM), pp. 351–353, IEEE Maksymiv O, Rak T, Peleshko D (2017) Real-time fire detection method combining AdaBoost, LBP and convolutional neural network in video sequence. In: 2017 14th international conference the experience of designing and application of CAD Systems in microelectronics (CADSM), pp. 351–353, IEEE
18.
Zurück zum Zitat Yang H, Jang H, Kim T, Lee B (2019) Non-temporal lightweight fire detection network for intelligent surveillance systems. IEEE Access 7:169257–169266CrossRef Yang H, Jang H, Kim T, Lee B (2019) Non-temporal lightweight fire detection network for intelligent surveillance systems. IEEE Access 7:169257–169266CrossRef
19.
Zurück zum Zitat Li S, Yan Q, Liu P (2020) An efficient fire detection method based on multiscale feature extraction, implicit deep supervision and channel attention mechanism. IEEE Trans Image Process 29:8467–8475CrossRef Li S, Yan Q, Liu P (2020) An efficient fire detection method based on multiscale feature extraction, implicit deep supervision and channel attention mechanism. IEEE Trans Image Process 29:8467–8475CrossRef
20.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In Proceedings of the IEEE Conference on computer vision and pattern recognition, pp. 1–9
21.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:​1409.​1556.
22.
Zurück zum Zitat Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183CrossRef Muhammad K, Ahmad J, Mehmood I, Rho S, Baik SW (2018) Convolutional neural networks based fire detection in surveillance videos. IEEE Access 6:18174–18183CrossRef
23.
Zurück zum Zitat Muhammad K, Ahmad J, Baik SW (2018) Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288:30–42CrossRef Muhammad K, Ahmad J, Baik SW (2018) Early fire detection using convolutional neural networks during surveillance for effective disaster management. Neurocomputing 288:30–42CrossRef
24.
Zurück zum Zitat Muhammad K, Khan S, Elhoseny M, Ahmed SH, Baik SW (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Informat 15(5):3113–3122CrossRef Muhammad K, Khan S, Elhoseny M, Ahmed SH, Baik SW (2019) Efficient fire detection for uncertain surveillance environment. IEEE Trans Ind Informat 15(5):3113–3122CrossRef
25.
Zurück zum Zitat Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Studies Thermal Eng 19:100625CrossRef Li P, Zhao W (2020) Image fire detection algorithms based on convolutional neural networks. Case Studies Thermal Eng 19:100625CrossRef
26.
Zurück zum Zitat Wu S, Zhang L (2018) Using popular object detection methods for real time forest fire detection. In 2018 11th International symposium on computational intelligence and design (ISCID), vol. 1, pp. 280–284, IEEE Wu S, Zhang L (2018) Using popular object detection methods for real time forest fire detection. In 2018 11th International symposium on computational intelligence and design (ISCID), vol. 1, pp. 280–284, IEEE
27.
Zurück zum Zitat Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:​1506.​01497.
28.
Zurück zum Zitat Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861. Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:​1704.​04861.
29.
Zurück zum Zitat Töreyin BU, Dedeoğlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58CrossRef Töreyin BU, Dedeoğlu Y, Güdükbay U, Cetin AE (2006) Computer vision based method for real-time fire and flame detection. Pattern Recogn Lett 27(1):49–58CrossRef
30.
Zurück zum Zitat Zhang Z, Zhao J, Zhang D, Qu C, Ke Y, Cai B (2008) Contour based forest fire detection using FFT and wavelet. In 2008 International conference on computer science and software engineering, vol. 1, pp. 760-763, IEEE Zhang Z, Zhao J, Zhang D, Qu C, Ke Y, Cai B (2008) Contour based forest fire detection using FFT and wavelet. In 2008 International conference on computer science and software engineering, vol. 1, pp. 760-763, IEEE
31.
Zurück zum Zitat Günay O, Taşdemir K, Töreyin BU, Çetin AE (2010) Fire detection in video using LMS based active learning. Fire Technol 46(3):551–577CrossRef Günay O, Taşdemir K, Töreyin BU, Çetin AE (2010) Fire detection in video using LMS based active learning. Fire Technol 46(3):551–577CrossRef
32.
Zurück zum Zitat Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circuits Syst Video Technol 20(5):721–731CrossRef Borges PVK, Izquierdo E (2010) A probabilistic approach for vision-based fire detection in videos. IEEE Trans Circuits Syst Video Technol 20(5):721–731CrossRef
33.
Zurück zum Zitat Qiu T, Yan Y, Lu G (2011) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Measure 61(5):1486–1493CrossRef Qiu T, Yan Y, Lu G (2011) An autoadaptive edge-detection algorithm for flame and fire image processing. IEEE Trans Instrum Measure 61(5):1486–1493CrossRef
34.
Zurück zum Zitat Wang DC, Cui X, Park E, Jin C, Kim H (2013) Adaptive flame detection using randomness testing and robust features. Fire Safety J 55:116–125CrossRef Wang DC, Cui X, Park E, Jin C, Kim H (2013) Adaptive flame detection using randomness testing and robust features. Fire Safety J 55:116–125CrossRef
35.
Zurück zum Zitat Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circuits Syst Video Technol 25(9):1545–1556CrossRef Foggia P, Saggese A, Vento M (2015) Real-time fire detection for video-surveillance applications using a combination of experts based on color, shape, and motion. IEEE Trans Circuits Syst Video Technol 25(9):1545–1556CrossRef
36.
Zurück zum Zitat He K, Zhang X, Ren S, & Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778 He K, Zhang X, Ren S, & Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770-778
37.
Zurück zum Zitat Krizhevsky A, Sutskever I, & Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097-1105 Krizhevsky A, Sutskever I, & Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems, pp. 1097-1105
38.
Zurück zum Zitat Zhang G, Wang M, Liu K (2019) Forest fire susceptibility modeling using a convolutional neural network for Yunnan province of China. Int J Disaster Risk Sci 10(3):386–403CrossRef Zhang G, Wang M, Liu K (2019) Forest fire susceptibility modeling using a convolutional neural network for Yunnan province of China. Int J Disaster Risk Sci 10(3):386–403CrossRef
39.
Zurück zum Zitat Park B, Yu S, Jeong J (2019) Densely connected hierarchical network for image denoising. In Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp. 0–0 Park B, Yu S, Jeong J (2019) Densely connected hierarchical network for image denoising. In Proceedings of the IEEE Conference on computer vision and pattern recognition workshops, pp. 0–0
40.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In European conference on computer vision. Springer, Cham, pp. 630–645 He K, Zhang X, Ren S, Sun J (2016) Identity mappings in deep residual networks. In European conference on computer vision. Springer, Cham, pp. 630–645
41.
Zurück zum Zitat Project FP7-ICT-2013-EU-Brazil (2013) RESCURE-Reliable and Smart Crowdsourcing Solution for Emergency and Crisis Management Project FP7-ICT-2013-EU-Brazil (2013) RESCURE-Reliable and Smart Crowdsourcing Solution for Emergency and Crisis Management
42.
Zurück zum Zitat Daniel YT Chino et al. (2015) Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: 2015 28th SIBGRAPI conference on graphics, patterns and images, pp. 95–102, IEEE Daniel YT Chino et al. (2015) Bowfire: detection of fire in still images by integrating pixel color and texture analysis. In: 2015 28th SIBGRAPI conference on graphics, patterns and images, pp. 95–102, IEEE
43.
Zurück zum Zitat Mlích, J, Koplík, K, Hradiš M, Zemčík P (2020) Fire segmentation in still images. In: International conference on advanced concepts for intelligent vision systems. Springer, Cham, pp. 27–37 Mlích, J, Koplík, K, Hradiš M, Zemčík P (2020) Fire segmentation in still images. In: International conference on advanced concepts for intelligent vision systems. Springer, Cham, pp. 27–37
Metadaten
Titel
Multi-Scale Prediction For Fire Detection Using Convolutional Neural Network
verfasst von
Myeongho Jeon
Han-Soo Choi
Junho Lee
Myungjoo Kang
Publikationsdatum
08.05.2021
Verlag
Springer US
Erschienen in
Fire Technology / Ausgabe 5/2021
Print ISSN: 0015-2684
Elektronische ISSN: 1572-8099
DOI
https://doi.org/10.1007/s10694-021-01132-y

Weitere Artikel der Ausgabe 5/2021

Fire Technology 5/2021 Zur Ausgabe