Skip to main content

2024 | OriginalPaper | Buchkapitel

Face Recognition and Hand Gesture Control for Tello Drone Navigation

verfasst von : Huy-Anh Bui, Anh-Tu Nguyen, Thanh-Hung Nguyen, Xuan-Thuan Nguyen

Erschienen in: Proceedings of the 3rd Annual International Conference on Material, Machines and Methods for Sustainable Development (MMMS2022)

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

These days, low-cost commercial drones are rapidly used in variety of fields, ranging from manufacturing and logistics to STEM education. This paper addresses a fully-actuated Tello Drone’s control under random positions and in an indoor environment. For this purpose, we designed a closed-loop controller based on computer vision techniques for face recognition and a gesticulation rule for navigable motion. To be more detailed, Local Binary Pattern Histogram combined with SQLite 3 is initially applied to detect the right target. After that, the built-in controller determines the hand gesture on the human target to transmit the commands to Tello Drone. Additionally, the user interface is also developed to summary and display the drone info during operation process. The experimental results revealed the effectiveness of the suggested strategy and the reliability of the drone under different scenarios.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat M. Alwateer, S.W. Loke, N. Fernando, Enabling drone services: drone crowdsourcing and drone scripting. IEEE Access 7, 110035–110049 (2019)CrossRef M. Alwateer, S.W. Loke, N. Fernando, Enabling drone services: drone crowdsourcing and drone scripting. IEEE Access 7, 110035–110049 (2019)CrossRef
3.
Zurück zum Zitat T.-V. Dang, Smart home management system with face recognition based on ArcFace model in deep convolutional neural network. J. Robot. Control 3(6), 754–761 (2022) T.-V. Dang, Smart home management system with face recognition based on ArcFace model in deep convolutional neural network. J. Robot. Control 3(6), 754–761 (2022)
4.
Zurück zum Zitat B. Patle, S.-L. Chen, B. Patel, S.K. Kashyap, S. Sanap, Topological drone navigation in uncertain environment. Ind. Robot. 48(3), 423–441 (2021)CrossRef B. Patle, S.-L. Chen, B. Patel, S.K. Kashyap, S. Sanap, Topological drone navigation in uncertain environment. Ind. Robot. 48(3), 423–441 (2021)CrossRef
5.
Zurück zum Zitat Y.-P. Huang, L. Sithole, T.-T. Lee, Structure from motion technique for scene detection using autonomous drone navigation. IEEE Trans. Syst. Man, Cyber. Syst. 49(12), 2559–2570 (2019)CrossRef Y.-P. Huang, L. Sithole, T.-T. Lee, Structure from motion technique for scene detection using autonomous drone navigation. IEEE Trans. Syst. Man, Cyber. Syst. 49(12), 2559–2570 (2019)CrossRef
6.
Zurück zum Zitat I. White, D. K. Borah, W. Tang, Robust optical spatial localization using a single image sensor. IEEE Sens. Lett. 3(6), 1–4 (2019), Art no. 7000904 I. White, D. K. Borah, W. Tang, Robust optical spatial localization using a single image sensor. IEEE Sens. Lett. 3(6), 1–4 (2019), Art no. 7000904
7.
Zurück zum Zitat B. Kaplan et al., Detection, identification, and direction of arrival estimation of drone FHSS signals with uniform linear antenna array. IEEE Access 9, 152057–152069 (2021)CrossRef B. Kaplan et al., Detection, identification, and direction of arrival estimation of drone FHSS signals with uniform linear antenna array. IEEE Access 9, 152057–152069 (2021)CrossRef
8.
Zurück zum Zitat N.J. Sairamya et al., Hybrid approach for classification of electroencephalographic signals using time–frequency images with wavelets and texture features, in Intelligent Data Analysis for Biomedical Applications (Academic Press, 2019), pp. 253–273 N.J. Sairamya et al., Hybrid approach for classification of electroencephalographic signals using time–frequency images with wavelets and texture features, in Intelligent Data Analysis for Biomedical Applications (Academic Press, 2019), pp. 253–273
9.
Zurück zum Zitat C. Lugaresi et al., Mediapipe: a framework for perceiving and processing reality, in Third Workshop on Computer Vision for AR/VR at IEEE Computer Vision and Pattern Recognition (CVPR), vol. 2019 (2019) C. Lugaresi et al., Mediapipe: a framework for perceiving and processing reality, in Third Workshop on Computer Vision for AR/VR at IEEE Computer Vision and Pattern Recognition (CVPR), vol. 2019 (2019)
11.
Zurück zum Zitat P. Luo, X. Zhang, Z. Chang, W. Liu, Research on salt and pepper noise removal method based on adaptive fuzzy median filter, in 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) (2021), pp. 387–392 P. Luo, X. Zhang, Z. Chang, W. Liu, Research on salt and pepper noise removal method based on adaptive fuzzy median filter, in 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC) (2021), pp. 387–392
12.
Zurück zum Zitat V. Bazarevsky, F. Zhang, On-device, real-time hand tracking with mediapipe. Google AI Blog (2019) V. Bazarevsky, F. Zhang, On-device, real-time hand tracking with mediapipe. Google AI Blog (2019)
Metadaten
Titel
Face Recognition and Hand Gesture Control for Tello Drone Navigation
verfasst von
Huy-Anh Bui
Anh-Tu Nguyen
Thanh-Hung Nguyen
Xuan-Thuan Nguyen
Copyright-Jahr
2024
DOI
https://doi.org/10.1007/978-3-031-57460-3_45