A hand gesture recognition to control wheelchair to help People with special needs

Authors

  • Zawaina AL-Dughishi Middle East College
  • Dr. Nizar AL-Bassam Middle East College

Keywords:

Machine Learning

Abstract

 Accelerometer sensor to take several different readings to obtain a quantity of information until the machine recognizes the various movements by defining the X, Y, and Z coordinates. Collects information about the location of X, Y, and Z coordinates during the movement. Accelerometer sensors convert motion into electrical signal so, signal be suitable for measure. The sensor makes several movements so, that Edge Impulses can recognize it. The motion must be repeated several times so, Edge Impulse can recognize it. Every two minutes we repeat the movement. The more attempts which do it more exact results we get. All the data which measure by Accelerometer sensor be store it in Edge impulse. In Edge Impulse there are a lot of steps I should go through it. Data acquisition use to collect data. Then create impulse by add processing block choose spectrogram. Next, adding Learning block then choose Neural Network (Keras). It can generate feature by select MFCC. It will show 3D shape with different colour for x, y, and z. NN classifier use to training output. It is showing percentage of accuracy. In Model testing show green colour if identify colour if it is unknown will be shown orang colour. Last one is  Deployment. It used to build on device model. After the machine recognizes several movements, so can build model. Then program it by using a microcontroller to do three different action.The importance of this project lies in the use of machine learning to identify hand movement.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References or Bibliography

Bielefeldt, K.,( 2021). What I should be aware before I touch my Arduino?. [online] Arduino Stack Exchange. Available at: https://arduino.stackexchange.com/questions/143/what-i-should-be-aware-before-i-touch-my-arduino> [ 11 June 2021].

Components101. (2020). L298N Motor Driver Module Pinout, Datasheet, Features & Specs. [online] Available at: https://components101.com/modules/l293n-motor-driver-module> [8 May 2021].

Daniele Bibbo, (2020). [online] A fusion Recognition Method Based on Multifeature Hidden Markov Model for Dynamic Hand Gesture. Available at: https://www.hindawi.com/journals/cin/2020/8871605/#introduction> [3 January 2021].

Published

06-01-2022

How to Cite

AL-Dughishi, Z., & AL-Bassam, N. (2022). A hand gesture recognition to control wheelchair to help People with special needs. Journal of Student Research. Retrieved from https://www.jsr.org/index.php/path/article/view/1582