Head speak: Morse code Based Head Gesture to Speech Conversion Using Intel Realsense™ Technology
Rupam Das1, Kuderu B. ShivaKumar2
1Rupam Das, Department of, Electronics and Communication VTU, Belgaum
2Kuderu B. Shiva Kumar, Professor, Department of Telecommunication Engineering, Sri Siddhartha Institute of Technology, Tumkur.
Manuscript received on 21 March 2019 | Revised Manuscript received on 27 March 2019 | Manuscript published on 30 July 2019 | PP: 2866-2874 | Volume-8 Issue-2, July 2019 | Retrieval Number: B2140078219/19©BEIESP | DOI: 10.35940/ijrteB2140.078219
Open Access | Ethics and Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Advancement in technology has ensured better and more intuitive Human Computer Interaction (HCI). However, technological leap has not been able to bridge the gap for individuals with disability, particularly people with different impairments. Work has been done towards translating various sign languages and lip reading, but not much work is identified towards head gesture recognition and head gesture to speech conversion. Paralyzed patients, with ability to only move their head and eye find it rather difficult to communicate and interact with machines. This work presents a novel and efficient technique to map restricted head movements to text format using face and emotion detection capabilities of Intel RealSense SDK using Morse Code Mapping. The work maps UP and DOWN position of the head to DASH and DOT symbols of Morse code for an EYE_BLINK event trigger and SMILE emotion to convert the sequence of Morse symbols to an English character. The new language called HeadSpeak effectively reduces the pain for generating head gestures through 3D face position based gesture detection.The system can produce an average of 19 characters par minute, gesture error rate of .03% and average 4.5 words per minute.
Keywords: Intel RealSense™ Technology, Face Detection, Head Coupled Perspective, Morse Code.
Scope of the Article: Software Engineering Techniques and Production Perspectives