Publication: Recognition of Radar-Based Deaf Sign Language Using Convolution Neural Network
Date
2023
Authors
Malik M.D.H.D.
Mansor W.
Rashid N.E.A.
Rahman M.Z.U.
Journal Title
Journal ISSN
Volume Title
Publisher
Penerbit UTHM
Abstract
The difficulties in the communication between the deaf and normal people through sign language can be overcome by implementing deep learning in the gestures signal recognition. The use of the Convolution Neural Network (CNN) in distinguishing radar-based gesture signals of deaf sign language has not been investigated. This paper describes the recognition of gestures of deaf sign language using radar and CNN. Six gestures of deaf sign language were acquired from normal subjects using a radar system and processed. Short-time Fourier Transform was performed to extract the gestures features and the classification was performed using CNN. The performance of CNN was examined using two types of inputs
segmented and non-segmented spectrograms. The accuracy of recognising the gestures is higher (92.31%) using the non-segmented spectrograms compared to the segmented spectrogram. The radar-based deaf sign language could be recognised accurately using CNN without segmentation. � Universiti Tun Hussein Onn Malaysia Publisher�s Office
segmented and non-segmented spectrograms. The accuracy of recognising the gestures is higher (92.31%) using the non-segmented spectrograms compared to the segmented spectrogram. The radar-based deaf sign language could be recognised accurately using CNN without segmentation. � Universiti Tun Hussein Onn Malaysia Publisher�s Office
Description
Keywords
classification , deep learning , gestures , Radar , Short-Time Fourier Transform (STFT)