- Balkan Journal of Electrical and Computer Engineering
- Vol: 7 Issue: 2
- Lip Reading Using Convolutional Neural Networks with and without Pre-Trained Models
Lip Reading Using Convolutional Neural Networks with and without Pre-Trained Models
Authors : Tayyip Ozcan, Alper Basturk
Pages : 195-201
Doi:10.17694/bajece.479891
View : 15 | Download : 9
Publication Date : 2019-04-30
Article Type : Research
Abstract :Lip reading has become a popular topic recently. There is a widespread literature studies on lip reading in human action recognition. Deep learning methods are frequently used in this area. In this paper, lip reading from video data is performed using self designed convolutional neural networks (CNNs). For this purpose, standard and also augmented AvLetters dataset is used train and test stages. To optimize network performance, minibatchsize parameter is also tuned and its effect is investigated. Additionally, experimental studies are performed using AlexNet and GoogleNet pre-trained CNNs. Detailed experimental results are presented.Keywords : deep learning, convolutional neural networks, lip reading, transfer learning, human action recognition, human computer interaction, data augmentation