Affiliations:
Department of Computer Science, Indian Institute of Information Technology and Management-Kerala, IIITMK Building, P.O. Karyavattom, Technopark Campus, Kazhakkoottam, Trivandrum, Kerala, India
Correspondence:
[*]
Corresponding author. Vineetha Vijayan, Department of Computer Science, Indian Institute of Information Technology and Management-Kerala, IIITMK Building,
P.O. Karyavattom, Technopark Campus, Kazhakkoottam, Trivandrum, 695581, Kerala, India. Tel.: +91 9961533392; E-mail: [email protected].
Abstract: One of the major issues of road accidents all over the world is drowsiness state of the driver. It is a complex phenomenon to measure a driver’s consciousness in a direct manner. This work proposes with three deep neural architecture for learning facial features which consists of 68 attributes from the RGB video input of a driver. The experimentation is conducted by three different CNN models such as ResNet50, VGG16 and InceptionV3. These three networks are combined for representation learning which then put together the features to form a feature fused architecture(FFA). The trained features as well as facial movements such as eye blinking, yawning and head swaying are again trained with a softmax classifier to classify the drowsiness state of driver. Out of the three networks and FFA, InceptionV3 shows 78% accuracy.
Keywords: Convolutional neural networks, drowsiness, deep
learning
