Detecting Driver Drowsiness in Real Time Through Deep Learning Based Object Detection

Shakeel, Muhammad Faique; Bajwa, Nabit; Anwaar, Ahmad Muhammad; Sohail, Anabia; Khan, Asifullah; Haroon-Ur-Rashid,

doi:10.1007/978-3-030-20521-8_24

Cited by 53 publications

(52 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These methods evaluate mainly three parameters: eye movements (eye blinking and eye closure activity) via eye-tracking, that was also investigated for usage in maritime operations and aviation [19][20][21], facial expressions (yawning, jaw drop, brow rise, and lip stretch), and head position (head scaling/nodding) [22]. In particular, many studies focused on the use of machine (deep) learning-based approaches [23][24][25][26][27]. Apart from research, numerous commercial products are available that rely on behavioral measures for drowsiness detection.…”

Section: Driver Drowsiness Measurement Technologiesmentioning

confidence: 99%

Assessment of the Potential of Wrist-Worn Wearable Sensors for Driver Drowsiness Detection

Kundinger

Sofra

Riener

2020

Sensors

View full text Add to dashboard Cite

Drowsy driving imposes a high safety risk. Current systems often use driving behavior parameters for driver drowsiness detection. The continuous driving automation reduces the availability of these parameters, therefore reducing the scope of such methods. Especially, techniques that include physiological measurements seem to be a promising alternative. However, in a dynamic environment such as driving, only non- or minimal intrusive methods are accepted, and vibrations from the roadbed could lead to degraded sensor technology. This work contributes to driver drowsiness detection with a machine learning approach applied solely to physiological data collected from a non-intrusive retrofittable system in the form of a wrist-worn wearable sensor. To check accuracy and feasibility, results are compared with reference data from a medical-grade ECG device. A user study with 30 participants in a high-fidelity driving simulator was conducted. Several machine learning algorithms for binary classification were applied in user-dependent and independent tests. Results provide evidence that the non-intrusive setting achieves a similar accuracy as compared to the medical-grade device, and high accuracies (>92%) could be achieved, especially in a user-dependent scenario. The proposed approach offers new possibilities for human–machine interaction in a car and especially for driver state monitoring in the field of automated driving.

show abstract

Section: Driver Drowsiness Measurement Technologiesmentioning

confidence: 99%

Assessment of the Potential of Wrist-Worn Wearable Sensors for Driver Drowsiness Detection

Kundinger

Sofra

Riener

2020

Sensors

View full text Add to dashboard Cite

show abstract

“…the applicability of CNN to low memory and time constraint applications[117]. Many real world applications such as autonomous vehicles, robotics, healthcare and mobile applications, perform the tasks that need to be carried on computationally limited…”

mentioning

confidence: 99%

A survey of the recent architectures of deep convolutional neural networks

et al. 2020

Self Cite

View full text Add to dashboard Cite

Deep Convolutional Neural Networks (CNNs) are a special type of Neural Networks, which have shown exemplary performance on several competitions related to Computer Vision and Image Processing. Interesting application areas of CNN include Image Classification and Segmentation, Object Detection, Video Processing, Natural Language Processing, Speech Recognition, etc. The powerful learning ability of deep CNN is largely due to the use of multiple feature extraction stages that can automatically learn representations from the data. Availability of a large amount of data and improvements in the hardware technology have accelerated the research in CNNs, and recently very interesting deep CNN architectures have been reported. In fact, several interesting ideas to bring advancements in CNNs have been explored such as the use of different activation and loss functions, parameter optimization, regularization, and architectural innovations. However, the major improvement in representational capacity of the deep CNN is achieved through architectural innovations. Especially, the idea of exploiting spatial and channel information, depth and width of architecture, and multi-path information processing has gained substantial attention. Similarly, the idea of using a block of layers as a structural unit is also gaining popularity. This survey thus focuses on the intrinsic taxonomy present in the recently reported deep CNN architectures and consequently, classifies the recent innovations in CNN architectures into seven different categories. These seven categories are based on spatial exploitation, depth, multi-path, width, feature-map exploitation, channel boosting, and attention. Additionally, the elementary understanding of CNN components, current challenges and applications of CNN are also provided. CNNs are the best among learning algorithms in understanding images content, and have shown exemplary results in segmentation, classification, detection, and retrieval related tasks [8], [9]. The success of CNNs has captured attention beyond academia. In industry, companies such as Google, Microsoft, AT&T, NEC, and Facebook have developed active research groups for exploring new architectures of CNN [10]. At present, most of the frontrunners of image processing and computer vision competitions are employing deep CNN based models.The attractive feature of CNN is its ability to exploit spatial or time correlation of the data. The topology of CNN is divided into multiple learning stages composed of a combination of the convolutional layers, non-linear processing units, and subsampling layers [11]. CNNs are feedforward multilayered hierarchical networks that are similar to fully connected neural network where each layer, using a bank of convolutional kernels, performs multiple transformations [12]. Convolution operation extracts useful features from locally correlated data points. Output of the convolutional kernels is assigned to non-linear processing unit (activation function), which not only helps in learning abstractions but also emb...

show abstract

“…The reviewed AmI literature is good evidence of that. Although the works specifically identified along those lines [64,68,69,[77][78][79]82,85,96,102,105,106] cover only a limited subset of the broad spectrum of applications resulting from the technological progress in the field, they provide good intuition on the relevance of object detection as a key factor for making both vehicles and infrastructures safer, more efficient, comfortable and reliable. In particular, in-vehicle ITS systems [64,[77][78][79]85,96,102,105,106] (commonly known as Advanced Driving Assistance Systems or ADAS) stand out in the analysis as the central focus of interest.…”

Section: On-device Object Detection For Context Awareness In Ambient Intelligence Systemsmentioning

confidence: 99%

On-Device Object Detection for More Efficient and Privacy-Compliant Visual Perception in Context-Aware Systems

2021

View full text Add to dashboard Cite

Ambient Intelligence (AmI) encompasses technological infrastructures capable of sensing data from environments and extracting high-level knowledge to detect or recognize users’ features and actions, as well as entities or events in their surroundings. Visual perception, particularly object detection, has become one of the most relevant enabling factors for this context-aware user-centered intelligence, being the cornerstone of relevant but complex tasks, such as object tracking or human action recognition. In this context, convolutional neural networks have proven to achieve state-of-the-art accuracy levels. However, they typically result in large and highly complex models that typically demand computation offloading onto remote cloud platforms. Such an approach has security- and latency-related limitations and may not be appropriate for some AmI use cases where the system response time must be as short as possible, and data privacy must be guaranteed. In the last few years, the on-device paradigm has emerged in response to those limitations, yielding more compact and efficient neural networks able to address inference directly on client machines, thus providing users with a smoother and better-tailored experience, with no need of sharing their data with an outsourced service. Framed in that novel paradigm, this work presents a review of the recent advances made along those lines in object detection, providing a comprehensive study of the most relevant lightweight CNN-based detection frameworks, discussing the most paradigmatic AmI domains where such an approach has been successfully applied, the different challenges arisen, the key strategies and techniques adopted to create visual solutions for image-based object classification and localization, as well as the most relevant factors to bear in mind when assessing or comparing those techniques, such as the evaluation metrics or the hardware setups used.

show abstract

Detecting Driver Drowsiness in Real Time Through Deep Learning Based Object Detection

Cited by 53 publications

References 18 publications

Assessment of the Potential of Wrist-Worn Wearable Sensors for Driver Drowsiness Detection

Assessment of the Potential of Wrist-Worn Wearable Sensors for Driver Drowsiness Detection

A survey of the recent architectures of deep convolutional neural networks

On-Device Object Detection for More Efficient and Privacy-Compliant Visual Perception in Context-Aware Systems

Contact Info

Product

Resources

About