Enhancing Driver Safety and Interaction: Real-Time Eye Blink and Head Nod Detection System Using Computer Vision

Abstract

Driver fatigue and drowsiness are major contributors to road accidents worldwide, especially in long-distance driving scenarios. Early detection of fatigue-related behaviors such as prolonged eye closure, frequent yawning, and head nodding can significantly reduce accident risks. This project presents a real-time driver monitoring system that leverages computer vision and machine learning techniques to detect eye blinks, yawning, and head nod movements using a webcam.The system is implemented using Python and integrates libraries such as OpenCV for image processing, dlib for facial landmark detection, and Tkinter for the graphical user interface. Facial landmarks are extracted using a pre-trained shape predictor model, enabling precise localization of key regions such as the eyes, mouth, and nose. The Eye Aspect Ratio (EAR) is computed to monitor eye closure, while the Mouth Aspect Ratio (MAR) is used to detect yawning. Additionally, head nod detection is achieved by tracking vertical movement of the nose landmark over time.The system continuously captures video frames from a webcam and processes them in real-time. If the EAR falls below a predefined threshold for a certain number of consecutive frames, the system identifies this as eye closure and triggers a sleepiness alert. Similarly, mouth opening beyond a threshold indicates yawning. Head nod detection is performed by comparing the initial and current positions of the nose, identifying downward movements that may indicate fatigue.A user-friendly graphical interface allows users to start monitoring and view system status. Alerts are displayed visually on the video feed, ensuring immediate feedback. The system is designed to operate efficiently on standard hardware without requiring specialized sensors, making it cost-effective and accessible.This approach offers a non-intrusive and real-time solution for driver monitoring. Compared to traditional systems that rely on physiological sensors, this vision-based method eliminates the need for wearable devices. The proposed system demonstrates reliable performance under controlled conditions and has the potential to be extended with audio alerts, cloud integration, and advanced deep learning models for improved accuracy.Overall, this project contributes to enhancing road safety by providing an intelligent, real-time monitoring system capable of detecting early signs of driver fatigue and prompting timely alerts.