US-12623598-B2 - Alert system and method to alert driver of vehicle

US12623598B2US 12623598 B2US12623598 B2US 12623598B2US-12623598-B2

Abstract

A system and method to alert a driver of a vehicle as a safety system for vehicle includes a force sensing resistor and a galvanic skin response sensor coupled to the steering wheel, and an alarm notification module. The alert system further includes a processing unit with a circuitry including instructions to receive initial conductance data and real-time conductance data from the galvanic skin response sensor, and real-time force data from the force sensing resistor; generate a mean data from the initial conductance data; apply an averaging filter to the real-time conductance data to generate filtered real-time conductance data; generate a first comparison between the real-time force data and a predefined threshold; generate a second comparison between the filtered real-time conductance data and the mean data; and activate the alarm notification module of the vehicle based on at least one of the first comparison and the second comparison.

Inventors

Abdul-Hakeem Hussein ALOMARI
Lola EL SAHMARANY
Abdul Hameed Sulaiman ALMOJIL
Haifa Ahmed KHALIFA
Shahad Hani Alomair
Doaa Mohammed Abu Aladas

Assignees

IMAM ABDULRAHMAN BIN FAISAL UNIVERSITY

Dates

Publication Date: 20260512
Application Date: 20240917

Claims (17)

1 . An alert system for a driver of a vehicle, comprising: a force sensing resistor attached to a steering wheel of the vehicle; a galvanic skin response sensor coupled to the steering wheel of the vehicle; an alarm notification module coupled to an interior console of the vehicle; and a processing unit coupled to the force sensing resistor and coupled to the galvanic skin response sensor, wherein the processing unit comprises a circuitry including instructions to: receive initial conductance data from the galvanic skin response sensor; generate a mean data from the initial conductance data and store the mean data in a memory coupled to the circuitry; receive real-time force data from the force sensing resistor; receive real-time conductance data from the galvanic skin response sensor; apply an averaging filter to the real-time conductance data to generate filtered real-time conductance data; generate a first comparison between the real-time force data and a predefined threshold stored in the memory; generate a second comparison between the filtered real-time conductance data and the mean data stored in the memory; and activate the alarm notification module of the vehicle based on at least one of the first comparison and the second comparison.
2 . The alert system of claim 1 , wherein the circuitry of the processing unit further includes instructions to activate the alarm notification module when real-time force data is less than the predefined threshold in the first comparison.
3 . The alert system of claim 1 , wherein the circuitry of the processing unit further includes instructions to activate the alarm notification module when a difference between the filtered real-time conductance data and the mean data is larger than a predefined difference value in the second comparison.
4 . The alert system of claim 1 , wherein the driver is in contact with the force sensing resistor and the galvanic skin response sensor.
5 . The alert system of claim 1 , wherein the galvanic skin response sensor is integrated into a pair of rings, wherein the pair of rings are attached to the steering wheel of the vehicle.
6 . The alert system of claim 5 , wherein the pair of rings is positioned to provide a contact with the driver's skin as the driver is in contact with the steering wheel.
7 . The alert system of claim 1 , wherein the galvanic skin response sensor is integrated into an internal circuitry of a smart watch.
8 . The alert system of claim 1 , wherein the alarm notification module comprises a sound producing element.
9 . The alert system of claim 8 , wherein the activation of the alarm notification module comprises generating an audible alarm from the sound producing element.
10 . The alert system of claim 1 , wherein each of the real-time force data corresponds to a force exerted by the driver on the steering wheel of the vehicle.
11 . The alert system of claim 1 , wherein each of the initial conductance data and the real-time conductance data measured by the galvanic skin response sensor corresponds to an electrical conductance of the driver's skin.
12 . A method to alert a driver of a vehicle, comprising: measuring initial conductance data through a galvanic skin response sensor in contact with the driver's skin; storing the initial conductance data in a processing unit coupled to the galvanic skin response sensor; generating and storing a mean data from the initial conductance data using the processing unit; measuring real-time force data corresponding to force exerted by the driver on a steering wheel of the vehicle through a force sensing resistor attached to the steering wheel of the vehicle; measuring real-time conductance data from the galvanic skin response sensor; applying an averaging filter to the real-time conductance data and generating filtered real-time conductance data using the processing unit; generating a first comparison between the real-time force data and a predefined threshold stored in the processing unit; generating a second comparison between the filtered real-time conductance data and the mean data stored in the processing unit; and activating an alarm notification module connected to the vehicle based on at least one of the first comparison and the second comparison.
13 . The method of claim 12 , wherein activating the alarm notification module based on the first comparison corresponds to real-time force data being less than the predefined threshold.
14 . The method of claim 12 , wherein activating the alarm notification module based on the second comparison corresponds to a difference between the filtered real-time conductance data and the mean data being larger than a predefined difference value.
15 . The method of claim 12 , wherein the galvanic skin response sensor is integrated into a pair of rings, wherein the pair of rings are coupled to the steering wheel of the vehicle.
16 . The method of claim 12 , wherein measuring each of the initial conductance data and the real-time conductance data using the galvanic skin response sensor corresponds to an electrical conductance of the driver's skin.
17 . The method of claim 12 , wherein an activation of the alarm notification module comprises generating an audible alarm from a sound producing element of the alarm notification module.

Description

STATEMENT OF ACKNOWLEDGEMENT Support provided by Traffic Safety Chair, Saudi Aramco, Dhahran, Saudi Arabia, through funding project #4034 is gratefully acknowledged. BACKGROUND Technical Field The present disclosure is directed to a vehicle safety system, and more specifically to a system and method for continuous or intermittent monitoring and alerting the driver of a vehicle based on physiological and physical data of the driver. Description of Related Art The “background” description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present invention. The development and implementation of safety systems for vehicles have been a focus in the automotive industry to address the high potential for accidents. Traditional safety systems for vehicles have predominantly revolved around passive safety features, such as seat belts and airbags, designed to protect occupants in the event of a crash. New technology in the automotive sector relating to safety systems such as Anti-lock Braking Systems (ABS) and Electronic Stability Control (ESC), works to actively prevent accidents. In recent years, the focus has shifted towards advanced driver-assistance systems (ADAS), which use a combination of technologies like sensors, cameras, and radar to monitor the vehicle's environment and assist the driver in navigating more safely. Despite these advancements, a critical aspect of vehicular safety remains, i.e., monitoring driver alertness and responsiveness to potentially hazardous situations. Most current systems lack the capability to effectively gauge the driver's physiological state, which is a key indicator of the driver's ability to react to road conditions and control the vehicle safely. Factors such as fatigue, drowsiness, and distraction significantly contribute to road accidents. Current technologies primarily focus on external factors and vehicle dynamics, often overlooking the human (driver) element. The failure to accurately monitor and respond to the driver's state can lead to delayed reactions or inappropriate responses from the vehicle's safety systems, resulting in accidents that could have been prevented. In response to the need for enhanced driver monitoring, some solutions have been developed. For instance, US 20160039424A1 describes a wearable device including a main body configured to be worn on a user's body, a sensing unit that senses a biological signal of a user, a storage unit for collecting log information, and a controller for setting a reference driving index. This device outputs feedback including the state of the user based on the biological signal sensed before and after getting in a vehicle. However, this publication does not mention integration of the safety system with the steering wheel of vehicle, nor does it utilize a force sensing resistor or a galvanic skin response sensor for real-time monitoring, focusing instead on wearable technology for sensing and logging biological signals. CN110403617A describes a system for monitoring the state of mind of a driver through skin electric signals and pressure distribution signals acquired at the driver's palm on the steering wheel. The system judges the driver's state of mind and provides mood-relieving adjustments. However, this publication does not utilize a force sensing resistor or a galvanic skin response sensor for real-time monitoring, focusing instead on the acquisition of skin electric signals and pressure distribution for mood and state of mind assessment. KR 20110069992A describes a system for drowsiness detection using an operator's driving patterns and handle grip pressure. The system includes a driving pattern detecting part, a handle grip pressure detection part, and a central control part for sensing sleepiness and controlling a warning device. However, this reference does not mention combining physiological data such as skin conductance with physical force data from a steering wheel, focusing instead on the operator's driving pattern and handle grip pressure for sleepiness detection. US 20030141978A1 describes a monitoring arrangement for detecting a sleeping driver using a load cell connected to electronic scales. This system establishes a baseline force value when the driver grasps the steering wheel and sounds an alarm if the grip falls below this value. However, this publication does not mention integration of a galvanic skin response sensor or processing real-time physiological and physical data to alert a driver of the vehicle, focusing instead on the detection of sleepiness through changes in steering wheel grip force. WIPO publication 1985000785A1 describes a method for monitoring attention by tracking volar skin