CN-121987201-A - Fatigue detection method, device, equipment and storage medium based on wearable equipment

Abstract

The application discloses a fatigue detection method, a device, equipment and a storage medium based on wearable equipment, which relate to the technical field of the wearable equipment and are applied to the wearable equipment, wherein the wearable equipment is provided with a first image acquisition device and a second image acquisition device; and when the current driving state is not the fatigue state, determining the current weather condition according to the external environment image acquired by the second image acquisition device, and detecting the fatigue state according to the current weather condition and the monitoring physiological index of the user to determine a fatigue detection result. Through the mode, accurate detection of the driving fatigue state through the wearable equipment is achieved, detection efficiency and accuracy of detection results are greatly improved, driving safety is guaranteed, and a driver is helped to establish good driving habits.

Inventors

• ZHUANG XIANGYANG
• LI YISONG

Assignees

• 歌尔科技有限公司

Dates

Publication Date

20260508

Application Date

20241101

Claims (10)

1. 1. The fatigue detection method based on the wearable device is characterized in that the fatigue detection method based on the wearable device is applied to the wearable device, the wearable device is provided with a first image acquisition device and a second image acquisition device, the first image acquisition device is used for acquiring facial images, and the second image acquisition device is used for acquiring external environment images, and the method comprises the following steps: analyzing the current facial image acquired by the first image acquisition device to determine the current driving state of the user; When the current driving state is not a fatigue state, determining a current weather condition according to the external environment image acquired by the second image acquisition device; and detecting the fatigue state according to the current weather condition and the monitored physiological index of the user, and determining a fatigue detection result.
2. 2. The method of claim 1, wherein the step of detecting the fatigue status based on the current weather conditions and the monitored physiological indicators of the user, and determining the fatigue detection result comprises: Determining external light intensity and weather type according to the current weather conditions; Determining a weather severity according to the external light intensity and the weather type; And when the monitoring physiological index of the user meets the fatigue judgment condition corresponding to the severe weather degree, determining that the fatigue detection result is a fatigue driving result.
3. 3. The method of claim 2, wherein the fatigue determination condition comprises at least one of: the blink frequency of the user in the monitored physiological index is smaller than a blink frequency threshold value; The user watching time length in the monitoring physiological index is larger than a watching time length threshold value; The operation response time in the monitoring physiological index is longer than a response time threshold; The monitored heart rate in the monitored physiological index is not in the target heart rate range.
4. 4. The method of claim 3, wherein before the step of determining that the fatigue detection result is the fatigue driving result when the monitored physiological index of the user satisfies the fatigue determination condition corresponding to the weather severity, further comprising: the first image acquisition device acquires a plurality of continuous facial images to be positioned, and a user eye area corresponding to each facial image is determined; and analyzing the eye areas of the user corresponding to the face images, and determining the blink frequency and the gazing duration of the user.
5. 5. The method of claim 3, wherein the wearable device further comprises a heart rate sensor for acquiring user heart rate data; and before the step of determining that the fatigue detection result is the fatigue driving result when the monitored physiological index of the user meets the fatigue judgment condition corresponding to the severe weather degree, the method further comprises the following steps: acquiring user heart rate data acquired by the heart rate sensor; performing signal processing on the heart rate data of the user to obtain a processed heart rate signal; performing peak detection on the processed heart rate signal to obtain a plurality of monitoring peaks; a monitored heart rate of the user is determined from the plurality of monitored peaks.
6. 6. The method of claim 3, wherein before the step of determining that the fatigue detection result is the fatigue driving result when the monitored physiological index of the user satisfies the fatigue determination condition corresponding to the weather severity, further comprising: performing environmental analysis according to the external environment image to determine the driving road environment; When a driving change event exists in the driving road environment, acquiring the image acquisition time of the external environment image; acquiring a user response time corresponding to the driving change event; and determining operation response time according to the user response time and the image acquisition time.
7. 7. The method of any one of claims 1 to 6, wherein the step of analyzing the current face image acquired by the first image acquisition device to determine the current driving state of the user includes: Acquiring sample face images and sample fatigue labels of the sample face images in various driving weather environments; extracting the characteristics of each sample face image and determining the sample characteristics of each sample face image; training a machine learning model through sample features of a plurality of sample face images and sample fatigue labels of the sample face images to obtain a state recognition model; And inputting the current facial image acquired by the first image acquisition device into the state identification model to obtain the current driving state of the user.
8. 8. Fatigue detection device based on wearable equipment, characterized in that, the fatigue detection device based on wearable equipment includes: The analysis module is used for analyzing the current facial image acquired by the first image acquisition device and determining the current driving state of the user; The processing module is used for determining the current weather condition according to the external environment image acquired by the second image acquisition device when the current driving state is not a fatigue state; and the detection module is used for detecting the fatigue state according to the current weather condition and the monitored physiological index of the user and determining a fatigue detection result.
9. 9. A wearable device comprising a memory, a processor, and a wearable device-based fatigue detection program stored on the memory and executable on the processor, the wearable device-based fatigue detection program configured to implement the wearable device-based fatigue detection method of any of claims 1-7.
10. 10. A storage medium having stored thereon a wearable device-based fatigue detection program that, when executed by a processor, implements the wearable device-based fatigue detection method of any of claims 1-7.

Description

Fatigue detection method, device, equipment and storage medium based on wearable equipment Technical Field The application relates to the technical field of wearable equipment, in particular to a fatigue detection method, device, equipment and storage medium based on the wearable equipment. Background With the development of wearable devices, such as VR (Virtual Reality) devices, AR (Augmented Reality) devices, wearable devices may appear in multiple scenes in life, improving the quality of life of users from many aspects. At present, the wearable device can be used for detecting whether a driver has fatigue driving or not, wherein the detection mode is to detect driving states of other drivers through a state evaluation model obtained through training of one driver, the detection accuracy is low, or a separate evaluation model is trained for each driver, and the detection efficiency is low. Therefore, when the wearable device is used for detecting the driving fatigue state at present, the detection accuracy and the detection efficiency cannot be considered. The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present application and is not intended to represent an admission that the foregoing is prior art. Disclosure of Invention The application mainly aims to provide a fatigue detection method, device, equipment and storage medium based on wearable equipment, and aims to solve the technical problem that the detection accuracy and the detection efficiency cannot be considered when the wearable equipment is utilized to detect the driving fatigue state in the prior art. In order to achieve the above object, the present application provides a fatigue detection method based on a wearable device, the fatigue detection method based on a wearable device being applied to a wearable device, the wearable device being provided with a first image acquisition device and a second image acquisition device, the first image acquisition device being used for acquiring a facial image, the second image acquisition device being used for acquiring an external environment image, the method comprising: analyzing the face image acquired by the first image acquisition device to determine the current driving state of the user; When the current driving state is not a fatigue state, determining a current weather condition according to the external environment image acquired by the second image acquisition device; and detecting the fatigue state according to the current weather condition and the monitored physiological index of the user, and determining a fatigue detection result. In an embodiment, the step of detecting the fatigue state according to the current weather condition and the monitored physiological index of the user, and determining the fatigue detection result includes: Determining external light intensity and weather type according to the current weather conditions; Determining a weather severity according to the external light intensity and the weather type; And when the monitoring physiological index of the user meets the fatigue judgment condition corresponding to the severe weather degree, determining that the fatigue detection result is a fatigue driving result. In an embodiment, the fatigue determination condition includes at least one of: the blink frequency of the user in the monitored physiological index is smaller than a blink frequency threshold value; The user watching time length in the monitoring physiological index is larger than a watching time length threshold value; The operation response time in the monitoring physiological index is longer than a response time threshold; The monitored heart rate in the monitored physiological index is not in the target heart rate range. In an embodiment, before the step of determining that the fatigue detection result is the fatigue driving result when the monitored physiological index of the user meets the fatigue judgment condition corresponding to the severe weather level, the method further includes: the first image acquisition device acquires a plurality of continuous facial images to be positioned, and a user eye area corresponding to each facial image is determined; and analyzing the eye areas of the user corresponding to the face images, and determining the blink frequency and the gazing duration of the user. In an embodiment, the wearable device further comprises a heart rate sensor for acquiring user heart rate data; and before the step of determining that the fatigue detection result is the fatigue driving result when the monitored physiological index of the user meets the fatigue judgment condition corresponding to the severe weather degree, the method further comprises the following steps: acquiring user heart rate data acquired by the heart rate sensor; performing signal processing on the heart rate data of the user to obtain a processed heart rate signal; performing peak detection on the process