CN-121989683-A - Driver visual field vision compensation method, device, equipment and storage medium

CN121989683ACN 121989683 ACN121989683 ACN 121989683ACN-121989683-A

Abstract

The application discloses a driver visual field vision compensation method, a device, equipment and a storage medium, which relate to the technical field of vision compensation and comprise the steps of detecting a high beam light source of a facing vehicle according to multi-mode sensing data; when the intensity of the high beam light source is detected to be larger than a preset threshold value, a high beam glare area is determined according to the high beam light source, shielding information of the high beam glare area is determined based on the multi-mode sensing data, and an augmented reality image is projected on a windshield according to the shielding information so as to complete visual field visual compensation of a driver. The scheme can actively compensate the front road condition visual information lost by the driver when the vehicle meeting encounters the high beam glare at night.

Inventors

YANG SHIGANG
LAN QIULING
ZHANG JINZHOU
JIANG WENHAI
Yan Rungang
LI YANG
SHI CONG
QIN HAOXIANG
SU HAIYUAN
WU LIUYI
MENG YUZHEN
SHEN GUODONG

Assignees

东风柳州汽车有限公司

Dates

Publication Date: 20260508
Application Date: 20260304

Claims (10)

1. A driver visual field vision compensation method, characterized in that the driver visual field vision compensation method comprises: detecting a high beam light source of an opposite vehicle according to multi-mode sensing data; when the intensity of the high beam light source is detected to be larger than a preset threshold value, determining a high beam glare area according to the high beam light source; Determining shading information of the high beam glare area based on the multi-mode sensing data; and projecting an augmented reality image on the windshield according to the shielding information so as to complete visual field visual compensation of the driver.
2. The method of claim 1, wherein the multi-modal sensing data obtains high dynamic range image data, infrared image data, and radar point cloud data; The step of determining the shielding information of the high beam glare area based on the multi-mode sensing data comprises the following steps: Determining three-dimensional structure information of the high beam glare area and spatial position relation information of a target object according to the radar point cloud data; Determining boundary information of the high-beam glare area and visible texture feature information adjacent to the high-beam glare area according to the high-dynamic-range image data; Determining thermal characteristic contour information and target object candidate region information in the high beam glare region according to the infrared image data; And determining shielding information of the high beam glare area based on the three-dimensional structure information, the target object spatial position relation information, the boundary information, the visible texture feature information, the thermal feature contour information and the target object candidate area information.
3. The method of claim 2, wherein the step of determining the masking information of the high beam glare region based on the three-dimensional structure information, target object spatial position relationship information, boundary information, visible texture feature information, thermal feature profile information, and target object candidate region information comprises: Carrying out fusion judgment on the candidate region information of the target object according to the three-dimensional structure information, the visible texture feature information and the thermal feature contour information to obtain obstacle contour information; geometric deduction is carried out according to the three-dimensional structure information, the boundary information and the visible texture characteristic information to obtain lane line information and curb information; And obtaining shielding information of the high beam glare area based on the obstacle contour information, the lane line information and the curb information.
4. The method of claim 1, wherein the step of projecting an augmented reality image on a windshield based on the masking information to accomplish visual compensation of the driver's field of view comprises: determining an original object to be compensated and a corresponding spatial position according to the shielding information; generating virtual compensation information according to the category of the original object and the space position; Determining world coordinate information of the virtual compensation information according to the vehicle posture information and the vehicle position information; and projecting an augmented reality image on a windshield based on the world coordinate information and the virtual compensation information to complete visual field compensation of the driver.
5. The method of claim 4, wherein the step of projecting an augmented reality image on a windshield based on the world coordinate information and the virtual compensation information to complete visual compensation of the driver's field of view comprises: Acquiring eyeball tracking information of a driver; Determining display coordinate information of the virtual compensation information according to the eyeball tracking information; determining virtual-real registration information based on the world coordinate information and the display coordinate information; and projecting an augmented reality image on the windshield according to the virtual-real registration information so as to complete visual field visual compensation of the driver.
6. The method of claim 5, wherein the step of projecting an augmented reality image on a windshield based on the virtual-real registration information to accomplish driver visual field visual compensation comprises: determining a projection area of the augmented reality image on the windshield according to the virtual-real registration information; Determining projection brightness control information, projection color control information and projection depth control information according to the projection area and the high beam glare area to obtain projection control information; and driving a projection display component to project an augmented reality image at a windshield position corresponding to the projection area information according to the projection control information so as to complete visual field visual compensation of a driver.
7. The method of claim 6, wherein after the step of projecting an augmented reality image on the windshield based on the masking information to complete visual compensation of the driver's field of view, further comprising: Determining dynamic change information of the high beam glare area according to the opposite vehicle movement information; updating the projection control information according to the dynamic change information, and returning to the step of driving a projection display assembly to project an augmented reality image at a windshield position corresponding to the projection area information according to the projection control information; upon detection of glare relief, the augmented reality image is controlled to fade.
8. A driver vision field vision compensation device, the device comprising: The data processing module is used for detecting a high beam light source of the opposite vehicle according to the multi-mode sensing data; The glare identification module is used for determining a high beam glare area according to the high beam light source when the intensity of the high beam light source is detected to be larger than a preset threshold value; The information extraction module is used for determining shielding information of the high beam glare area based on the multi-mode sensing data; and the vision compensation module is used for projecting an augmented reality image on the windshield according to the shielding information so as to complete vision compensation of the driver's vision.
9. Driver visual field visual compensation apparatus, characterized in that the apparatus comprises a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the driver visual field visual compensation method according to any one of claims 1 to 7.
10. A storage medium, characterized in that the storage medium is a computer-readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the driver visual field vision compensation method according to any one of claims 1 to 7.

Description

Driver visual field vision compensation method, device, equipment and storage medium Technical Field The present application relates to the field of vision compensation technology, and in particular, to a method, apparatus, device, and storage medium for driver vision compensation. Background When meeting at night, the strong glare to the high beam of the vehicle is harmful, not only in that the light is glaring, but also in that a large-area light saturation area is formed on the retina of a driver, so that key visual information (such as lane lines, pedestrian outlines and barriers) cannot be recognized due to submerged, and the driving safety at night is influenced. At present, the existing scheme mainly solves the problem of glare of a high beam of a vehicle by reducing or blocking strong light from entering eyes of a driver, such as adopting devices of an automatic dimming rearview mirror, a manual sun shield and the like to physically shield strong light in a specific direction, or avoiding direct irradiation of strong light by means of a mode of transferring vision and the like by means of passive response of the driver, or carrying out non-selective dimming on all light entering a visual field by being provided with accessories such as global dimming glasses, vehicle window anti-dazzle coating and the like. However, the existing scheme mainly optimizes around a light input link, can only realize shielding or weakening of strong light, cannot recover key visual information submerged due to the fact that the strong light forms a light saturation region on the retina of a driver, and when road condition details such as lane lines, pedestrians, obstacles and the like are covered by high beam light spots, simple light adjustment cannot enable the information to be reproduced, so that the driver is still in a dangerous state with visual field information loss. Therefore, how to actively compensate the front road condition visual information lost by the driver when meeting vehicles at night and encountering high beam glare is a technical problem to be solved. The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present application and is not intended to represent an admission that the foregoing is prior art. Disclosure of Invention The application mainly aims to provide a visual field vision compensation method, device and equipment for a driver and a storage medium, and aims to solve the technical problem of actively compensating front road condition visual information lost by the driver when a vehicle meeting encounters high beam glare at night. In order to achieve the above object, the present application proposes a driver visual field vision compensation method including: detecting a high beam light source of an opposite vehicle according to multi-mode sensing data; when the intensity of the high beam light source is detected to be larger than a preset threshold value, determining a high beam glare area according to the high beam light source; Determining shading information of the high beam glare area based on the multi-mode sensing data; and projecting an augmented reality image on the windshield according to the shielding information so as to complete visual field visual compensation of the driver. In an embodiment, the multi-modal sensing data obtains high dynamic range image data, infrared image data, and radar point cloud data; The step of determining the shielding information of the high beam glare area based on the multi-mode sensing data comprises the following steps: Determining three-dimensional structure information of the high beam glare area and spatial position relation information of a target object according to the radar point cloud data; Determining boundary information of the high-beam glare area and visible texture feature information adjacent to the high-beam glare area according to the high-dynamic-range image data; Determining thermal characteristic contour information and target object candidate region information in the high beam glare region according to the infrared image data; And determining shielding information of the high beam glare area based on the three-dimensional structure information, the target object spatial position relation information, the boundary information, the visible texture feature information, the thermal feature contour information and the target object candidate area information. In an embodiment, the step of determining the masking information of the high beam glare area based on the three-dimensional structure information, the target object spatial position relationship information, the boundary information, the visible texture feature information, the thermal feature profile information, and the target object candidate area information includes: Carrying out fusion judgment on the candidate region information of the target object according to the three-dimensional structure information, t