CN-122009233-A - Vehicle-mounted multi-mode navigation interaction method, system, equipment and storage medium

CN122009233ACN 122009233 ACN122009233 ACN 122009233ACN-122009233-A

Abstract

The application relates to the technical field of automobile control, in particular to a vehicle-mounted multi-mode navigation interaction method, a system, equipment and a storage medium. The vehicle-mounted multi-mode navigation system comprises a navigation prompt module, a safety early warning module, a head display module, a steering wheel touch feedback module and a controller, wherein the navigation prompt module is used for outputting a driving navigation prompt, the safety early warning module is used for outputting a driving safety early warning prompt, the head display module is used for projecting a navigation picture or a safety early warning picture on a vehicle window, the steering wheel touch feedback module is used for providing navigation prompt vibration feedback or safety early warning vibration feedback on a steering wheel, and the controller is used for adjusting working modes of the head display module and the steering wheel touch feedback module according to the driving navigation prompt and the driving safety early warning prompt. According to the embodiment of the application, by constructing the multi-mode navigation interaction system framework and integrating the vision and touch information transmission channels, the dependence on a central control screen of a driver is obviously reduced, the sight line transfer frequency is reduced, the distraction driving problem caused by the traditional navigation system is effectively relieved, and the driving safety is improved.

Inventors

LU YUXIN
LI LI
HU HUIHUI
LI DONGXUAN
HU JIANG

Assignees

东风汽车集团股份有限公司

Dates

Publication Date: 20260512
Application Date: 20260211

Claims (15)

1. A vehicle-mounted multi-modal navigation interactive system, characterized in that the vehicle-mounted multi-modal navigation interactive system comprises: The navigation prompt module is used for monitoring navigation information of the vehicle and outputting driving navigation prompts; the safety early warning module is used for monitoring the running safety state of the vehicle and outputting running safety early warning prompts; The head display module is used for projecting a navigation picture or a safety early warning picture on the car window; the steering wheel touch feedback module is used for providing navigation prompt vibration feedback or safety early warning vibration feedback on the steering wheel; and the controller is in signal connection with the head display module and the steering wheel touch feedback module, and is used for adjusting the working modes of the head display module and the steering wheel touch feedback module according to driving navigation prompts and driving safety early warning prompts.
2. The vehicle-mounted multi-modal navigation interactive system of claim 1, wherein the controller is configured to adjust the modes of operation of the head display module and the steering wheel haptic feedback module based on the driving navigation prompt and the driving safety pre-warning prompt, comprising: When the controller only receives the driving navigation prompt and does not receive the driving safety early warning prompt, the controller drives the head display module to project a navigation picture on the vehicle window according to the driving navigation prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding navigation prompt vibration feedback; When the controller receives the driving navigation prompt and the driving safety early warning prompt simultaneously, the controller drives the head display module to project a safety early warning picture on the vehicle window according to the safety early warning prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding safety early warning vibration feedback actions.
3. The vehicle-mounted multi-modal navigation interactive system of claim 1 wherein the steering wheel haptic feedback module includes at least 6 independently disposed linear vibration motors for embedding in the steering wheel, and the 6 linear vibration motors are disposed uniformly about a center point of the steering wheel.
4. The in-vehicle multi-modal navigation interactive system of claim 1 wherein the head-up module includes: the projection assembly comprises a light guide plate and an LED array, wherein the light guide plate is used for being matched with the LED array to project a picture onto a vehicle windshield; The eyeball tracking assembly is connected with the light guide plate through signals and is used for capturing the pupil position of a driver in real time and driving the light guide plate to adjust the refraction angle according to the pupil position of the driver.
5. The vehicle-mounted multi-modal navigation interactive system of claim 4 wherein the head display module further includes a stepper motor coupled to the light guide plate, the stepper motor for adjusting the angle of refraction of the light guide plate.
6. The vehicle-mounted multimodal navigation interactive system of claim 1, wherein the safety precaution module includes a lane departure precaution component.
7. A vehicle-mounted multi-modal navigation interaction method using the vehicle-mounted multi-modal navigation interaction system of claim 1, comprising: The navigation prompt module and the safety early warning module are used for respectively collecting driving navigation information and driving safety states; judging whether to output a driving navigation prompt and/or a driving safety early warning prompt according to the driving navigation information and the driving safety state; And driving the head display module and the steering wheel touch feedback module to act according to the driving navigation prompt and/or the driving safety early warning prompt received by the controller.
8. The vehicle-mounted multi-mode navigation interaction method according to claim 7, wherein the driving navigation prompt and/or driving safety early warning prompt received by the controller drive the head display module and the steering wheel touch feedback module to act, and the method comprises the following steps: When the controller only receives the driving navigation prompt and does not receive the driving safety early warning prompt, the controller drives the head display module to project a navigation picture on the vehicle window according to the driving navigation prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding navigation prompt vibration feedback; When the controller receives the driving navigation prompt and the driving safety early warning prompt simultaneously, the controller drives the head display module to project a safety early warning picture on the vehicle window according to the safety early warning prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding safety early warning vibration feedback actions.
9. The vehicle-mounted multi-modal navigation interaction method of claim 8, wherein the controller drives the head display module to project a safety precaution picture on a vehicle window according to the safety precaution prompt and synchronously drives the steering wheel touch feedback module to execute a corresponding safety precaution vibration feedback action, comprising: Classifying the current driving state according to the safety early warning prompt to obtain the current early warning grade; and driving the head display module to project a corresponding safety early warning picture on the windshield according to the current early warning level, and synchronously driving the steering wheel touch feedback module to execute safety early warning vibration feedback corresponding to the current early warning level.
10. The vehicle-mounted multi-modal navigation interaction method of claim 9, wherein classifying the current driving state according to the safety warning prompt to obtain the current warning level includes: Classifying the current early warning level into three early warning levels according to the safety early warning prompt, wherein, When the safety early warning prompts that a signal that the vehicle approaches a potential dangerous area appears, the current early warning level is divided into primary early warning; when the safety early warning prompts that a signal that the vehicle has a slight lane departure trend appears, the current early warning level is divided into a second early warning level; When the safety early warning prompts that the signal of the emergent collision of the vehicle is about to occur, the current early warning level is divided into three levels of early warning.
11. The vehicle-mounted multi-modal navigation interaction method of claim 10, wherein driving the head display module to project a corresponding safety precaution picture on the windshield according to the current precaution level and synchronously driving the steering wheel haptic feedback module to execute the safety precaution vibration feedback corresponding to the current precaution level comprises: When the current early warning level is the first-level early warning, driving the head display module to project yellow prompt information on the windshield, and synchronously driving the linear vibration motor of the steering wheel touch feedback module to vibrate at low frequency; When the current early warning level is three-level early warning, the head display module is driven to project red prompt information on the windshield, and the linear vibration motor of the steering wheel touch feedback module is synchronously driven to vibrate at high frequency.
12. The vehicle-mounted multi-modal navigation interaction method of claim 10, wherein the driving the head display module to project a corresponding safety precaution picture on the windshield according to the current precaution level and synchronously driving the steering wheel haptic feedback module to execute the safety precaution vibration feedback corresponding to the current precaution level further comprises: When the current early warning level is the second level early warning, the head display module is driven to project yellow prompt information on the windshield, and the steering wheel touch feedback module is synchronously driven to vibrate at the middle frequency by the linear vibration motor at one side of the deviation direction.
13. The method of claim 7, wherein the using the navigation prompt module and the safety warning module to collect the driving navigation information and the driving safety state respectively comprises using the lane departure warning module to monitor the lane departure trend.
14. A vehicle-mounted multi-modal navigation interaction device, characterized in that the vehicle-mounted multi-modal navigation interaction device comprises a processor, a memory, and a vehicle-mounted multi-modal navigation interaction program stored on the memory and executable by the processor, wherein the vehicle-mounted multi-modal navigation interaction program, when executed by the processor, implements the steps of the vehicle-mounted multi-modal navigation interaction method according to any of claims 7 to 13.
15. A computer readable storage medium, wherein a vehicle-mounted multi-modal navigation interactive program is stored on the computer readable storage medium, wherein the vehicle-mounted multi-modal navigation interactive program, when executed by a processor, implements the steps of the vehicle-mounted multi-modal navigation interactive method according to any one of claims 7 to 13.

Description

Vehicle-mounted multi-mode navigation interaction method, system, equipment and storage medium Technical Field The application relates to the technical field of automobile control, in particular to a vehicle-mounted multi-mode navigation interaction method, a system, equipment and a storage medium. Background With the rapid development of the intelligent technology of automobiles, navigation and automobile machine systems gradually become important influencing factors for users to select automobiles. The traditional vehicle navigation system mainly adopts a mode of combining a central control screen with voice broadcasting to provide navigation guidance for a driver. The system generally installs a central control screen at the position of a central control console of a vehicle, guides the running direction by displaying a map and arrow indication, and simultaneously carries out voice broadcasting in cooperation with a vehicle-mounted sound system to inform a driver of key information such as the running direction, the distance and the like. However, since the position of the center screen deviates from the normal vision range of the driver, the driver must frequently shift vision during driving, actively rotate the head and eyes to view screen information, resulting in continuous switching of vision between the road and the center screen. The frequent sight line transfer not only increases the cognitive load of the driver, but also obviously increases the risk of distracted driving, and is easy to cause traffic accidents, especially more obvious under high-speed driving or complex road conditions. In the related art, the AR-HUD system can project navigation information to the driver's front view, reducing the line of sight offset. Meanwhile, part of high-end vehicle models begin to adopt a touch feedback technology, and information is transmitted to a driver in a vibration mode. However, the visual and audible prompting modes are single, and a differential information transmission mechanism suitable for different driving scenes is lacked, so that under the condition of complex road conditions or loud environmental noise, a driver may ignore key prompts due to distraction, and important operations such as lane changing time and the like are missed. Disclosure of Invention Aiming at the related technology, the vehicle-mounted navigation system has single visual and auditory prompt modes, and lacks a differential multi-mode information transmission mechanism aiming at different driving scenes, so that a driver is easy to ignore key navigation prompts under the condition of complex road conditions or high environmental noise, thereby missing important driving operation opportunities such as lane change and the like. In a first aspect, an embodiment of the present application provides a vehicle-mounted multi-modal navigation interaction system, where the vehicle-mounted multi-modal navigation interaction system includes: The navigation prompt module is used for monitoring navigation information of the vehicle and outputting driving navigation prompts; the safety early warning module is used for monitoring the running safety state of the vehicle and outputting running safety early warning prompts; The head display module is used for projecting a navigation picture or a safety early warning picture on the car window; the steering wheel touch feedback module is used for providing navigation prompt vibration feedback or safety early warning vibration feedback on the steering wheel; And the controller is in signal connection with the head display module and the steering wheel touch feedback module, and is used for adjusting the working modes of the head display module and the steering wheel touch feedback module according to driving navigation prompts and driving safety early warning prompts. With reference to the first aspect, in an implementation manner, the controller is configured to adjust a working mode of the head display module and the steering wheel haptic feedback module according to a driving navigation prompt and a driving safety early warning prompt, and includes: When the controller only receives the driving navigation prompt and does not receive the driving safety early warning prompt, the controller drives the head display module to project a navigation picture on the vehicle window according to the driving navigation prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding navigation prompt vibration feedback; When the controller receives the driving navigation prompt and the driving safety early warning prompt simultaneously, the controller drives the head display module to project a safety early warning picture on the vehicle window according to the safety early warning prompt, and synchronously drives the steering wheel touch feedback module to execute corresponding safety early warning vibration feedback actions. With reference to the first aspect, in on