US-12625547-B2 - Displaying in-vehicle messaging and activating vehicle functions based on driver gaze direction

US12625547B2US 12625547 B2US12625547 B2US 12625547B2US-12625547-B2

Abstract

A system for controlling a vehicle operation based on a driver gaze direction includes a plurality of sensors and an electronic processor. The electronic processor is configured to determine a gaze direction of a driver using the plurality of sensors and selectively activating a vehicle function based on the gaze direction.

Inventors

John Nowinski
Troy A. McCormick
Tyler Warga
Suman YELATI
Dhanabal Arunachalam

Assignees

ROBERT BOSCH GMBH

Dates

Publication Date: 20260512
Application Date: 20240228

Claims (10)

1 . A system for controlling a vehicle operation based on a driver gaze direction, the system comprising: a plurality of sensors; and an electronic processor, the electronic processor configured to: determine a gaze direction of a driver using the plurality of sensors; determine a gaze zone of the driver based on the gaze direction; detect a vehicle hazard; activate a warning indicator associated with the vehicle hazard, wherein the warning indicator includes a normal display mode and an augmented display mode; determine a gaze zone in which the warning indicator is actively displayed; compare the gaze zone of the driver to the gaze zone in which the warning indicator is actively displayed; activate the normal display mode in response to determining that the gaze zone of the driver is in the same gaze zone as the gaze zone in which the warning indicator is actively displayed; and activate the augmented display mode in response to determining that the gaze zone of the driver is in a different gaze zone than the gaze zone in which the warning indicator is actively displayed.
2 . The system of claim 1 , wherein the electronic processor is configured to: determine when the gaze direction of the driver is moved to the same gaze zone as the gaze zone in which the warning indicator is actively displayed.
3 . The system of claim 1 , wherein the electronic processor is configured to: de-activate the augmented display mode when the gaze direction of the driver is moved to the same gaze zone as the gaze zone in which the warning indicator is actively displayed.
4 . The system of claim 1 , wherein the electronic processor is configured to: determine when the gaze direction is moved to an activation zone, the activation zone being associated with a functional feature of the vehicle; and determine when a gaze duration exceeds an activation duration.
5 . The system of claim 4 , wherein the electronic processor is configured to: activate a function associated with the activation zone.
6 . The system of claim 5 , wherein the electronic processor is configured to: determine when the gaze direction is moved away from the activation zone; and determine when a gaze duration exceeds a de-activation duration.
7 . The system of claim 6 , wherein the electronic processor is configured to: de-activate the function associated with the activation zone when the gaze duration exceeds the de-activation duration.
8 . The system of claim 1 , wherein the vehicle hazard is detected using vehicle sensors.
9 . The system of claim 1 , wherein the vehicle hazard is an external hazard to the vehicle.
10 . The system of claim 1 , wherein the electronic processor is further configured to: divide the vehicle into a plurality of gaze zones; determine which of the plurality of gaze zones includes the warning indicator; and determine which of the plurality of gaze zones is in the gaze direction of the driver.

Description

SUMMARY Modern vehicles include various human machine interfaces (HMIs) to communicate data to and, in some cases, receive inputs from vehicle drivers and occupants. Examples of HMIs include head units, instrument clusters, head-up displays (HUDs), and mirrors with lighting or other display components (rear view and side view). In some instances, HMIs include touch control, voice control, and haptic feedback. HMIs provide vehicle information to drivers and passengers, such as, vehicle speed, internal vehicle warnings (e.g., low fuel), external vehicle warnings (e.g., occupied blind spot, pedestrians nearby), map information, directions, music information, and other information. In some instances, all or a combination of these features are included in a vehicle and or vehicle system, for example, an advanced driver assistance system. One example implementation provides a system for controlling a vehicle operation based on a driver gaze direction and the system includes a plurality of sensors and an electronic processor. The electronic processor is configured to determine a gaze direction of a driver using the plurality of sensors and selectively activating a vehicle function based on the gaze direction. The electronic processor is further configured to detect a vehicle hazard and activate a warning indicator associated with the vehicle hazard. The warning indicator includes a normal display mode and an augmented display mode. The electronic processor is further configured to activate the normal display mode when the gaze direction is in a same gaze zone as the warning indicator. The electronic processor is further configured to activate the augmented display mode when the gaze direction is in a different gaze zone than the warning indicator. The electronic processor is further configured to determine when the gaze direction is moved to the same gaze zone as the warning indicator. The electronic processor is further configured to de-activate the augmented display mode when the gaze direction is moved to the same gaze zone as the warning indicator. The electronic processor is further configured to determine when the gaze direction is moved to an activation zone and determine when a gaze duration exceeds an activation duration. The electronic processor is further configured to activate a function associated with the activation zone. The electronic processor is further configured to determine when the gaze direction is moved away from the activation zone and determine when a gaze duration exceeds a de-activation duration. The electronic processor is further configured to de-activate the function associated with the activation zone when the gaze duration exceeds the de-activation duration. Another example implementation provides a system for controlling a vehicle operation based on a driver gaze direction and the system includes a plurality of sensors and an electronic processor. The electronic processor is configured to determine a gaze direction of a driver using the plurality of sensors, detect a vehicle hazard, and activate a warning indicator associated with the vehicle hazard, wherein the warning indicator includes a normal display mode and an augmented display mode. The electronic processor is further configured to activate the normal display mode when the gaze direction is in a same gaze zone as the warning indicator. The electronic processor is further configured to activate the augmented display mode when the gaze direction is in a different gaze zone than the warning indicator. The augmented display mode includes an increased size of the warning indicator, an increased brightness of the warning indicator, a color change of the warning indicator, an additional indicator around or adjacent the warning indicator, or any combination thereof. The electronic processor is further configured to determine when the gaze direction is moved to the same gaze zone as the warning indicator. The electronic processor is further configured to de-activate the augmented display mode when the gaze direction is moved to the same gaze zone as the warning indicator. Still another example implementation provides a system for controlling a vehicle operation based on a driver gaze direction and the system includes a plurality of sensors and an electronic processor. The electronic processor configured to determine a gaze direction of a driver using the plurality of sensors, determine when the gaze direction is moved to an activation zone, and activate a function associated with the activation zone. The electronic processor is further configured to determine when a gaze duration exceeds an activation duration before activating the function associated with the activation zone. The electronic processor is further configured to determine when the gaze direction is moved away from the activation zone. The electronic processor is further configured to determine when a gaze duration exceeds a de-activation duration and de-activate the f