US-12625661-B2 - Display control system, method, and computer-readable storage medium

US12625661B2US 12625661 B2US12625661 B2US 12625661B2US-12625661-B2

Abstract

A display control system for a moving body, the display control system comprising an audio source device configured to give audio guidance about the moving body; a display device capable of displaying information indicating an external environment in surroundings of the moving body, and a control device, wherein the control device processes audio information of the audio guidance to be output by the audio source device, and acquires a signal waveform of the audio information, and controls the display device for a display mode to be output by the display device in synchronization with the acquired signal waveform.

Inventors

Masaki Maruyama
Haruko Okuyama
Tatsuya Iwasa
Tsuyoshi NOJIRI

Assignees

HONDA MOTOR CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20241001
Priority Date: 20231006

Claims (19)

1 . A display control system for a moving body, the display control system comprising: an audio source device configured to give audio guidance about the moving body; a display device capable of displaying information indicating an external environment in surroundings of the moving body; and a control device, wherein the control device processes audio information of the audio guidance to be output by the audio source device, and acquires a signal waveform of the audio information, and controls the display device for a display mode to be output by the display device in synchronization with the acquired signal waveform, and the control device synchronizes the display mode to be output by the display device with a timing when volume of the audio information becomes equal to or smaller than a reference, based on the acquired signal waveform.
2 . The display control system according to claim 1 , wherein the synchronization of the display mode to be output by the display device includes at least one of a change in luminance of a display, a change in color of the display, a change in shape of the display, a change in size of the display, a swing of the display, and another display that accompanies the display.
3 . The display control system according to claim 1 , wherein the control device performs filtering processing to process the audio information.
4 . The display control system according to claim 1 , wherein the control device controls the display device for the display mode to be output by the display device in synchronization with a signal value in the acquired signal waveform.
5 . The display control system according to claim 1 , wherein the control device synchronizes the display mode to be output by the display device with a temporal change in volume of the audio information, based on the acquired signal waveform.
6 . The display control system according to claim 1 , wherein the control device delays a start timing of the synchronization by a predetermined period of time from a start timing of the audio guidance to be output by the audio source device.
7 . The display control system according to claim 1 , wherein the display device is disposed to extend a display range in a left-and-right direction, a first element is defined as an element in the external environment to be displayed on the display device, and in a case where position information indicating a relative position of the first element with respect to the moving body is able to be displayed within the display range that extends in the left-and-right direction, the control device controls the display device to display the position information of the first element in a first mode at a position corresponding to the first element in the display range.
8 . The display control system according to claim 7 , wherein in a case where the position information indicating the relative position of the first element is unable to be displayed within the display range that extends in the left-and-right direction, the control device controls the display device to display the position information of the first element in a second mode different from the first mode at one of both end portions of the display range to correspond to the position of the first element.
9 . The display control system according to claim 1 , wherein the control device sets a priority for an element in the external environment to be displayed on the display device, and changes a display mode corresponding to the element, in a case where the priority satisfies a reference.
10 . The display control system according to claim 9 , wherein at least two elements in the external environment are to be displayed on the display device, and the at least two elements include a first element and a second element, and in a case where the priority of the first element and the priority of the second element both satisfy the reference and the priority of the first element is higher than the priority of the second element, the control device changes a display mode corresponding to the first element, and suppresses a change of a display mode corresponding to the second element before and/or after changing the display mode.
11 . The display control system according to claim 9 , wherein in a case where the priority of the element in the external environment to be displayed on the display device satisfies the reference, the control device then controls the audio source device to output the audio guidance about the element, and changes the display mode corresponding to the element.
12 . The display control system according to claim 9 , wherein the control device changes luminance of a display corresponding to the element having the priority that satisfies the reference.
13 . The display control system according to claim 9 , wherein the control device changes a color of a display corresponding to the element having the priority that satisfies the reference.
14 . The display control system according to claim 9 , wherein the control device controls the audio source device to change a speed of the audio guidance about the element having the priority that satisfies the reference and output the audio guidance.
15 . The display control system according to claim 1 , wherein the audio source device gives the audio guidance for traveling guidance of the moving body.
16 . A method for conducting display control of a display device in a moving body including an audio source device configured to give audio guidance about the moving body and the display device capable of displaying information indicating an external environment in surroundings of the moving body, the method comprising: a step of processing audio information of the audio guidance to be output by the audio source device, and acquiring a signal waveform of the audio information; and a step of controlling the display device for a display mode to be output by the display device in synchronization with the acquired signal waveform, and the display mode to be output by the display device is synchronized with a timing when volume of the audio information becomes equal to or smaller than a reference, based on the acquired signal waveform.
17 . The method according to claim 16 , wherein a start timing of the synchronization is delayed by a predetermined period of time from a start timing of the audio guidance to be output by the audio source device.
18 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute display control of a display device in a moving body including an audio source device configured to give audio guidance about the moving body and the display device capable of displaying information indicating an external environment in surroundings of the moving body, the program causing the computer to execute: processing audio information of the audio guidance to be output by the audio source device, and acquiring a signal waveform of the audio information; and controlling the display device for a display mode to be output by the display device in synchronization with the acquired signal waveform, and the display mode to be output by the display device is synchronized with a timing when volume of the audio information becomes equal to or smaller than a reference, based on the acquired signal waveform.
19 . The non-transitory computer-readable storage medium according to claim 18 , wherein a start timing of the synchronization is delayed by a predetermined period of time from a start timing of the audio guidance to be output by the audio source device.

Description

CROSS-REFERENCE TO RELATED APPLICATION(S) This application claims priority to and the benefit of Japanese Patent Application No. 2023-174617, filed on Oct. 6, 2023, the entire disclosure of which is incorporated herein by reference. BACKGROUND OF THE INVENTION Field of the Invention The present invention mainly relates to a display control system. Description of the Related Art In these years, efforts to provide a sustainable transportation system in consideration of further safety of traffic are actively being made, and research and development on preventive safety technology are being conducted to achieve such a transportation system. For example, some vehicles include a display device capable of displaying position information of surrounding objects (pedestrians, other vehicles, and the like) (International Publication No. 2022/190630 and Japanese Patent Laid-Open No. 2016-197407). According to such a configuration, the driver is able to easily recognize the presence of the objects in the surroundings of the vehicle, and an appropriate driving mode of the vehicle is enabled. In general, there may be a demand for a technique capable of further improving the traffic safety by setting a more appropriate driving mode. The same demand also applies to moving bodies without wheels. SUMMARY OF THE INVENTION It is an exemplary object of the present invention to improve traffic safety, and thus an object is to contribute to development of a sustainable transportation system. One of the aspects of the present invention provides a display control system for a moving body, the display control system comprising: an audio source device configured to give audio guidance about the moving body; a display device capable of displaying information indicating an external environment in surroundings of the moving body; and a control device, wherein the control device processes audio information of the audio guidance to be output by the audio source device, and acquires a signal waveform of the audio information, and controls the display device for a display mode to be output by the display device in synchronization with the acquired signal waveform. Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating a configuration of a vehicle according to an embodiment; FIG. 2 is a schematic diagram illustrating relative positions of individual elements of the vehicle; FIG. 3 is a flowchart illustrating an example of control contents by a control device; FIG. 4A is a schematic diagram illustrating an example of a mode of driving a display device and an audio source device; FIG. 4B is a schematic diagram illustrating an example of a mode of driving the display device and the audio source device; FIG. 4C is a schematic diagram illustrating an example of a mode of driving the display device and the audio source device; FIG. 5 is a view illustrating an example of icons used in the display device; FIG. 6 is a view illustrating an example of synchronization display of the icons used in the display device; FIG. 7 is a flowchart illustrating an example of control contents by the control device for achieving the synchronization display; FIG. 8 illustrates an example of signal waveforms that can be generated by filtering processing; FIG. 9A is a diagram illustrating an example of a mode of driving for synchronization display; FIG. 9B is a diagram illustrating an example of a mode of driving for the synchronization display; FIG. 9C is a diagram illustrating an example of a mode of driving for the synchronization display; FIG. 9D is a diagram illustrating an example of a mode of driving for the synchronization display; FIG. 9E is a diagram illustrating an example of a mode of driving for the synchronization display; FIG. 10 is a schematic diagram illustrating an example of a mode of driving the display device and the audio source device; and FIG. 11 is a flowchart illustrating an example of control contents by the control device for achieving the synchronization display. DESCRIPTION OF THE EMBODIMENTS Hereinafter, embodiments will be described in detail with reference to the attached drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention, and limitation is not made an invention that requires all combinations of features described in the embodiments. Two or more of the multiple features described in the embodiments may be combined as appropriate. Furthermore, the same reference numerals are given to the same or similar configurations, and redundant description thereof is omitted. First Embodiment FIG. 1 illustrates a configuration of a vehicle 1 according to an embodiment. FIG. 2 is a schematic diagram for describing relative positions of individual elements included in the vehicle 1. The vehicle 1 includes wheels 11, a driver's s