KR-20260066850-A - IN-VEHICLE INFOTAINMENT SYSTEM WITH HAPTIC FEEDBACK FUNCTION BASED ON DRIVER'S CONDITION AND DRIVING ENVIRONMENT, AND CONTROL METHOD THEREFOR

Abstract

An infotainment system for a vehicle equipped with a haptic feedback function according to one embodiment comprises: a first sensor unit that measures a driver's biosignal and acquires a face image of the driver; a second sensor unit configured to include a plurality of sensors and acquires the condition of the road while driving; a first haptic feedback unit embedded in a display and including a plurality of first haptic actuators; a second haptic feedback unit mounted on a driving steering wheel and including a plurality of second haptic actuators; and a control unit that generates a control signal for controlling the operation of the first haptic feedback unit and the second haptic feedback unit based on the outputs of the first sensor unit and the second sensor unit.

Inventors

• 김형준
• 정수현

Assignees

• 주식회사 베이리스

Dates

Publication Date

20260512

Application Date

20241105

Claims (20)

1. In a vehicle infotainment system equipped with a haptic feedback function, A first sensor unit that measures the driver's biosignal and acquires the driver's face image; A second sensor unit configured to include a plurality of sensors and acquiring the road condition while driving; A first haptic feedback unit embedded in a display and comprising a plurality of first haptic actuators; A second haptic feedback unit mounted on a driving steering wheel and comprising a plurality of second haptic actuators; and An infotainment system for a vehicle, comprising: a control unit that generates a control signal for controlling the operation of the first haptic feedback unit and the second haptic feedback unit based on the outputs of the first sensor unit and the second sensor unit.
2. In paragraph 1, The above control unit is, An infotainment system for a vehicle that measures driver fatigue based on the output of the first sensor unit, determines road driving risk based on the output of the second sensor unit, and generates a control signal to control the operation of the first haptic feedback unit and the second haptic feedback unit using the driver fatigue and the road driving risk.
3. In paragraph 2, The above control signal is, An infotainment system for a vehicle comprising a vibration pattern signal for generating a vibration pattern of the plurality of first haptic actuators and the plurality of second haptic actuators.
4. In paragraph 3, The above vibration pattern signal is, An infotainment system for vehicles generated by a combination of multiple amplitudes, frequencies, durations, and waveform shapes.
5. In paragraph 4, The above control unit is, An infotainment system for a vehicle that generates a vibration pattern signal that increases the amplitude, increases the frequency, and increases the duration as the driver's fatigue level increases.
6. In paragraph 5, The above control unit is, An infotainment system for a vehicle that generates a vibration pattern signal that increases the amplitude, increases the frequency, and increases the duration as the road driving risk increases.
7. In paragraph 4, The above control unit is, An infotainment system for a vehicle that generates a vibration pattern signal by multiplying the driver's fatigue and the road driving risk by a weight, respectively, and then summing them.
8. In paragraph 4, The above control unit is, An infotainment system for a vehicle that generates a vibration pattern signal for continuously outputting a plurality of pulse signals when the driver's fatigue level exceeds a first-1 threshold or the road driving risk level exceeds a second-1 threshold.
9. In paragraph 3, The above-mentioned vehicle infotainment system is, It further includes a first operating unit mounted on the above display and operating the operation of the vehicle infotainment system; When operated by the first operating unit, at least one of the plurality of first haptic actuators is, A vehicle infotainment system that vibrates by the above vibration pattern signal.
10. In Paragraph 9, The above-mentioned vehicle infotainment system is, It further includes a second control unit mounted on the driving steering wheel and operating the vehicle infotainment system. When operated by the second operating unit, at least one of the plurality of second haptic actuators is, A vehicle infotainment system that vibrates by the above vibration pattern signal.
11. In Paragraph 10, At least some of the plurality of first haptic actuators and at least some of the plurality of second haptic actuators, An infotainment system for vehicles that is interconnected and vibrates simultaneously by a single vibration pattern signal.
12. In Paragraph 10, The above control unit is, An infotainment system for a vehicle that generates a vibration pattern signal that vibrates at least one of the plurality of second haptic actuators when the driver's fatigue level exceeds a first-2 threshold or the road driving risk level exceeds a second-2 threshold, displays a warning message on the display, and outputs a warning sound through a speaker.
13. In a method for controlling haptic feedback, (a) Step of measuring driver fatigue; (b) a step of determining the risk of driving on the road; and (c) a step of generating a control signal to control the operation of a plurality of first haptic actuators embedded in a display and a plurality of second haptic actuators mounted on a driving handle, using the driver's fatigue and the road driving risk; a control method comprising.
14. In Paragraph 13, The above control signal is, A control method comprising a vibration pattern signal for generating a vibration pattern of the plurality of first haptic actuators and the plurality of second haptic actuators.
15. In Paragraph 14, The above vibration pattern signal is, A control method generated by a combination of multiple of amplitude, frequency, duration and waveform shape.
16. In paragraph 15, In step (c) above, A control method for generating a vibration pattern signal that increases the amplitude, increases the frequency, and increases the duration as the driver's fatigue level increases.
17. In paragraph 15, In step (c) above, A control method for generating a vibration pattern signal that increases the amplitude, increases the frequency, and increases the duration as the road driving risk increases.
18. In Paragraph 14, In step (c) above, A control method for generating a vibration pattern signal by multiplying the driver's fatigue and the road driving risk by weights, respectively, and then summing them.
19. In Paragraph 14, In step (c) above, A control method for generating a vibration pattern signal to continuously output a plurality of pulse signals when the driver's fatigue level exceeds a first-1 threshold or the road driving risk level exceeds a second-1 threshold.
20. In Paragraph 13, In step (c) above, A control method for generating a vibration pattern signal that vibrates at least one of the plurality of first haptic actuators when operated by touch of the display.

Description

Vehicle infotainment system equipped with a haptic feedback function based on driver's condition and driving environment, and control method therefor The embodiments disclosed in this specification relate to a vehicle infotainment system having a haptic feedback function according to the driver's state and driving environment, and a method for controlling the same. With the advancement of technology, the current automotive industry is seeing a significant improvement in both the quantity and quality of information and entertainment provided within vehicles. In-Vehicle Infotainment Systems (IVI) provide drivers and passengers with various services, such as navigation, audio/video playback, and communication functions, and have established themselves as an important part of the driving experience. Touchscreens are becoming the mainstream in-vehicle interface, replacing traditional physical buttons and dials. While touchscreens enable intuitive operation and the integration of various functions, the need to physically touch the screen while driving forces the driver's gaze from the road to the display, which can lead to distraction and safety risks. In particular, the lack of tactile feedback makes it difficult for drivers to be confident in the accuracy of their operations. Furthermore, factors such as long hours of driving, night driving, and repetitive driving environments increase driver fatigue and reduce concentration. This leads to delayed reaction times, decreased attention span, and impaired judgment, becoming a major cause of traffic accidents. However, existing vehicle systems currently have limited or insufficient capabilities to detect driver fatigue and provide appropriate responses. In addition, while haptic feedback technology is widely used in devices such as smartphones and game controllers, its application in automotive infotainment systems is still in its early stages. This has been limited due to the complexity of the vehicle environment, safety requirements, and difficulties in technical implementation. In particular, external factors such as vibrations or noise generated while driving can reduce the effectiveness of haptic feedback. FIG. 1 is a configuration diagram of a vehicle infotainment system equipped with a haptic feedback function according to the driver's state and driving environment according to one embodiment. FIG. 2 is a configuration diagram of a control unit according to one embodiment. FIG. 3 is a flowchart of a method for controlling haptic feedback according to one embodiment. Hereinafter, with reference to the attached drawings, a vehicle infotainment system equipped with a haptic feedback function according to the driver's state and driving environment and a method for controlling the same will be described in detail according to embodiments of the present disclosure. It is understood that the following embodiments of the present disclosure are merely intended to embody the present disclosure and do not limit or restrict the scope of the rights of the present disclosure. Anything that can be easily inferred by a person skilled in the art to which the present disclosure belongs from the detailed description and embodiments of the present disclosure is interpreted as falling within the scope of the rights of the present disclosure. FIG. 1 shows a configuration diagram of a vehicle infotainment system (100) equipped with a haptic feedback function according to the driver's condition and driving environment according to one embodiment. As can be seen from FIG. 1, a vehicle infotainment system (100) equipped with a haptic feedback function according to the driver's state and driving environment according to one embodiment may be configured to include a first sensor unit (10), a second sensor unit (20), a first operating unit (30), a second operating unit (40), a first haptic feedback unit (50), a second haptic feedback unit (60), and a control unit (70). The first sensor unit (10) is responsible for acquiring sensor signals from each sensor, including a pulse sensor, a heart rate sensor, and a camera sensor. Specifically, the first sensor unit (10) measures the driver's biometric signal and acquires the driver's face image. In addition, the second sensor unit (20) includes a lidar sensor and a camera sensor and plays the role of acquiring sensor signals from each sensor. Specifically, the second sensor unit (20) acquires the condition of the road while driving. The first control unit (30) is installed on the display and serves to operate the vehicle infotainment system (100). If the display is a touch screen, the first control unit (30) may be implemented as an integral part of the display. The second control unit (40) is mounted on the steering wheel and operates the vehicle infotainment system (100). For example, the second control unit (40) can be implemented in the form of a plurality of buttons provided on the steering wheel. The first haptic feedback unit (50) is emb