US-12620295-B2 - Rear seat passenger notification device and a method therefor

US12620295B2US 12620295 B2US12620295 B2US 12620295B2US-12620295-B2

Abstract

A rear seat passenger notification device includes a sensor device that identifies information about at least one passenger who is present in a host vehicle when the host vehicle enters a lock state. The rear seat passenger notification device also includes an alarm device that performs a visual and audible alarm function, and an information collection device that collects information about the host vehicle and information about a user of the host vehicle The rear seat passenger notification device further includes an action determination and control device that identifies, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and provides the user with the at least one action item.

Inventors

Seul Ki Jeon
Hui Won Shin
Eung Hwan Kim

Assignees

HYUNDAI MOTOR COMPANY
KIA CORPORATION

Dates

Publication Date: 20260505
Application Date: 20230518
Priority Date: 20221031

Claims (20)

1 . A rear seat passenger notification device, comprising: a sensor device configured to: identify information about at least one passenger who is present in a host vehicle when the host vehicle enters a lock state, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof, and identify whether the at least one passenger is an adult or a child using at least one of a detection area where a detected passenger is detected, a detection intensity where the detected passenger is detected, a detection height where the detected passenger is detected, a location where breathing of the detected passenger occurs, or a combination thereof; an alarm device configured to perform a visual and audible alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof, when it is identified that the information about the at least one passenger meets a specified condition including at least one of the detection area, the detection intensity, the detection height, or a combination thereof; an information collection device configured to collect information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition; and an action determination and control device configured to: identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and provide the user with the at least one action item, wherein the action determination and control device is configured to provide the user with a function to control a window adjacent to an area identified as including the child, wherein the information collection device includes: a user location information collection device configured to collect a location of the user based on wireless communication with a user terminal, and an outsider detection device configured to identify an outsider adjacent to the host vehicle using at least one of a biometric sensor, a motion sensor, an acceleration sensor, or a combination thereof.
2 . The rear seat passenger notification device of claim 1 , wherein the alarm device is configured to perform the visual and audible alarm function when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child.
3 . The rear seat passenger notification device of claim 1 , wherein: the information collection device is configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child, and the alarm device is configured to gradually strengthen and repeatedly perform the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
4 . The rear seat passenger notification device of claim 1 , wherein: the information collection device is configured to collect a separation distance between the user and the host vehicle when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child, and the action determination and control device is configured to transmit a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
5 . The rear seat passenger notification device of claim 1 , wherein the at least one action item includes at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
6 . The rear seat passenger notification device of claim 1 , wherein the action determination and control device is configured to: execute one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature, and execute one of the control of air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
7 . The rear seat passenger notification device of claim 1 , wherein the action determination and control device is configured to transmit a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle when presence of the external user is identified by means of adjacent information of the host vehicle, the adjacent information being included in the information of the host vehicle.
8 . The rear seat passenger notification device of claim 1 , wherein: the sensor device is configured to: divide an interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device, and identify information of the at least one passenger with respect to each of the plurality of areas, and the action determination and control device is configured to: identify the location where the at least one passenger is seated among the plurality of areas, and provide the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof in an area adjacent to the location.
9 . The rear seat passenger notification device of claim 1 , wherein: the sensor device is configured to identify that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera, and the action determination and control device is configured to: continue setting all doors of the host vehicle to the lock state, and transmit information about the external user to a terminal of the user.
10 . The rear seat passenger notification device of claim 1 , wherein the sensor device includes: at least one camera configured to capture an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle, and at least one rear occupant alert (ROA) sensor configured to divide and identify an interior of the host vehicle into a plurality of areas for each sitting seat.
11 . A rear seat passenger notification method, comprising: identifying, by a sensor device, information about at least one passenger who is present in a host vehicle, the information including at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof, when the host vehicle enters a lock state; identifying, by the sensor device, whether the at least one passenger is an adult or a child using at least one of a detection area where a detected passenger is detected, a detection intensity where the detected passenger is detected, a detection height where the detected passenger is detected, a location where breathing of the detected passenger occurs, or a combination thereof; performing, by an alarm device, a visual and audible alarm function including at least one of a visual alarm function, an audible alarm function, or a combination thereof, when it is identified that the information about the at least one passenger meets a specified condition including at least one of the detection area, the detection intensity, the detection height, or a combination thereof; collecting, by an information collection device, information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition; collecting, by a user location information collection device, a location of the user based on wireless communication with a user terminal; identifying, by an outsider detection device, an outsider adjacent to the host vehicle using at least one of a biometric sensor, a motion sensor, an acceleration sensor, or a combination thereof; identifying, by an action determination and control device, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle; and providing, by the action determination and control device, the user with the at least one action item, including providing the user with a function to control a window adjacent to an area identified as including the child.
12 . The rear seat passenger notification method of claim 11 , wherein performing the visual and audible alarm function by the alarm device includes: performing the visual and audible alarm function when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child.
13 . The rear seat passenger notification method of claim 11 , wherein: collecting the information by the information collection device includes collecting, by the information collection device, a separation distance between the user and the host vehicle when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child, and performing the visual and audible alarm function by the alarm device includes gradually strengthening and repeatedly performing the visual and audible alarm function when it is identified that the separation distance is less than a specified distance.
14 . The rear seat passenger notification method of claim 11 , wherein: collecting the information by the information collection device includes collecting a separation distance between the user and the host vehicle when it is identified, based on whether at least one of the detection area, the detection intensity, the detection height, or a combination thereof included in the specified condition is met, that the at least one passenger includes the child, and providing the at least one action item to the user by the action determination and control device includes transmitting, by the action determination and control device, a user interface including the at least one action item for the control of the host vehicle to a terminal of the user when it is identified that the separation distance is greater than a specified distance.
15 . The rear seat passenger notification method of claim 11 , wherein the at least one action item includes at least one of control of air conditioning of the host vehicle, control of starting of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, communication with a terminal of the user, digital key transmission to a terminal of an external user adjacent to the host vehicle, or a combination thereof.
16 . The rear seat passenger notification method of claim 11 , wherein providing the at least one action item to the user by the action determination and control device includes: executing, by the action determination and control device, one of control of air conditioning of the host vehicle, control of at least one window of the host vehicle, control of at least one door of the host vehicle, or a combination thereof such that an interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, decreases when it is identified that the interior temperature is greater than or equal to a first temperature, or executing, by the action determination and control device, one of the control of the air conditioning of the host vehicle, the control of the at least one window of the host vehicle, the control of the at least one door of the host vehicle, or the combination thereof such that the interior temperature of the host vehicle, the interior temperature being in included in the information of the host vehicle, increases when it is identified that the interior temperature is less than a second temperature lower than the first temperature.
17 . The rear seat passenger notification method of claim 11 , wherein providing the at least one action item to the user includes: transmitting, by the action determination and control device, a digital key of the host vehicle to a terminal of an external user adjacent to the host vehicle when presence of the external user is identified, using adjacent information of the host vehicle, the adjacent information being included in the information of the host vehicle.
18 . The rear seat passenger notification method of claim 11 , wherein: identifying the information about the at least one passenger includes dividing, by the sensor device, an interior of the host vehicle into a plurality of areas based on a field of view (FOV) of at least one sensor included in the sensor device and identifying, by the sensor device, information of the at least one passenger with respect to each of the plurality of areas, and providing the at least one action item to the user by the action determination and control device includes: identifying, by the action determination and control device, the location where the at least one passenger is seated among the plurality of areas, and providing, by the action determination and control device, the user with the at least one action item to execute at least one of air conditioning control, window control, door control, or a combination thereof, in an area adjacent to the location.
19 . The rear seat passenger notification method of claim 11 , wherein: identifying the information about the at least one passenger by the sensor device includes identifying, by the sensor device, that an external user adjacent to the host vehicle approaches the host vehicle using at least one camera, and providing the at least one action item to the user by the action determination and control device includes continuing, by the action determination and control device, setting all doors of the host vehicle to the lock state, and transmitting, by the action determination and control device, information about the external user to a terminal of the user.
20 . The rear seat passenger notification method of claim 11 , wherein the sensor device includes: at least one camera configured to capture an area in front of the host vehicle, an area behind the host vehicle, and an area at a side of the host vehicle, and at least one rear occupant alert (ROA) sensor configured to divide and identify an interior of the host vehicle into a plurality of areas for each sitting seat.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application claims the benefit of and priority to Korean Patent Application No. 10-2022-0142989, filed on Oct. 31, 2022, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD The present disclosure relates to a rear seat passenger notification device and a method therefor. BACKGROUND Situations in which a user of a host vehicle leaves children in the host vehicle due to lack of attention or unavoidable circumstances often occur. Such situations may cause major problems, especially during summer months. For example, children and the like may suffocate due to an increase in the interior temperature of the host vehicle if the children are left in the interior of the host vehicle for a long time. Because accidents of this type are not intended by the user of the host vehicle and are generally caused by momentary negligence and a moment of carelessness, most accidents may be prevented when an alarm is provided under certain conditions. Many technologies have been proposed to cope with dangerous accidents in the parked host vehicle. For example, technologies of measuring the interior temperature of the host vehicle to open a window of a door of the host vehicle, operate an air conditioner of the host vehicle, or generate an alarm are provided in the host vehicle when the host vehicle is manufactured. However, because the functions uniformly control the interior environment without considering the location of the user of the host vehicle or information about the exterior environment, there may be a risk of malfunction. Furthermore, because the accuracy of an interior detection process for providing a function may be degraded or it may be difficult to determine whether to execute various functions to be adaptive to the user, availability is slightly reduced. SUMMARY The present disclosure has been made to solve the above-mentioned problems occurring in the prior art while advantages achieved by the prior art are maintained intact. An aspect of the present disclosure provides a rear seat passenger notification device for identifying information about an interior and/or exterior environment of a host vehicle using a sensor device and adaptively identifying an action item for safety of a passenger based on the identified result, and a method therefor. Another aspect of the present disclosure provides a rear seat passenger notification device for visually and/or audibly providing an alarm function for a remaining situation of a passenger using an alarm device and further considering a separation distance between the host vehicle and the user to provide an alarm function in various manners, and a method therefor. Another aspect of the present disclosure provides a rear seat passenger notification device for collecting at least one of information about the host vehicle, information of the user of the host vehicle, or a combination thereof in a complex manner using an information collection device and suitably identifying and providing an action item using the collected information, and a method therefor. The technical problems to be solved by the present disclosure are not limited to the aforementioned problems, and any other technical problems not mentioned herein will be clearly understood from the following description by those having ordinary skill in the art to which the present disclosure pertains. According to an embodiment of the present disclosure, a rear seat passenger notification device may include a sensor device configured to identify information about at least one passenger who is present in a host vehicle when the host vehicle enters a locked state. In particular, the information includes at least one of a location where the at least one passenger is seated, a state where the at least one passenger is seated, an age group of the at least one passenger, or a combination thereof. The rear seat passenger notification device may also include an alarm device configured to perform a visual and audible alarm function when it is identified that the information about the at least one passenger meets a specified condition, and an information collection device configured to collect information about the host vehicle and information about a user of the host vehicle when it is identified that the information about the at least one passenger meets the specified condition. The rear seat passenger notification device may further include an action determination and control device configured to identify, based on at least one of the information about the at least one passenger, the information about the host vehicle, the information about the user, or a combination thereof, at least one action item for control of the host vehicle, and the action determination and control device provide the user with the at least one action item. In an aspect, the alarm device may be configured to perform the visual and audible alarm function when it is identified, bas