JP-7857056-B1 - Operation support device

JP7857056B1JP 7857056 B1JP7857056 B1JP 7857056B1JP-7857056-B1

Abstract

An operation support device that assists a user in operating a mobile object includes: an information collection unit that collects data or information related to the user, the mobile object, or its surrounding environment; a situation recognition unit that uses the data or information collected by the information collection unit to recognize the situation of the user, the mobile object, or its surrounding environment and generates information related to the situation as recognition information; a recognition information storage unit capable of storing the recognition information generated by the situation recognition unit; a comparison unit that compares the recognition information received from the situation recognition unit with the recognition information already stored in the recognition information storage unit; and a storage control unit that, if the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, causes the comparison unit to newly store the received recognition information in the recognition information storage unit. The operation support device assists the user in operating the mobile object based on the recognition information stored in the recognition information storage unit.

Inventors

府川　泰朗

Assignees

エニー株式会社

Dates

Publication Date: 20260512
Application Date: 20250612

Claims (7)

An operation support device that assists the user of the mobile body in moving the mobile body, the operation support device is An information collection unit connected to an information collection device of the mobile body, which collects data or information related to the user, the mobile body, or the surrounding environment of the mobile body acquired by the information collection device, A situation recognition unit that uses data or information collected by the information collection unit to recognize the situation of the user, the mobile object, or the surrounding environment, and generates information related to the situation as recognition information, A recognition information storage unit capable of storing the recognition information generated by the situation recognition unit, A comparison unit capable of receiving the recognition information generated by the situation recognition unit, and which compares the recognition information received from the situation recognition unit with the recognition information already stored in the recognition information storage unit, If the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, the storage control unit causes the recognition information received by the comparison unit to be newly stored in the recognition information storage unit , If the comparison unit determines that the recognition information received from the situation recognition unit has already been stored in the recognition information storage unit, the system includes an operation subject determination unit that determines whether or not the user is the one primarily operating the mobile body . An operation support device that, when the operation subject determination unit determines that the user is the one primarily operating the mobile body, monitors whether the user is performing the movement operation of the mobile body in a manner consistent with the recognition information stored in the recognition information storage unit.
In the operation support device according to claim 1, the operation support device further, An operation support device comprising a comparison result notification unit that, when the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, the comparison unit compares the recognition information with the recognition information already stored in the recognition information storage unit, and the storage control unit has started the process of storing the resulting recognition information in the recognition information storage unit, and notifies the user that the storage control unit has started the process of storing the resulting recognition information in the recognition information storage unit.
An operation support device according to claim 1 or 2, wherein the information items of the recognition information generated by the situation recognition unit include the physical state of the user when operating the mobile body, or the behavior of the mobile body that manifests in relation to said physical state.
The operation support device according to claim 3, wherein the information collection unit is connected to a biosensor that detects data or information related to the user's physical condition.
In the operation support device according to claim 1 or 2, the operation subject determination unit determines whether the user or the automated driving system mounted on the mobile body is the one primarily operating the mobile body. An operation support device that, when the operation subject determination unit determines that the automatic driving system is the primary operator of the mobile body, and the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, causes the mobile body to perform movement control to ensure the safety of the mobile body .
An operation support program that causes a computer to function as an operation support device to assist the user of the mobile body in moving the mobile body, The operation support program controls the computer, An information collection unit connected to an information collection device of the mobile body, which collects data or information related to the user, the mobile body, or the surrounding environment of the mobile body acquired by the information collection device, A situation recognition unit that uses data or information collected by the information collection unit to recognize the situation of the user, the mobile object, or the surrounding environment, and generates information related to the situation as recognition information. A recognition information storage unit capable of storing the recognition information generated by the situation recognition unit, A comparison unit capable of receiving the recognition information generated by the situation recognition unit, and which compares the recognition information received from the situation recognition unit with the recognition information already stored in the recognition information storage unit. If the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, the storage control unit causes the recognition information received by the comparison unit to be newly stored in the recognition information storage unit, and If the comparison unit determines that the recognition information received from the situation recognition unit has already been stored in the recognition information storage unit, it will function as an operation subject determination unit to determine whether or not the user is the one primarily operating the mobile body. An operation support program that, when the operation subject determination unit determines that the user is the primary operator of the mobile body, causes the computer to monitor whether the user is performing the movement operation of the mobile body in a manner consistent with the recognition information stored in the recognition information storage unit.
In the operation support program described in claim 6, The function of the computer as the operator determination unit includes determining whether the user or the automated driving system mounted on the mobile body is the one primarily operating the mobile body. If the operator determination unit determines that the automatic driving system is the primary operator of the mobile body, and the comparison unit determines that the recognition information received from the situation recognition unit has not yet been stored in the recognition information storage unit, then an operation support program causes the computer to execute movement control to ensure the safety of the mobile body.

Description

This invention relates to an operation support device. More specifically, this invention relates to an operation support device that assists a driver in operating a moving object such as an automobile. While vehicles such as automobiles were originally driven and operated by humans, the development of autonomous driving systems has been progressing in recent years. Autonomous driving systems that assist human drivers have already been put into practical use, and development continues in various places towards the realization of fully autonomous driving. However, many challenges remain to be overcome before fully autonomous driving can be achieved. Therefore, it is expected that humans will continue to handle at least a portion of the driving operations for the foreseeable future. While the degree to which currently available autonomous driving systems assist human drivers varies, they can be considered de facto driver assistance systems. An example of such an autonomous driving system is the technology disclosed in Japanese Patent Publication No. 5425170, which is used to prevent collisions between vehicles. This is a functional block diagram showing one embodiment of the operation support device according to the present invention.Figure 1 is a schematic diagram showing an example of the hardware configuration of the operation support device.Figure 1 is a flowchart illustrating an example of the operation of the operation support device shown in Figure 1.This diagram, following Figure 3, shows an example of the operation of the operation support device shown in Figure 1 in flowchart format.This diagram, following Figure 3, shows an example of the operation of the operation support device shown in Figure 1 in flowchart format.This diagram, following Figure 5, shows an example of the operation of the operation support device shown in Figure 1 in flowchart format.This diagram, following Figure 5, shows an example of the operation of the operation support device shown in Figure 1 in flowchart format. Next, embodiments of the operation support device according to the present invention will be described in detail with reference to the attached drawings. In this application, the term "mobile body" is used as a broad concept that includes mobile machines having a power source and a mobile mechanism driven by power supplied from the power source, particularly land mobile machines such as four-wheeled automobiles, motorcycles, and autonomous mobile robots, aerial mobile machines such as airplanes and drones, and water or underwater mobile machines such as ships and submarines, regardless of whether they are manned or unmanned. In the following description of embodiments, the mobile body will be described as a four-wheeled automobile traveling on land, but the present invention is also applicable to mobile machines other than four-wheeled automobiles. By mounting the operation support device 10, which is one embodiment of the present invention, on an automobile, the operation support device 10 can autonomously move the automobile under certain circumstances, or it can assist the driver operating the vehicle. Referring to Figure 1, the vehicle operation support device 10 has a control unit 12 that controls the entire operation support device 10 and the vehicle's hardware components connected to the operation support device 10. The operation support device 10 further has a storage unit 14, which stores an operation support program 16 that defines the vehicle's control procedures related to assisting the driver's operation of the vehicle, and data necessary for executing the program 16. The operation support program 16 may include an autonomous driving program that pre-defines conditions for autonomous driving and allows the vehicle to drive autonomously when those conditions are met, or the operation support program 16 may be included as part of such an autonomous driving program. The operation support device 10 further includes a calculation unit 18 that executes calculation processing necessary for control related to operation support according to the operation support program 16, and an input unit 20 that acquires information necessary for controlling the vehicle and provides the acquired information to the operation support device 10. The operation support device 10 further includes an output unit 22 that provides calculation results and control signals obtained from processing based on the operation support program 16 to the hardware components of the vehicle on which the operation support device 10 is installed. The input unit 20 is connected to various input hardware and can acquire various information or data in cooperation with the connected input hardware. Specific examples of input hardware connected to the input unit 20 will be described later. The input unit 20 is also connected to the control unit 12 and transmits the acquired information or data to the storage unit 14 under the control of the control unit