JP-7855989-B2 - Information processing device, information processing method, and program

Inventors

• 長田 祐
• 小塚 智之

Assignees

• トヨタ自動車株式会社

Dates

Publication Date

20260511

Application Date

20221101

Claims (16)

1. An information processing device capable of communicating with a management server, including a control unit, the control unit is Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger . The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information . An information processing device that performs operations including those mentioned above.
2. In the information processing apparatus according to claim 1, The sensor is an information processing device that includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor.
3. In the information processing apparatus according to claim 1, The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing device, including
4. In the information processing apparatus according to claim 1, the operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing device, including
5. In the information processing apparatus according to claim 4 , An information processing device that determines the passenger's condition, including at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.
6. A vehicle equipped with the information processing device described in claim 1.
7. An information processing method using an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger . The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information . Information processing methods, including those mentioned above.
8. In the information processing method described in claim 7 , The sensor includes at least one of an image sensor, a door sensor, and a millimeter-wave sensor, and is an information processing method.
9. In the information processing method described in claim 7 , The aforementioned sensor includes a camera, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, Information processing methods, including those mentioned above.
10. In the information processing method described in claim 7 , If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, Information processing methods, including those mentioned above.
11. In the information processing method described in claim 10 , Information processing method for determining the passenger's condition, which includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.
12. A computer acting as an information processing device capable of communicating with a management server, Acquiring sensor information from sensors installed on the vehicle, The sensor information is used to detect abnormalities inside the vehicle, To determine whether the nature of the abnormality is related to a suspicious object, If it is determined that the nature of the abnormality is related to a suspicious object, the size of the suspicious object is determined, and the level of urgency is set according to that size. To determine whether the nature of the abnormality is related to the passenger, If it is determined that the nature of the abnormality is related to a passenger, the urgency level will be set according to whether the nature of the abnormality is a passenger emergency, a disruption to operations, or an inquiry from a passenger . The management server is notified of the details of the abnormality and the degree of urgency, and other abnormality-related information . A program that performs an action that includes the following:
13. In the program described in claim 12 , The program includes at least one of the following sensors: an image sensor, a door sensor, and a millimeter-wave sensor.
14. In the program described in claim 12 , The aforementioned sensor includes a camera, The aforementioned operation is, When it is determined that the abnormality is a suspicious object and that the contents of the suspicious object cannot be determined, the camera's orientation, field of view, and zoom level are adjusted to capture a magnified image of the suspicious object. The enlarged image is notified to the management server, A program that includes this.
15. In the program according to claim 12 , the operation is: If it is determined that the nature of the abnormality is related to a passenger, the passenger's condition will be analyzed, To notify the management server of the passenger's status, A program that includes this.
16. In the program described in claim 15 , The passenger's condition is a program that includes at least one of the passenger's age, gender, posture, behavior, pulse, blood pressure, and respiratory rate.

Description

This disclosure relates to an information processing device, an information processing method, and a program. Conventionally, there is a known invention that, when an abnormal condition is detected that makes manual operation by the occupant (driver) difficult, notifies a remote control device to secure a remote operator (for example, Patent Document 1). Japanese Patent Publication No. 2021-015561 This is a schematic diagram of the information processing system of this embodiment.This is a block diagram showing the configuration of the management server.This is a block diagram showing the vehicle configuration.This is a sequence diagram illustrating the operation of an information processing system.This diagram shows the data structure of the anomaly-related information database. Figure 1 is a schematic diagram of the information processing system S of this embodiment. The information processing system S includes a management server 1 and a vehicle 2. The management server 1 can communicate with the vehicle 2 via a network NW. The network NW includes, for example, a mobile communication network, the Internet, or a fixed communication network. In Figure 1, for the sake of simplicity, one management server 1 and one vehicle 2 are shown. However, the number of management servers 1 and vehicles 2 is not limited to these. For example, the processing performed by management server 1 may be performed by multiple management servers 1 located in a distributed manner. Management server 1 may be able to communicate with multiple vehicles 2. The outline of the processing performed by the information processing unit in this embodiment is described below. The control unit 21 of the information processing unit 2A performs operations including acquiring sensor information from the sensor 24 installed in the vehicle 2, and, upon detecting an abnormality inside the vehicle from the sensor information, notifying the management server 1 of the details of the abnormality. This configuration allows the information processing unit 2A to quickly notify the administrator performing remote monitoring of abnormalities inside the vehicle. Thus, the information processing unit 2A can support the administrator in making quick and appropriate decisions regarding abnormalities. Furthermore, the information processing unit 2A can support the administrator in smoothly handling escalations. The management server 1 may be a server that supports the provision of services by the service provider. The management server 1 may be installed in, for example, a control center, an operations management center, a remote monitoring center, an operations management center, a facility dedicated to the service provider, or a shared facility including a data center. The management server 1 may also be referred to as a center server. Alternatively, the management server 1 may be installed in a vehicle 2. Vehicle 2 includes any type of automobile, such as a gasoline car, diesel car, HEV, PHEV, BEV, or FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The operation of Vehicle 2 may be automated to any level. The level of automation may be, for example, one of levels 1 through 5 in the SAE classification. "SAE" is an abbreviation for Society of Automotive Engineers. Vehicle 2 may also be a MaaS-dedicated vehicle. "MaaS" is an abbreviation for Mobility as a Service. As an alternative, Vehicle 2 may be driven by a driver. Figure 2 provides a detailed explanation of the internal configuration of management server 1. The management server 1 includes a control unit 11, a communication unit 12, a storage unit 13, and a display unit 14. Each component of the management server 1 is connected to each other via, for example, a dedicated line, enabling communication. The control unit 11 includes, for example, one or more general-purpose processors, including a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The control unit 11 may include one or more dedicated processors specialized for specific processing. Instead of including processors, the control unit 11 may include one or more dedicated circuits. These dedicated circuits may be, for example, FPGAs (Field-Programmable Gate Arrays) or ASICs (Application Specific Integrated Circuits). The control unit 11 may also include an ECU (Electronic Control Unit). The control unit 11 transmits and receives arbitrary information via the communication unit 12. The communication unit 12 includes a communication module compatible with one or more wired or wireless LAN (Local Area Network) standards for connecting to a network. The communication unit 12 may include a module compatible with one or more mobile communication standards, including LTE (Long Term Evolution), 4G (4th Generation), or 5G (5th Generation). The communication uni