Search

US-20260127896-A1 - STATE RECOGNITION APPARATUS, STATE RECOGNITION METHOD, COMPUTER-READABLE MEDIUM, TASK EXECUTION SYSTEM, AND TASK EXECUTION METHOD

US20260127896A1US 20260127896 A1US20260127896 A1US 20260127896A1US-20260127896-A1

Abstract

A state recognition apparatus detects that a mirror of a vehicle is operated. The state recognition apparatus determines a head position of a driver of the vehicle at a time point when the mirror is operated. The state recognition apparatus sets the determined head position as a reference position of a head in the vehicle.

Inventors

  • Yasuhiro Mizukoshi

Assignees

  • NEC CORPORATION

Dates

Publication Date
20260507
Application Date
20221013

Claims (20)

  1. 1 . A state recognition apparatus comprising: at least one memory that is configured to store instructions; and at least one processor that is configured to execute the instructions to: detect that a mirror of a vehicle is operated; determine a head position of a driver of the vehicle at a time point when the operation is performed; and set the determined head position as a reference position of a head in the vehicle.
  2. 2 . The state recognition apparatus according to claim 1 , wherein the detection of the operation of the mirror includes detecting an action of operating the mirror from a first captured image including the mirror to detect that the mirror is operated.
  3. 3 . The state recognition apparatus according to claim 2 , wherein the action of operating the mirror is an action of moving the mirror by hand or an action of operating an operation interface of the mirror.
  4. 4 . The state recognition apparatus according to claim 1 , wherein the determination of the head position includes: acquiring a second captured image including a head of the driver; and determining the head position of the driver based on coordinates of one or more points related to the head included in the second captured image.
  5. 5 . The state recognition apparatus according to claim 1 , wherein the setting of the reference position includes outputting reference information including the determined head position.
  6. 6 . The state recognition apparatus according to claim 5 , wherein the determination of the head position includes determining the head position of the driver based on a combination of coordinates of each of a plurality of parts of the head, and wherein the setting of the reference position includes: determining a posture of the head based on the combination of the coordinates, and outputting the reference information including the determined posture of the head.
  7. 7 . The state recognition apparatus according to claim 5 , wherein the setting of the reference position includes determining identification information of the driver and outputting the reference information including the determined identification information.
  8. 8 . The state recognition apparatus according to claim 5 , wherein the setting of the reference position includes: outputting the reference information including the head position of the driver if the head position of the driver is determined within a predetermined period; and outputting the reference information including a predetermined head position if the head position of the driver is not determined within the predetermined period.
  9. 9 . The state recognition apparatus according to claim 8 , wherein the predetermined head position is a head position included in the reference information output in the past.
  10. 10 . A state recognition method executed by a computer, comprising: detecting that a mirror of a vehicle is operated; determining step of determining a head position of a driver of the vehicle at a time point when the operation is performed; and setting the determined head position as a reference position of a head in the vehicle.
  11. 11 . The state recognition method according to claim 10 , wherein the detection of the operation of the mirror includes detecting an action of operating the mirror from a first captured image including the mirror to detect that the mirror is operated.
  12. 12 . The state recognition method according to claim 11 , wherein the action of operating the mirror is an action of moving the mirror by hand or an action of operating an operation interface of the mirror.
  13. 13 . The state recognition method according to claim 10 , wherein the determination of the head position includes: acquiring a second captured image including a head of the driver; and determining the head position of the driver based on coordinates of one or more points related to the head included in the second captured image.
  14. 14 . The state recognition method according to claim 10 , wherein the setting of the reference position includes outputting reference information including the determined head position.
  15. 15 . The state recognition method according to claim 14 , wherein the determination of the head position includes determining the head position of the driver based on a combination of coordinates of each of a plurality of parts of the head, and wherein the setting of the reference position includes determining a posture of the head based on the combination of the coordinates, and outputting the reference information including the determined posture of the head.
  16. 16 - 18 . (canceled)
  17. 19 . A non-transitory computer-readable medium storing a program that causes a computer to execute: detecting that a mirror of a vehicle is operated; determining step of determining a head position of a driver of the vehicle at a time point when the operation is performed; and setting the determined head position as a reference position of a head in the vehicle.
  18. 20 . The computer-readable medium according to claim 19 , wherein the detection of the operation of the mirror includes detecting an action of operating the mirror from a first captured image including the mirror to detect that the mirror is operated.
  19. 21 . The computer-readable medium according to claim 20 , wherein the action of operating the mirror is an action of moving the mirror by hand or an action of operating an operation interface of the mirror.
  20. 22 . The computer-readable medium according to claim 19 , wherein the determination of the head position includes: acquiring acquires a second captured image including a head of the driver; and determining the head position of the driver based on coordinates of one or more points related to the head included in the second captured image.

Description

TECHNICAL FIELD The present disclosure relates to a state recognition apparatus, a state recognition method, a computer-readable medium, a task execution system, and a task execution method. BACKGROUND ART A technique for detecting a state of a driver in a vehicle such as an automobile has been developed. For example, Patent Literature 1 discloses a technique for detecting that a driver is looking away by using, as a reference value, a direction of the face of a driver at time of adjusting an outer mirror. CITATION LIST Patent Literature Patent Literature 1: Japanese Unexamined Patent Application Publication No. 2009-009244 SUMMARY OF INVENTION Technical Problem In Patent Literature 1, the direction of the face of the driver is used as a reference for the state of the driver. An objective of the present disclosure is to disclose a more efficient technique for determining a reference for a state of a driver. Solution to Problem According to the present disclosure, a state recognition apparatus includes: detection means for detecting that a mirror of a vehicle is operated; determining means for determining a head position of a driver of the vehicle at a time point when the operation is performed; and setting means for setting the determined head position as a reference position of a head in the vehicle. According to the present disclosure, a state recognition method is executed by a computer. The state recognition method includes: a detection step of detecting that a mirror of a vehicle is operated; a determining step of determining a head position of a driver of the vehicle at a time point when the operation is performed; and a setting step of setting the determined head position as a reference position of a head in the vehicle. According to the present disclosure, a program causes a computer to execute the state recognition method of the present disclosure. Advantageous Effects of Invention According to the present disclosure, a more efficient technique for determining a reference for a state of a driver is provided. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a diagram illustrating an overview of an operation of a state recognition apparatus according to an example embodiment. FIG. 2 is a block diagram illustrating a functional configuration of the state recognition apparatus. FIG. 3 is a block diagram illustrating a hardware configuration of a computer that implements the state recognition apparatus. FIG. 4 is a flowchart illustrating a flow of processing executed by the state recognition apparatus. FIG. 5 is a diagram illustrating a case where a head position is represented by a combination of coordinates of a plurality of points. FIG. 6 is a block diagram illustrating a functional configuration of a system including the state recognition apparatus and an application apparatus. FIG. 7 is a flowchart illustrating a flow of processing executed by the application apparatus. EXAMPLE EMBODIMENT Hereinafter, example embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding elements are denoted by the same reference numerals, and repeated description is omitted as necessary for clarity of description. In addition, unless otherwise described, predetermined values such as predetermined values and threshold values are stored in advance in a storage device or the like accessible from an apparatus using the values. Furthermore, unless otherwise described, a storage unit includes one or any larger number of storage devices. <Overview> FIG. 1 is a diagram illustrating an overview of a state recognition apparatus 2000 according to an example embodiment. Here, FIG. 1 is a diagram for facilitating understanding of the overview of the state recognition apparatus 2000, and the operation of the state recognition apparatus 2000 is not limited to that illustrated in FIG. 1. The state recognition apparatus 2000 sets the position of a driver 30 at a time point when a mirror 20 provided in a vehicle 10 is operated, as a reference position of the head (hereinafter, referred to as reference head position) in the vehicle 10. The vehicle 10 is, for example, an automobile. The mirror 20 is a mirror used by the driver 30 during driving, and is, for example, a rear-view mirror or a side mirror. Note that only one type of mirror may be treated as the mirror 20, or a plurality of types of mirrors may be treated as the mirror 20. In the latter case, for example, if any one of the rear-view mirror and two side mirrors is operated, the state recognition apparatus 2000 determines that the mirror 20 is operated by the driver 30. For example, the state recognition apparatus 2000 operates as follows. First, the state recognition apparatus 2000 detects an operation of the mirror 20 by the driver 30. Further, the state recognition apparatus 2000 determines the position (head position 40) of the head of the driver 30 at the time point when the mirror 20 is operated by t