Search

US-12626511-B2 - Detection method

US12626511B2US 12626511 B2US12626511 B2US 12626511B2US-12626511-B2

Abstract

A detection system 100 of the present invention includes a position detection means 121 for detecting position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person, and a separation detection means 122 for detecting that the accessory is separated from the person based on the position information.

Inventors

  • Marina KATO
  • Satoshi TERASAWA
  • Yohei Itou
  • Natsuki Yui

Assignees

  • NEC CORPORATION

Dates

Publication Date
20260512
Application Date
20200317

Claims (20)

  1. 1 . A detection method comprising: detecting position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person; based on the position information, detecting that the accessory is separated from the person; detecting a posture of the person after it is detected that the accessory is separated from the person and detecting that the person is looking for the accessory based on the posture; and transmitting notification information to an information processing terminal, the notification information including the posture of the person, wherein the detection method further comprises detecting that the accessory is separated from the person for a preset time or more.
  2. 2 . The detection method according to claim 1 , further comprising detecting the position information of the predetermined part of the person and the accessory by detecting a skeleton of the person from a captured image in which the person is captured.
  3. 3 . The detection method according to claim 1 , further comprising detecting that the accessory is separated from the person by a preset distance or more.
  4. 4 . The detection method according to claim 1 , further comprising when detecting that the accessory is separated from the person, performing a preset notifying process.
  5. 5 . The detection method according to claim 1 , further comprising detecting a posture of the person after it is detected that the accessory is separated from the person.
  6. 6 . The detection method according to claim 5 , further comprising detecting the posture of the person by detecting a skeleton of the person from a captured image in which the person is captured after it is detected that the accessory is separated from the person.
  7. 7 . The detection method according to claim 5 , further comprising detecting a motion of the person on a basis of the posture of the detected person.
  8. 8 . The detection method according to claim 6 , further comprising performing a preset second notifying process on a basis of the detected posture of the person.
  9. 9 . The detection method according to claim 1 , wherein the accessory is a rod-shaped body having a predetermined length.
  10. 10 . The detection method according to claim 9 , wherein the accessory is a white cane.
  11. 11 . An information processing device comprising: at least one memory configured to store instructions; and at least one processor configured to execute instructions to: detect position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person; detect that the accessory is separated from the person based on the position information; detect a posture of the person after it is detected that the accessory is separated from the person and detect that the person is looking for the accessory based on the posture; and transmit notification information to an information processing terminal, the notification information including the posture of the person, wherein the at least one processor is configured to execute the instructions to detect that the accessory is separated from the person for a preset time or more.
  12. 12 . The information processing device according to claim 11 , wherein the at least one processor is configured to execute the instructions to detect the position information of the predetermined part of the person and the accessory by detecting a skeleton of the person from a captured image in which the person is captured.
  13. 13 . The information processing device according to claim 11 , wherein the at least one processor is configured to execute the instructions to detect that the accessory is separated from the person by a preset distance or more.
  14. 14 . The information processing device according to claim 11 , wherein the at least one processor is configured to execute the instructions to, when detecting that the accessory is separated from the person, perform a preset notifying process.
  15. 15 . The information processing device according to claim 11 , wherein the at least one processor is configured to execute the instructions detect a posture of the person after it is detected that the accessory is separated from the person.
  16. 16 . The information processing device according to claim 15 , wherein the at least one processor is configured to execute the instructions to, detect the posture of the person by detecting a skeleton of the person from a captured image in which the person is captured after it is detected that the accessory is separated from the person.
  17. 17 . The information processing device according to claim 16 , wherein the at least one processor is configured to execute the instructions to perform a preset second notifying process on a basis of the detected posture of the person.
  18. 18 . A non-transitory computer-readable medium storing thereon a program comprising instructions for causing an information processing device to execute processing to: detect position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person; detect that the accessory is separated from the person based on the position information; detect a posture of the person after it is detected that the accessory is separated from the person and detect that the person is looking for the accessory based on the posture; and transmit notification information to an information processing terminal, the notification information including the posture of the person, wherein the instructions further cause the information processing device to execute processing to detect that the accessory is separated from the person for a preset time or more.
  19. 19 . The detection method according to claim 1 , further comprising detecting that the person is looking for the accessory based on the posture of bending.
  20. 20 . The detection method according to claim 1 , further comprising detecting that the person is looking for the accessory based on the posture of a head position and an eye direction of the person.

Description

This application is a National Stage Entry of PCT/JP2020/011763 filed on Mar. 17, 2020, the contents of all of which are incorporated herein by reference, in their entirety. TECHNICAL FIELD The present invention relates to a detection method, a detection system, and a program for detecting a situation of a person having an accessory. BACKGROUND ART Persons with physical disabilities may use various tools for assisting their motions in their daily life. For example, a visually impaired person uses a white cane as a walking assisting tool. A white cane is used for checking safety at the tip of the cane for a visually impaired person, collecting information required for walking, acknowledging that he/she is a visually impaired person by those around, and the like. Meanwhile, a visually impaired person may be involved in a contact accident or a traffic accident. In particular, a white cane of a visually impaired person may come into contact with another person, a car, a bicycle, a train, or the like and may be involved in an accident. Therefore, when a white cane is used by a visually impaired person, there are may cases that a person does not hold the grip firmly in order not to be involved in an accident. As a result, an action that a white cane is separated from the hand of a visually impaired person may be caused. Patent Literature 1: JP 2019-16348 ANon-Patent Literature 1: Yadong Pan et & Shoji Nishimura, “Multi-Person Pose Estimation with Mid-Points for Human Detection under Real-World Surveillance”, The 5th Asian Conference on Pattern Recognition (ACPR 2019), 26-29 Nov. 2019 SUMMARY However, once a white cane is separated from the hand of a visually impaired person, it is difficult to pick it up thereafter. Accordingly, it is necessary to detect that a white cane is separated from the hand of a visually impaired person and that the visually impaired person is looking for a white cane, and to notify those around the person and assist the person. In Patent Literature 1, a sensor for detecting acceleration is mounted on a white cane, and drop of the white cane is detected from the detected acceleration. However, it is difficult to detect that a white cane is separated from a visually impaired person more accurately only with the acceleration of the white cane, which may cause erroneous detection. Moreover, in that case, it is impossible to detect a motion of looking for an accessory such as a white cane by a person. This causes a problem that it is impossible to detect a situation that a person may be in trouble such as dropping a white cane or looking for a white cane. Such a problem may be caused in a situation of holding any accessory without being limited to a person having a white cane. An object of the present invention is to provide a detection method, a detection system, and a program capable of solving the above-described problem, that is, a problem that it is impossible to detect a situation that a person having an accessory may be in trouble. A detection method according to one aspect of the present invention is configured to include detecting position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person, andbased on the position information, detecting that the accessory is separated from the person. Further, a detection system according to one aspect of the present invention is configured to include a position detection means for detecting position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person, anda separation detection means for detecting that the accessory is separated from the person based on the position information. Further, a program according to one aspect of the present invention is configured to cause an information processing device to realize a position detection means for detecting position information representing a position of a predetermined part of a person and a position of an accessory in a specific shape held by the person, andseparation detection means for detecting that the accessory is separated from the person based on the position information. With the configurations described above, the present invention can detect that an accessory is separated from a person with high accuracy. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 illustrates the overall configuration of an information processing system according to a first exemplary embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration of a detection device disclosed in FIG. 1. FIG. 3 illustrates a state of processing by the detection device disclosed in FIG. 1. FIG. 4 illustrates a state of processing by the detection device disclosed in FIG. 1. FIG. 5A is a flowchart illustrating an operation of the detection device disclosed in FIG. 1. FIG. 5B is a flowchart illustrating another exemplary operation of the detectio