Search

JP-7855487-B2 - Behavioral analysis system and behavioral analysis method

JP7855487B2JP 7855487 B2JP7855487 B2JP 7855487B2JP-7855487-B2

Inventors

  • 李 媛

Assignees

  • 株式会社日立製作所

Dates

Publication Date
20260508
Application Date
20221013

Claims (8)

  1. A sample video input section for inputting sample videos, A subject video input unit for inputting subject video, An evaluation timing determination unit that determines the evaluation timing by selecting a subject image frame for evaluating the subject's actions from multiple image frames included in the subject video, A similarity evaluation unit compares the selected subject image frame with a sample image frame included in the sample video that corresponds to the subject image frame, and evaluates the degree of similarity. A person identification unit receives the data of the sample video and the subject video, and identifies the subject as the person corresponding to the sample. A posture extraction unit that extracts the posture of the person identified by the person identification unit, The system includes an evaluation action identification unit that, from the posture extracted by the posture extraction unit, identifies a part of the sample action that is performed in the sample but is not performed in the action of the target person targeted by the similarity evaluation unit, and identifies the reason why the action is not performed in the action of the target person or the action that could not be performed, The evaluation timing identification unit is an action analysis system that selects the subject image frame based on an image frame relating to a predetermined action that is included in the subject video and an image frame relating to the predetermined action that is included in the sample video.
  2. The behavioral analysis system according to claim 1, further comprising an output unit that outputs results including the aforementioned similarity score.
  3. The behavioral analysis system according to claim 1, wherein the evaluation timing specification unit selects the subject image frame using a dynamic time stretching method or a method employing artificial intelligence.
  4. The behavioral analysis system according to claim 1, further comprising a comprehensive similarity determination unit that determines the overall similarity between the subject's actions and the sample actions using data obtained from the similarity evaluation unit and the evaluation action identification unit.
  5. The sample video input unit receives a sample video, The subject video input unit inputs the subject's video, The evaluation timing determination unit determines the evaluation timing by selecting a subject image frame for evaluating the subject's actions from multiple image frames included in the subject video. The similarity evaluation unit compares the selected subject image frame with the sample image frame included in the sample video that corresponds to the subject image frame, and evaluates the similarity. The designated person selection unit receives the sample video and the target person video data, identifies the target person as the person corresponding to the sample, The posture extraction unit extracts the posture of the person identified by the specific person selection unit, The evaluation action identification unit identifies, from the posture extracted by the posture extraction unit, a part of the sample action that is performed in the sample but is not performed in the action of the subject targeted by the similarity evaluation unit, and identifies the reason why the action is not performed in the action of the subject or the action that could not be performed. The evaluation timing identification unit selects the subject image frame based on an image frame relating to a predetermined action that is included in the subject video and an image frame relating to the predetermined action that is included in the sample video.
  6. The behavioral analysis method according to claim 5 , wherein the output unit outputs results including the similarity score.
  7. The behavioral analysis method according to claim 5 , wherein the evaluation timing identification unit selects the subject image frame by a method using dynamic time stretching or artificial intelligence.
  8. The behavioral analysis method according to claim 5 , wherein the similarity comprehensive determination unit determines the overall similarity between the subject's behavior and the sample's behavior using the data obtained by the similarity evaluation unit and the evaluation behavior identification unit.

Description

This disclosure relates to a behavioral analysis system and a behavioral analysis method. With more people exercising at home, services that provide remote exercise monitoring and support, rather than in person, are being considered. Patent Document 1 discloses a motion similarity evaluation device that extracts skeletal information for each motion from example videos and imitation videos, and evaluates the similarity of each motion based on the similarity of each skeletal information at the synchronization time. This enables accurate motion similarity evaluation regardless of differences in body shape, clothing, or height between the model in the example video and the user. Japanese Patent Publication No. 2020-195648 This is a diagram showing the behavioral analysis system of Example 1.Figure 1 is a flowchart illustrating the process for determining the evaluation timing in the behavioral analysis system.Figure 1 is a flowchart showing the process in the evaluation operation identification unit 22.This is a flowchart that schematically shows the specific process of Example 1.This is a diagram showing the behavioral analysis system of Example 2.This is a diagram showing the behavioral analysis system of Example 3.This is a diagram showing the main components of the behavioral analysis system of Example 4.This is a diagram showing the main components of the behavioral analysis system of Example 5.This is a diagram showing the main components of the behavioral analysis system of Example 6.This diagram shows the overall configuration of the behavioral analysis system related to this disclosure. The following describes an example using drawings.