JP-2026075415-A - Program, information processing device, and method

JP2026075415AJP 2026075415 AJP2026075415 AJP 2026075415AJP-2026075415-A

Abstract

[Problem] To photograph the worker's work status, analyze the captured images (videos) to generate display data for showing the worker's work status, and output the results. [Solution] The server 20 of the work analysis system 1 performs the following functions: acquiring video data (S101) of a worker performing a predetermined task; analyzing the acquired video data and determining the start and end times of work steps that indicate a process when the predetermined task performed by the worker captured in the acquired video data is divided into multiple processes (S102); dividing the acquired video data into work steps specified by the start and end times determined by the results of the determination (S103); generating display data (S104) for each work step and for each worker to display the work status of each worker; and outputting the generated display data (S105). [Selection Diagram] Figure 6

Inventors

太田良介
土屋紗輝
奥山昌紀
清水達也

Assignees

ブレインズテクノロジー株式会社
株式会社豊田自動織機

Dates

Publication Date: 20260508
Application Date: 20241022

Claims (14)

A program to be executed on a computer equipped with a processor and memory, for analyzing the work status of an employee, The program is provided to the processor: The steps include: acquiring video data of the worker performing a predetermined task, The steps include: analyzing the acquired video data and determining the start and end times of the work steps that represent the processes when the predetermined work performed by the worker, as captured in the acquired video data, is divided into multiple processes; The acquired video data is divided into work steps specified by the start and end times determined by the judgment result, and display data is generated for each work step and for each worker to display the work status of each worker. A program that executes the steps of outputting the generated display data.
In the step of outputting the generated display data, the display data for each work step is output as a list for each worker. The user selects from the displayed data for each of the aforementioned work steps, which is output as a list. The program according to claim 1, which outputs display data relating to the selected work step.
The program according to claim 2, wherein, in the step of outputting the generated display data, the program simultaneously outputs the display data of one worker and the display data of another worker related to the selected work step.
The program according to claim 2, wherein, in the step of outputting the generated display data, the program superimposes and outputs the display data of one worker and the display data of another worker related to the selected work step.
The aforementioned program, further, The acquired video data is analyzed, and the position of the worker's joints as captured in the acquired video data is estimated to extract the worker's skeletal data. The program according to any one of claims 1 to 4, wherein in the step of outputting generated display data, it outputs display data showing the movement of the worker's joints based on the extracted worker's skeletal data.
The program according to claim 5, wherein, in the step of outputting the generated display data, data indicating the characteristic quantities of joint movement of the worker, which are included in the extracted worker's skeletal data, is output.
The program according to claim 6, wherein, in the step of outputting the generated display data, it outputs data that includes one or more of the following as data indicating the characteristic quantities of the worker's joint movements: the trajectory of each joint of the worker, coordinates, velocity, distance traveled, operating time, operating rate, and the degree of influence on the time required for the work step.
The program according to claim 6, wherein, in the step of outputting the generated display data, data indicating the characteristic quantities of the movement of a predetermined joint of the operator is output in a different manner from data indicating the characteristic quantities of the movement of other joints.
The program according to claim 5, wherein, in the step of outputting the generated display data, it outputs display data showing the joint movements of one worker based on the extracted skeletal data of the worker, and display data showing the joint movements of other workers based on the skeletal data of other workers.
The program according to claim 9, wherein, in the step of outputting the generated display data, it outputs data showing the difference between data indicating the characteristic quantities of joint movement of one worker based on the extracted skeletal data of one worker and data indicating the characteristic quantities of joint movement of other workers based on the skeletal data of other workers.
The program according to claim 9, wherein, in the step of outputting the generated display data, the program outputs display data in which the difference between data showing the characteristic quantities of joint movement of one worker based on the extracted skeletal data of one worker and data showing the characteristic quantities of joint movement of other workers based on the skeletal data of other workers deviates by a predetermined value or more.
The program according to claim 5, wherein, in the step of outputting the generated display data, it outputs display data showing the movement of some of the joints of the worker, which is included in the extracted worker's skeletal data.
An information processing device comprising a control unit and a memory, which analyzes the work status of an worker, The control unit, The steps include: acquiring video data of the worker performing a predetermined task, The steps include: analyzing the acquired video data and determining the start and end times of the work steps that represent the processes when the predetermined work performed by the worker, as captured in the acquired video data, is divided into multiple processes; The acquired video data is divided into work steps specified by the start and end times determined by the judgment result, and display data is generated for each work step and for each worker to display the work status of each worker. An information processing device that performs the steps of outputting generated display data.
A method for analyzing the work status of an employee, which is performed by a computer having a processor and memory, The above method involves the processor, The steps include: acquiring video data of the worker performing a predetermined task, The steps include: analyzing the acquired video data and determining the start and end times of the work steps that represent the processes when the predetermined work performed by the worker, as captured in the acquired video data, is divided into multiple processes; The acquired video data is divided into work steps specified by the start and end times determined by the judgment result, and display data is generated for each work step and for each worker to display the work status of each worker. A method for performing the steps of outputting the generated display data.

Description

This disclosure relates to programs, information processing devices, and methods. To improve the quality of manufactured goods in factories and other facilities, and to enhance worker efficiency, the work of workers is being filmed and the recorded videos are being analyzed. Furthermore, AI (artificial intelligence) technology is being applied to this analysis. Patent Document 1 discloses a work support system for assisting workers performing tasks on-site, which analyzes the worker's posture from captured images and provides information corresponding to that posture. Japanese Patent Publication No. 2020-144776 This is a block diagram showing the overall configuration of the work analysis system 1 according to an embodiment of the present disclosure.This is a block diagram showing the functional configuration of the terminal device 10 in Figure 1.This is a block diagram showing the functional configuration of server 20 in Figure 1.Figure 3 shows an example of the data structure of the video database 2021.Figure 3 shows an example of the data structure of the display database 2022.This flowchart shows an example of the flow of display data output processing performed by the work analysis system 1.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This is a block diagram showing the functional configuration of the server 20 according to Embodiment 2 of the present disclosure.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This figure shows an example of a screen display for the data to be shown on the terminal device 10.This is a diagram showing the basic hardware configuration of computer 90. The embodiments of this disclosure will be described below with reference to the drawings. In all the drawings illustrating the embodiments, common components are denoted by the same reference numerals, and repeated explanations are omitted. The following embodiments are not intended to unduly limit the scope of the claims of this disclosure. Furthermore, not all components shown in the embodiments are necessarily essential components of this disclosure. Also, each drawing is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in the following explanation, "processor" refers to one or more processors. At least one processor is typically a microprocessor such as a CPU (Central Processing Unit), but may be another type of processor such as a GPU (Graphics Processing Unit). At least one processor may be single-core or multi-core. Furthermore, at least one processor may be a broad-sense processor, such as a hardware circuit that performs some or all of the processing (e.g., an FPGA (Field-Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit)). Furthermore, in the following explanation, the term "xxx database" may be used to describe information that yields an output for a given input. This information can be data of any structure, or it can be a learning model such as a neural network that generates an output for a given input. Therefore, "xxx database" can be referred to as "xxx information." Furthermore, in the following explanation, the table configurations for each database are examples only; a single table may be divided into two or more tables, or all or part of two or more tables may constitute a single table. Furthermore, in the following explanation, while "program" may be used as the subject to describe processing, since a program, when executed by a processor, performs defined processing using the memory and/or interface units as appropriate, the subject of the processing could also be the processor (or a device such as a controller containing that processor). The program may be installed on a device such as a computer, or it may reside on a program distribution server or a computer-readable (e.g., non-temporary) recording medium. Furthermore, in the following description, two or more programs may be implemented as a single program, or one program may be implemented as two or more programs. Furthermore, while identification numbers are used as identification information for various objects in the following explanation, other types of identification information (for example, identifiers containing letters or symbols) may also be used. Furthermore, in the following explanation, when describing similar elements without distinction, a reference code (or a common code