JP-7855555-B2 - Information processing device and program

Inventors

• 神谷 卓也
• 竹野 唯志
• 山崎 景太
• ミヤ タンダル

Assignees

• 東芝テック株式会社

Dates

Publication Date

20260508

Application Date

20230824

Claims (6)

1. An extraction unit extracts images of a worker performing a series of multiple types of tasks from a series of images capturing the worker's movements. An acquisition unit that acquires time-series information representing the characteristics of the worker's actions at each point in time, in chronological order, from each of the aforementioned work images, A matching unit compares the type of work and the timing of the switchover of the work with known example time-series information and associates points in time when the characteristics of the operation are similar. Based on the correspondence results of the aforementioned correspondence unit, a measurement unit measures the work time for each type of work with respect to the time-series information, Equipped with , The acquisition unit extracts feature vectors from the working image, calculates the relative distances between multiple feature locations on the working image corresponding to the feature elements of the extracted feature vectors, and acquires the time-series information by arranging the feature vectors, with the vectors representing the calculated relative distances added as new feature elements, in chronological order. The aforementioned plurality of feature locations include the location of at least one tool and the location of the worker's hand. Information processing device.
2. A first selection unit selects one of the target time series information from among the acquired time series information that is used to estimate the work type of multiple tasks and the switching time of those tasks. The system further comprises a second selection unit that selects one example time series from a plurality of example time series information, The matching unit associates the selected target time series information with the selected example time series information at points in time when the characteristics of the operation are similar. The measurement unit measures the work time for each type of work for the target time-series information based on the correspondence results. The information processing apparatus according to claim 1.
3. The acquisition unit associates the target time-series information and the model time-series information with work information that includes at least one of the following: worker identification information related to the target time-series information or model time-series information, worker work experience, worker work time, and product identification information related to the time-series information. The second selection unit selects the example time series information based on the similarity between the target time series information selected by the first selection unit and the work information associated with it. The information processing apparatus according to claim 2.
4. The memory control unit further comprises a memory unit that determines whether the time series information is the target time series information or the example time series information, and stores the time series information determined to be the target time series information as a first group and the time series information determined to be the example time series information as a second group in the memory unit. The first selection unit selects one of the target time-series information from the first group, The second selection unit, when a plurality of example time series information is stored as the second group, compares the target time series information selected by the first selection unit with the plurality of example time series information and selects the one example time series information that minimizes the matching cost. The information processing apparatus according to claim 2.
5. The memory control unit, if it satisfies at least one of the following conditions, that the cost of associating the target time series information with the example time series information stored in the memory device as the second group is less than a threshold, and that the difference in time length between the measured work time for each work type and the standard time for each work type is less than a threshold, then controls the target time series information to be used as the example time series information and move it from the first group to the second group. The information processing apparatus according to claim 4 .
6. Computers, An extraction unit extracts images of a worker performing a series of multiple types of tasks from a series of images capturing the worker's movements. An acquisition unit that acquires time-series information representing the characteristics of the worker's actions at each point in time, in chronological order, from each of the aforementioned work images, A matching unit compares the type of work and the timing of the switchover of the work with known example time-series information and associates points in time when the characteristics of the operation are similar. Based on the correspondence results of the aforementioned correspondence unit, a measurement unit measures the work time for each type of work with respect to the time-series information, It is a program that makes it function as such. The acquisition unit extracts feature vectors from the working image, calculates the relative distances between multiple feature locations on the working image corresponding to the feature elements of the extracted feature vectors, and acquires the time-series information by arranging the feature vectors, with the vectors representing the calculated relative distances added as new feature elements, in chronological order. The aforementioned plurality of feature locations include the location of at least one tool and the location of the worker's hand. program .

Description

Embodiments of the present invention relate to an information processing device and a program. Conventionally, devices for measuring the working time of workers on production lines are known. For example, such devices use cameras to identify the area where a worker is located, and if a worker is present in the area where the work object is located, the time spent there is measured as working time. However, with conventional work time measurement methods, if the relative position of the camera and the worker changes, it's possible that the system might incorrectly determine that the area where the work object is located and the area where the worker is located do not correspond, even though the worker is performing the work. In this case, the work time would not be measured correctly. Therefore, there is room for improvement in the accuracy of work time measurement. Figure 1 is a block diagram showing an example of the configuration of a work time measurement system according to an embodiment.Figure 2 is a block diagram showing an example of the functional configuration of the CPU of the work time measuring device according to the embodiment.Figure 3 illustrates an example of the process for acquiring work video according to this embodiment.Figure 4 illustrates an example of the time-series data acquisition process according to the embodiment.Figure 5 illustrates an example of time-series data storage processing according to this embodiment.Figure 6 illustrates an example of the selection process for target data and example data according to the embodiment.Figure 7 illustrates an example of the sample data extraction process according to the embodiment.Figure 8 illustrates an example of the correspondence process between target data and example data according to the embodiment.Figure 9 illustrates an example of the estimation process for work types and the timing of work type changes according to the embodiment.Figure 10 is a diagram illustrating an example of a work time measurement process according to the embodiment.Figure 11 illustrates an example of a process performed by a work time measuring device according to an embodiment.Figure 12 illustrates an example of the process performed by the work time measuring device according to Modification 1.Figure 13 illustrates an example of the process performed by the work time measuring device according to Modification 2.Figure 14 illustrates an example of the process performed by the work time measuring device according to Modification 3. The embodiments of the information processing device and program will be described in detail below with reference to the attached drawings. In the following embodiments, an example of applying the information processing device and program of the present invention to measuring the working time of workers performing various tasks on a production line will be described; however, the invention is not limited to this embodiment. Figure 1 is a block diagram showing an example of the configuration of the information processing system S according to this embodiment. The work management system 1 includes a work time measurement device 10, a work information server 20, and a network camera 30. The work time measurement device 10, the work information server 20, and the network camera 30 are connected via a network such as the Internet or a LAN (Local Area Network). The work information server 20 is a server device that manages information related to the work of workers. For example, it manages information regarding the work time of each worker. Furthermore, for example, the work information server 20 stores information regarding standard work times for each type of work. The network camera 30 is a camera that can connect to a network such as the internet or a LAN. Multiple network cameras 30 may be installed. The network cameras 30 are positioned to capture images of workers performing tasks on the production line. For example, the network camera 30 captures the work of workers on the production line. By using the network camera 30, it is possible to capture the work of workers even if they are working in a location far from the installation location of the work time measurement device 10 (described later). The time of capture is recorded in the images (videos) captured by the network camera 30. The work time measurement device 10 is a device that measures the work time of an employee. For example, the work time measurement device 10 measures the work time of an employee on a production line. The configuration of the work time measurement device 10 will be described below with reference to Figures 2 and 3. First, the hardware configuration of the work time measurement device 10 will be described. Figure 2 is a block diagram showing an example of the hardware configuration of the work time measurement device 10. As shown in Figure 2, the work time measurement device 10 comprises a CPU (Central Processing Unit) 11, RAM (Random Access Memo