JP-2026074603-A - Information processing system

JP2026074603AJP 2026074603 AJP2026074603 AJP 2026074603AJP-2026074603-A

Abstract

[Problem] To appropriately determine whether the cleaning work performed by the worker is being carried out by the cleaning equipment. [Solution] The information processing system 1000 includes an imaging unit 30 that photographs a predetermined monitoring area, a detection unit 21 that detects people and cleaning materials from the images captured by the imaging unit 30, and a determination unit 112 that determines the order of cleaning work for the person and the degree of cleaning based on a plurality of body areas set according to the size of the person detected by the detection unit 21 and the position of the cleaning material 80 within the body area. [Selection Diagram] Figure 3

Inventors

坂田茉実
吉澤将則
曾根慎悟

Assignees

コニカミノルタ株式会社

Dates

Publication Date: 20260507
Application Date: 20241021

Claims (20)

An imaging unit that photographs a designated monitoring area, A detection unit detects people and cleaning materials from the image captured by the aforementioned imaging unit, A determination unit determines the order of cleaning work on the person and the degree of cleaning based on a plurality of body areas set according to the size of the person detected by the detection unit and the position of the cleaning member within the body area. An information processing system equipped with the following features.
The detection unit acquires the skeletal information of the person, The information processing system according to claim 1, wherein the determination unit sets a plurality of body areas corresponding to body parts, each having a size corresponding to the size of the person, based on the skeletal information.
The aforementioned body area has a standard size set for each body part, The information processing system according to claim 2, wherein the reference size is changed based on the ratio of the length between predetermined positions of the skeletal information to a reference length, the body area is set with the changed size, and the changed body area is arranged according to the predetermined positions of the skeletal information.
The information processing system according to claim 3, comprising a first receiving unit that receives user-defined changes to the standard size of each body part and the position of the skeletal information relative to its location.
The information processing system according to claim 1, wherein the determination unit determines the degree of cleaning based on the movement time and movement trajectory of the cleaning member within the body area.
The information processing system according to claim 1, further comprising a notification unit for notifying the determination result obtained by the determination unit.
The information processing system according to claim 2, wherein, in multiple body areas, adjacent body areas are configured to overlap each other within a certain range.
The information processing system according to claim 7, wherein the determination unit determines that cleaning is in progress in any of the body areas when the cleaning member is continuously located within that body area for a predetermined period of time or longer.
It has a state transition model that shows the correct cleaning sequence for multiple body areas, The information processing system according to claim 7, wherein the determination unit determines the order of the cleaning work based on the position of the cleaning member within the body area using the state transition model.
The information processing system according to claim 9, wherein the determination unit determines, in the state transition model, that a state transition occurred during cleaning of a body area when the cleaning member is continuously located within any of the body areas for a predetermined period of time or longer.
The information processing system according to claim 10, wherein the determination unit detects a sequential error and counts it as an error when the state transitions in the direction set as an error in the state transition model.
The information processing system according to claim 11, wherein the determination unit does not determine the state transition if the cleaning member is present within the overlapping area of the body areas.
The information processing system according to claim 11, further comprising a second receiving unit that accepts user requests to change the settings for determining correctness of transition directions between states in the state transition model.
The detection unit acquires the skeletal information of the person, The information processing system according to claim 1, wherein the determination unit determines, based on the skeletal information, that the person's movement is a pre-registered gesture, and determines the start and end of the cleaning work.
The system includes a storage unit that stores time-series data, which associates the position information of the cleaning member from the start to the end of the cleaning operation with the classification result of the body area determined by the position information and a timestamp. The information processing system according to claim 3, wherein the determination unit includes an analysis unit that calculates feature quantities for determining the degree of cleaning for each body area using the stored time-series data.
The aforementioned feature quantity is divided by the area of the body area set to the adjusted size. The information processing system according to claim 15, wherein the determination unit determines the degree of cleaning based on the feature quantity after division.
The information processing system according to claim 16, wherein the feature quantity after division is normalized by a reference value set based on historical data.
Equipped with a news department, The determination unit determines whether cleaning is complete or incomplete for each body area by comparing the normalized feature quantity with a determination threshold for cleaning completion. The information processing system according to claim 17, wherein the notification unit outputs a display image showing the result of the determination in a manner that allows identification by assigning color coding or symbols to a pictogram representing a person.
The information processing system according to claim 18, further comprising a third reception unit for receiving user requests to change the setting of the judgment threshold.
The information processing system according to claim 18, wherein the notification unit outputs a display image superimposed on the person in the video, showing the results of the cleaning level determination for each body area in different colors or shades.

Description

This invention relates to an information processing system. In particular, this invention relates to an information processing system for evaluating the cleaning work performed by an employee upon entering a cleanroom. Conventionally, in cleanrooms with a high degree of cleanliness, such as those in food processing plants and precision equipment manufacturing plants, cleaning work is performed using cleaning tools to remove foreign matter adhering to the workers themselves or their work clothes, such as dustproof suits. The information processing device disclosed in Patent Document 1 uses an imaging unit to photograph the worker and extracts the worker's joint positions based on the captured image. This information processing system also detects the sanitary tools carried by the worker and recognizes the worker performing sanitary work using these tools. Based on the joint positions and the positions of the sanitary tools when sanitary work is recognized, the information processing system identifies the body parts being worked on. Furthermore, the system determines the completion of work for a body part when the sanitary work time for that body part exceeds the completion time set for that body part. Furthermore, in the cleanliness management method for cleanroom entrants disclosed in Patent Document 2, the subject's area and the area of the roller held by the subject are extracted by background difference analysis, which is achieved by comparing an acquired image including the subject taken in the examination room with a background image. Additionally, the relative movement of the roller relative to each body part of the subject's area is acquired and analyzed using optical flow to determine whether the roller application was performed appropriately. Japanese Patent Publication No. 2021-152758Japanese Patent Publication No. 2018-005464 The advantages and features provided by one or more embodiments of the present invention will be better understood from the following detailed description and accompanying drawings. However, these are for illustrative purposes only and are not intended to limit the present invention. This is an overall block diagram showing the configuration of the information processing system according to this embodiment. This is a schematic diagram showing workers in a monitoring area. This is a functional block diagram showing the functions of the control unit. Figure 4(a) is a schematic diagram showing an example of video data obtained by filming. Figure 4(b) is a schematic diagram showing skeletal information detected from the video data. This is a schematic diagram showing the defined body area. This is a schematic diagram showing the defined body area. This diagram shows the movements involved in cleaning the upper body. This diagram shows the movements involved in cleaning the lower body. This is a schematic diagram illustrating the specific treatment 1 for cleaning components. This is a schematic diagram illustrating the specific treatment 2 for cleaning components. This is a schematic diagram showing the relationship between the position of the cleaning component and the specified cleaning area. This is an example of time-series data. This flowchart shows the cleaning sequence and cleaning level determination process performed by the information processing system. This is a subroutine flowchart showing the process in step S08 of Figure 11. This figure shows the state transition model used to determine the cleaning order. This is a subroutine flowchart showing the process in step S20 of Figure 12. This figure shows time-series data where label transitions are recorded. This is the data showing the range of each label in the time series data from Figure 14B. This is an example of the evaluation results for cleaning order. This is a subroutine flowchart showing the process in step S09 of Figure 11. This is an example of an evaluation result for the level of cleanliness. This is a schematic diagram showing an example of a displayed image. This is a schematic diagram showing an example of a displayed image. This is a schematic diagram showing an example of a displayed image. This is a schematic diagram showing an example of a displayed image. The embodiments of the present invention will be described below with reference to the attached drawings. However, the scope of the present invention is not limited to the disclosed embodiments. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted. Furthermore, the dimensional ratios in the drawings are exaggerated for illustrative purposes and may differ from actual ratios. Figure 1 is an overall block diagram showing the configuration of the information processing system 1000 according to this embodiment. Figure 2 is a schematic diagram showing a cleaner in the monitoring area. The information processing system 1000 includes a first information processing device