CN-121148019-B - Computer vision-based unsafe behavior identification method for water conservancy construction site personnel

CN121148019BCN 121148019 BCN121148019 BCN 121148019BCN-121148019-B

Abstract

The invention discloses a computer vision-based unsafe behavior identification method for water conservancy construction site personnel, which relates to the technical field of image analysis and comprises the steps of forming standard construction actions of operation steps, analyzing dangerous operation areas of operation projects, forming safe operation sets of the operation steps, obtaining actual actions, identifying target operation projects of the site personnel, generating non-operation areas, obtaining effective actual actions and ineffective actual actions, pairing the effective actual actions with the operation steps of the target operation projects, and identifying the safety of the effective actual actions corresponding to the operation steps by utilizing the safe operation sets of the operation steps. By forming a safe operation set of the operation steps, generating a non-operation area and obtaining effective actual actions and ineffective actual actions, actions which are not completely fixed by on-site personnel can be accurately identified according to the effective actual actions and interference of the ineffective actual actions on unsafe behavior identification can be eliminated.

Inventors

HUANG QIMING
SHEN XIN
FU WENHUI
BAI YAQI
YUAN XUEFENG

Assignees

盐城市大丰区水利工程建设中心

Dates

Publication Date: 20260512
Application Date: 20251028

Claims (10)

1. The method for identifying unsafe behaviors of water conservancy construction site personnel based on computer vision is characterized by comprising the following steps of: acquiring at least one operation project of water conservancy construction, acquiring at least one operation step of the operation project, forming standard construction actions of the operation step, and analyzing to obtain at least one dangerous operation area of the operation project; forming a safety operation set of operation steps based on standard construction actions and dangerous operation areas, wherein the safety operation set is composed of at least one safety construction action; acquiring the current position of the field personnel, identifying the continuous action of the field personnel at the current position to obtain at least one actual action, and identifying the target operation project of the field personnel according to the actual action; Generating a non-working area based on the arm size of the field personnel and the target working item; Classifying the actual actions based on the non-operation area to obtain effective actual actions and ineffective actual actions; pairing the effective actual action with the operation steps of the target operation project, and identifying the safety of the effective actual action corresponding to the operation steps by utilizing the safety operation set of the operation steps.
2. The computer vision-based method for identifying unsafe behavior of water conservancy construction site personnel according to claim 1, wherein the standard construction actions of the forming operation step comprise the following steps: Acquiring the history standard operation of at least one constructor of the operation project, acquiring the operation position of the operation step of the operation project, acquiring the operation position of the history standard operation, and matching the history standard operation to the operation step of the operation project with the smallest difference with the operation position of the operation step; and selecting one of at least one history standard operation corresponding to the operation step as a standard construction action of the operation step.
3. The computer vision-based method for identifying unsafe behavior of water conservancy construction site personnel according to claim 2, wherein the analyzing at least one dangerous work area of the work item comprises the following steps: Acquiring at least one historical non-standard operation of a job project, and acquiring unsafe events caused by the historical non-standard operation; Taking the position of the unsafe event in the operation project as an unsafe point and taking the maximum size of the hand length of the historic constructors as a characteristic distance; Forming an unsafe circle, wherein the circle center of the unsafe circle is an unsafe point, and the radius of the unsafe circle is equal to the characteristic distance; If the two unsafe circles have overlapping parts, merging the two unsafe circles, otherwise, not performing any treatment; At least one area obtained by combining unsafe circles is used as a dangerous operation area.
4. A computer vision based method for identifying unsafe behavior of water conservancy construction site personnel according to claim 3, wherein the forming the safe working set of the operation steps based on standard construction actions and dangerous working areas comprises the steps of: Identifying positions of the left hand and the left shoulder of a constructor in standard construction actions, and taking the positions as a first hand position and a first shoulder position respectively; Identifying positions of the right hand and the right shoulder of a constructor in standard construction actions, and respectively taking the positions as a second hand position and a second shoulder position in sequence; uniformly taking at least one identification point in a construction area where constructors are located, and randomly selecting two different identification points to be used as a first elbow position and a second elbow position respectively; taking the distance from the left hand of the constructor to the left elbow joint as a first distance and the distance from the left shoulder of the constructor to the left elbow joint as a second distance; if the distance from the first hand position to the first elbow position is equal to the first distance and the distance from the first shoulder position to the first elbow position is equal to the second distance, the first elbow position is taken as a first target elbow position, otherwise, no treatment is carried out; an operation of sequentially connecting the first hand position, the first target elbow position, and the first shoulder position to form a left operation, and if the left operation does not pass through the dangerous work area, setting the left operation as a left target operation; If the distance from the second hand position to the second elbow position is equal to the first distance and the distance from the second shoulder position to the second elbow position is equal to the second distance, the second elbow position is taken as a second target elbow position, otherwise, no treatment is carried out; an operation of sequentially connecting the second hand position, the second target elbow position, and the second shoulder position to form a right operation, wherein if the right operation does not pass through the dangerous work area, the right operation is set as a right target operation; at least one of the left target actions and one of the right target actions are randomly combined to form at least one safety construction action, and the safety operation sets of the operation steps corresponding to the standard construction actions are formed in a summarizing mode.
5. The method for identifying unsafe behavior of a water conservancy construction site personnel based on computer vision according to claim 4, wherein the step of identifying continuous actions of the site personnel at the current position to obtain at least one actual action comprises the following steps: At least one datum point is uniformly acquired in the working time of the field personnel, and action acquisition is carried out at the moment equal to the datum point, so that at least one actual action is obtained.
6. The method for identifying unsafe behavior of water conservancy construction site personnel based on computer vision according to claim 5, wherein the step of identifying the target work item of the site personnel according to the actual action comprises the following steps: capturing the hand position of the field personnel at the current position, and taking the moment when the hand position of the field personnel changes as the characteristic moment; Using adjacent characteristic moments as endpoints to form at least one characteristic interval, and summarizing actual actions of which the occurrence time belongs to the same characteristic interval to form at least one actual action set; Taking one of the actual actions in the actual action set as a target actual action, and taking the left hand position and the right hand position of the target actual action as a first position to be identified and a second position to be identified in sequence respectively; If the first position to be identified is consistent with the first hand position and the second position to be identified is consistent with the second hand position, taking the standard construction action as a target standard construction action; And taking the work item with the largest number of included target standard construction actions as a target work item of the field personnel.
7. The computer vision based water conservancy construction site personnel unsafe behavior identification method of claim 6, wherein the generating a non-working area based on the arm size of the site personnel and the target working item comprises the following steps: Acquiring the length of the whole arm of the field personnel as a characteristic length, and taking the space range occupied by the building entity after the completion of the target operation project as a target operation area; Uniformly taking at least one target point in a target operation area, and taking the point in the space as a characteristic point if the distance from the point in the space to one of the target points does not exceed the characteristic length; At least one characteristic point is summarized to form a work continuation area, and an area outside the work continuation area is used as a non-work area.
8. The method for identifying unsafe behaviors of water conservancy construction site personnel based on computer vision according to claim 7, wherein the classifying the actual actions to obtain the effective actual actions and the ineffective actual actions comprises the following steps: and acquiring the actual position of the field personnel when the field personnel performs the actual action, if the actual position is in the non-working area, taking the actual action as an invalid actual action, otherwise, taking the actual action as an effective actual action.
9. The computer vision-based water conservancy construction site personnel unsafe behavior identification method according to claim 8, wherein the pairing of the effective actual actions with the operation steps of the target work item comprises the following steps: Acquiring the superposition proportion of the effective actual action and the safe construction action, and taking the average value of the superposition proportion of the safe construction action and the effective actual action in the safe operation set of the operation step to obtain the verification value of the operation step and the effective actual action; Pairing the effective actual action to the operation step with the maximum check value of the effective actual action in the target operation project.
10. The method for identifying unsafe behavior of water conservancy construction site personnel based on computer vision according to claim 9, wherein the identifying the safety of the effective actual action corresponding to the operation step comprises the following steps: Randomly selecting one of standard construction actions as a sample action, and acquiring a reproduction action generated by repeating the sample action at least once by constructors in advance; subtracting the superposition ratio of the reproduction action and the sample action to obtain an error ratio, and taking the maximum value of the error ratio as an allowable error; if the superposition ratio of the effective actual action and one of the safety construction actions of the safety operation set of the corresponding operation step is not more than the allowable error, judging that the effective actual action is the safety action, otherwise, judging that the effective actual action is the unsafe action.

Description

Computer vision-based unsafe behavior identification method for water conservancy construction site personnel Technical Field The invention relates to the technical field of image analysis, in particular to a computer vision-based unsafe behavior identification method for water conservancy construction site personnel. Background The hydraulic engineering is a general term of various engineering constructed for controlling and utilizing water resources and preventing and controlling water damage. The core is that the water in the nature is allocated, controlled, utilized and protected by engineering technology means. However, the working procedures related to hydraulic engineering construction are complex, when working procedures are completed, the actions of operators are not completely fixed, and the operators have actions irrelevant to the construction, so that the problems of unsafe construction existing in the operations are difficult to accurately identify. Disclosure of Invention In order to solve the technical problems, the method for identifying unsafe behaviors of water conservancy construction site personnel based on computer vision is provided, and the technical scheme solves the problems in the background technology. In order to achieve the above purpose, the invention adopts the following technical scheme: the computer vision-based water conservancy construction site personnel unsafe behavior identification method comprises the following steps: acquiring at least one operation project of water conservancy construction, acquiring at least one operation step of the operation project, forming standard construction actions of the operation step, and analyzing to obtain at least one dangerous operation area of the operation project; forming a safety operation set of operation steps based on standard construction actions and dangerous operation areas, wherein the safety operation set is composed of at least one safety construction action; acquiring the current position of the field personnel, identifying the continuous action of the field personnel at the current position to obtain at least one actual action, and identifying the target operation project of the field personnel according to the actual action; Generating a non-working area based on the arm size of the field personnel and the target working item; Classifying the actual actions based on the non-operation area to obtain effective actual actions and ineffective actual actions; pairing the effective actual action with the operation steps of the target operation project, and identifying the safety of the effective actual action corresponding to the operation steps by utilizing the safety operation set of the operation steps. Preferably, the standard construction action of the forming operation step includes the steps of: Acquiring the history standard operation of at least one constructor of the operation project, acquiring the operation position of the operation step of the operation project, acquiring the operation position of the history standard operation, and matching the history standard operation to the operation step of the operation project with the smallest difference with the operation position of the operation step; and selecting one of at least one history standard operation corresponding to the operation step as a standard construction action of the operation step. Preferably, the analyzing the at least one dangerous work area of the work item comprises the steps of: Acquiring at least one historical non-standard operation of a job project, and acquiring unsafe events caused by the historical non-standard operation; Taking the position of the unsafe event in the operation project as an unsafe point and taking the maximum size of the hand length of the historic constructors as a characteristic distance; Forming an unsafe circle, wherein the circle center of the unsafe circle is an unsafe point, and the radius of the unsafe circle is equal to the characteristic distance; If the two unsafe circles have overlapping parts, merging the two unsafe circles, otherwise, not performing any treatment; At least one area obtained by combining unsafe circles is used as a dangerous operation area. Preferably, the forming the safety work set of the operation steps based on the standard construction action and the dangerous work area comprises the following steps: Identifying positions of the left hand and the left shoulder of a constructor in standard construction actions, and taking the positions as a first hand position and a first shoulder position respectively; Identifying positions of the right hand and the right shoulder of a constructor in standard construction actions, and respectively taking the positions as a second hand position and a second shoulder position in sequence; uniformly taking at least one identification point in a construction area where constructors are located, and randomly selecting two different identification points