CN-115690158-B - Method, device, system and storage medium for early warning of road closing safety under road closing

CN115690158BCN 115690158 BCN115690158 BCN 115690158BCN-115690158-B

Abstract

The application provides a method, a device, a system and a storage medium for early warning of road closing safety under road closing, and relates to the technical field of image processing. The method comprises the steps of carrying out safety early warning on a closing road of mechanical equipment provided with a lifting appliance, lifting the lifting appliance with a target, acquiring a first video frame of a closing road monitoring video of the mechanical equipment in real time, determining a first monitoring area corresponding to the first video frame according to early warning time length, first position information of the target in the first video frame and moving speed of the target, and outputting safety early warning information in the first video frame in response to the fact that a first object is detected to be located in the first monitoring area, wherein the first object comprises a pedestrian and/or a truck head. According to the application, the dangerous areas of falling of the lifting appliance and the suspended goods can be predicted more accurately, and early warning is carried out on site personnel and vehicles in advance before the lifting appliance and the suspended goods possibly fall, so that relevant personnel are reminded to avoid, sufficient time is provided for hidden danger treatment, and advanced early warning is realized.

Inventors

ZHAO KAIKAI
LIU ZHAOXIANG
LIAN SHIGUO

Assignees

中国联合网络通信集团有限公司
联通数字科技有限公司

Dates

Publication Date: 20260512
Application Date: 20221104

Claims (8)

1. The utility model provides a close safety precaution method of closing down close way which characterized in that is used for carrying out safety precaution to the close down close way of mechanical equipment who is equipped with hoist, the hoist hangs the target, close down close way and refer to the region under the hoist and motion area thereof, safety precaution method includes: Acquiring a first video frame of a closing road monitoring video of the mechanical equipment in real time; Initializing an initial monitoring area corresponding to a first video frame according to first position information of a target in the first video frame, wherein the initial monitoring area comprises a projection area corresponding to the first position information; Updating a monitoring area corresponding to the first video frame into a first monitoring area according to the early warning duration, the initial monitoring area and the moving speed of the target, wherein the moving speed is a vector obtained by tracking the target by adopting a target tracking algorithm, and the first monitoring area comprises a projection area corresponding to the first position information and a moving area of the target in the early warning duration; in the first video frame, in response to detecting that a first object is located in the first monitoring area, outputting safety pre-warning information, wherein the first object comprises a pedestrian and/or a truck head; Updating the monitoring area corresponding to the first video frame to be a first monitoring area according to the early warning duration, the initial monitoring area and the moving speed, including: updating the monitoring area corresponding to the first video frame into a first monitoring area according to the following formula: Wherein the moving speed is The speeds resolved into the x-axis direction and the y-axis direction are respectively And , For the upper left corner of the initial monitored area, For the lower right angular position of the initial monitoring area, For the upper left corner of the first monitored area, For the lower right angular position of the first monitoring area, And And the boundary length and width dimensions of the frame pictures of the first video frame are respectively t is the early warning duration.
2. The safety precaution method according to claim 1, wherein updating the monitoring area corresponding to the first video frame to be the first monitoring area according to the early warning duration, the initial monitoring area and the moving speed comprises: based on the following updating principle, according to the early warning time length, the initial monitoring area and the moving speed, updating the monitoring area corresponding to the first video frame into a first monitoring area: increasing the area in the moving direction, and increasing the ratio of the area as the absolute value of the moving speed is larger; The area in the opposite direction of the moving direction is reduced, and the larger the absolute value of the moving speed is, the larger the proportion of the area is reduced; the dimension perpendicular to the moving direction is consistent with the initial monitoring area; the first monitoring area does not exceed the maximum boundary range of the frame picture of the first video frame.
3. The safety precaution method according to claim 1, wherein the video frame in which the target is initially monitored is a second video frame, the position of the target in the second video frame is second position information, and the moving speed is determined according to the following manner: Tracking the target in a plurality of third video frames after the second video frame by adopting a target tracking algorithm to obtain third position information of the target in the corresponding third video frames; and determining the moving speed of the target according to the second position information and the third position information corresponding to the plurality of third video frames.
4. A safety precaution method according to any of claims 1 to 3, further comprising: In response to detecting the target in a second video frame of the off-road monitoring video, determining a second monitoring area corresponding to the second video frame based on second position information of the target in the second video frame, wherein the second monitoring area comprises a projection monitoring area corresponding to the second position information; And in the second video frame, outputting safety early warning information in response to detecting that a second object is positioned in the second monitoring area.
5. The method of claim 4, wherein determining a second monitoring area based on second location information of the target in the second video frame comprises: determining the center point coordinates of the second monitoring area as the center point coordinates contained in the second position information; determining that the width of the second monitoring area is a first multiple of the width contained in the second position information; determining that the length of the second monitoring area is a second multiple of the length contained in the second position information; Wherein the first multiple and the second multiple are each greater than or equal to 1.
6. The utility model provides a close safety precaution device of closing way down for close way to the mechanical equipment who is equipped with hoist carries out safety precaution, the hoist hangs the target, close down and close the way and be referred to the region under the hoist and the region of its motion, safety precaution device includes: The acquisition module is used for acquiring a first video frame of the off-road monitoring video of the mechanical equipment in real time; The determining module is used for initializing an initial monitoring area corresponding to a first video frame according to first position information of a target in the first video frame, wherein the initial monitoring area comprises a projection area corresponding to the first position information; updating a monitoring area corresponding to the first video frame into a first monitoring area according to the early warning duration, the initial monitoring area and the moving speed of the target, wherein the moving speed is a vector obtained by tracking the target by adopting a target tracking algorithm, and the first monitoring area comprises a projection area corresponding to the first position information and a moving area of the target in the early warning duration; the output module is used for outputting safety early warning information in the first video frame in response to the fact that a first object is detected to be located in the first monitoring area, wherein the first object comprises pedestrians and/or truck collecting heads; the determining module is specifically further configured to update, according to an early warning duration, the initial monitoring area, and the moving speed, a monitoring area corresponding to the first video frame to be a first monitoring area, where the determining module includes: updating the monitoring area corresponding to the first video frame into a first monitoring area according to the following formula: Wherein the moving speed is The speeds resolved into the x-axis direction and the y-axis direction are respectively And , For the upper left corner of the initial monitored area, For the lower right angular position of the initial monitoring area, For the upper left corner of the first monitored area, For the lower right angular position of the first monitoring area, And And the boundary length and width dimensions of the frame pictures of the first video frame are respectively t is the early warning duration.
7. An electronic device is characterized by comprising a memory and a processor; the memory is used for storing program instructions; the processor is configured to invoke the program instructions to perform the safety precaution method of any of claims 1 to 5.
8. A computer readable storage medium having stored therein computer executable instructions which when executed are adapted to implement the security pre-warning method of any one of claims 1 to 5.

Description

Method, device, system and storage medium for early warning of road closing safety under road closing Technical Field The present application relates to the field of image processing technologies, and in particular, to a method, an apparatus, a system, and a storage medium for early warning of road closing security. Background Along with the continuous development of scientific technology, the traditional port creates a new generation of intelligent port with safety, high efficiency, intelligence and ecology through the deep fusion application of new generation information technologies such as 5G, block chain, internet of things, big data, cloud computing, artificial intelligence and the like, and promotes the port and navigation logistics resource linkage, so that the port and navigation logistics resource linkage becomes an important measure for constructing differentiated value claims and competitive advantages. In practical application, mechanical devices of a port include a gantry crane, a quay crane, a portal crane, a crane and the like, when the mechanical devices are operated, a lifting appliance can move in any direction in the air, if a person or a truck head and other objects are involved in closing a road, the lifting appliance and the lifted goods can fall to hit the objects, and the mechanical devices can collide with the objects during movement to cause serious safety accidents, wherein the closing road refers to the area under the lifting appliance and the movement area thereof. Therefore, how to automatically, timely and accurately perform safety pre-warning on the objects which are close to the road, remind related personnel to avoid safety accidents, and the method is particularly important in intelligent ports. In the related technology, when safety precaution is carried out, the object lifted by the lifting appliance is identified to be a hatch board or a container to calculate the projection dangerous area of the object on the ground, and when personnel or a truck head exists in the projection dangerous area, the precaution treatment is carried out, and the problem of untimely precaution exists. Disclosure of Invention The application provides a method, a device, a system and a storage medium for early warning of off-road safety, which are used for solving the problem of untimely early warning. The application provides a safety early warning method for closing a road, which is used for carrying out safety early warning on the closing road of mechanical equipment provided with a lifting appliance, wherein the lifting appliance is provided with a target, and the safety early warning method comprises the steps of acquiring a first video frame of a closing road monitoring video of the mechanical equipment in real time; according to the early warning time length, first position information of a target in a first video frame and the moving speed of the target, a first monitoring area corresponding to the first video frame is determined, the moving speed is a vector obtained by tracking the target by adopting a target tracking algorithm, the first monitoring area comprises a projection area corresponding to the first position information and a moving area of the target in the early warning time length, in the first video frame, in response to the fact that a first object is detected to be located in the first monitoring area, safety early warning information is output, and the first object comprises a pedestrian and/or a truck head. Optionally, determining a first monitoring area corresponding to the first video frame according to the early warning time length, the first position information of the target in the first video frame and the moving speed of the target comprises initializing an initial monitoring area corresponding to the first video frame according to the first position information, wherein the initial monitoring area comprises a projection area corresponding to the first position information, and updating the monitoring area corresponding to the first video frame to be the first monitoring area according to the early warning time length, the initial monitoring area and the moving speed. Optionally, updating the monitoring area corresponding to the first video frame to be the first monitoring area according to the initial monitoring area and the moving speed comprises updating the monitoring area corresponding to the first video frame to be the first monitoring area according to the early warning time length, the initial monitoring area and the moving speed based on the updating principle that the larger the absolute value of the moving speed is, the larger the proportion of the area is increased, the area in the opposite direction of the moving direction is reduced, the larger the absolute value of the moving speed is, the larger the proportion of the area is reduced, the dimension in the direction perpendicular to the moving direction is consistent with the initial monitoring a