US-12627123-B2 - Electric patrol inspection control method and system based on unmanned aerial vehicle

US12627123B2US 12627123 B2US12627123 B2US 12627123B2US-12627123-B2

Abstract

Disclosed are an electric patrol inspection control method and an electric patrol inspection control system based on an unmanned aerial vehicle. The method includes: formulating a flight path according to an electric patrol inspection area, collecting an image and position information, and transmitting the image and the position information to a receiving terminal of a ground station in a form of wireless transmission; obtaining analysis on defects, damages and corrosion of the electric device, processing and analyzing the image, and then obtaining analysis situations; and generating a patrol inspection electronic report, and at the same time, giving the service life, maintenance expense, maintenance measure of the electric device according to the patrol inspection electronic report, informing maintenance personnel of the position information of the electric device. The system includes an UAV control module, an image processing and analyzing module and a patrol and examine electronic reports generation module.

Inventors

Cheng Xu
Yunsheng Xu
Jun Tang
Yu Xiao
Xiaomi ZHU
Xingchen XIANG
Chengshi HE
Chen Li

Assignees

Three Gorges Hi-Tech Information Technology Co., Ltd

Dates

Publication Date: 20260512
Application Date: 20240920
Priority Date: 20240412

Claims (7)

1 . An electric patrol inspection control method based on an unmanned aerial vehicle, comprising the following steps of: formulating a flight path according to an electric patrol inspection area, collecting an image and position information of an electric device by a plurality of types of devices equipped on the unmanned aerial vehicle, and transmitting the image and the position information to a receiving terminal of a ground station in a form of wireless transmission; receiving, by the ground station, the real-time collected image and position information, processing and analyzing the image, and then obtaining analysis on defects, damages and corrosion of the electric device; and generating a patrol inspection electronic report comprising the analysis situations of a plurality of electric devices according to the analysis situation of the ground station and the position information as a distinguishing characteristic; wherein a process of formulating the flight path for the electric patrol inspection area comprises the following steps of: acquiring an electric device distribution map in the electric patrol inspection area, and at the same time acquiring position coordinates of various electric devices, to constitute a training trajectory dataset; inputting the training trajectory dataset to a flight path generation model, to generate a flight path in real time, and inputting the flight path to a controller of the unmanned aerial vehicle; and minimizing time that the unmanned aerial vehicle completes the specified electric patrol inspection area in combination with wireless transmission power and the flight path of the unmanned aerial vehicle; and performing a trial flight on the unmanned aerial vehicle according to the flight path, to check the time; wherein a process of generating the flight path comprises the following steps of: continuing the plurality of flight path nodes to obtain a flight route of the adjacent flight path nodes, dividing the flight route into a plurality of grids, and constructing a flight path background field comprising the plurality of grids; acquiring, by a laser radar, geographical environment data of the electric patrol inspection area, preprocessing the geographical environment data, constructing a geographical environment background field of the electric patrol inspection area, and dividing the geographical environment background field into a plurality of grids; and merging the grids of the flight path background field with the grids of the geographical environment background field to form a grid matrix, judging a significance of a flight direction of the unmanned aerial vehicle based on the grids in the grid matrix, and confirming whether fly-around is required or not in the current geographical environment; wherein a process of processing and analyzing the image comprises the following steps of: preprocessing the received image, wherein the preprocessing comprises operations of image denoising, enhancing a contrast ratio and adjusting a brightness, the electric device in the image is subjected to object detection and segmentation, to identify and position a position and a bounding box of the electric device; extracting a target characteristic related to a defect, damage and corrosion in a segmented electric device area, and transforming the image information into a characteristic vector capable of being quantified and analyzed, wherein the target characteristic comprises a texture characteristic, a shape characteristic and a color characteristic; performing a defect analysis and a classification on the extracted target characteristic by using a classifier, judging the defect, damage, corrosion and other situations of the electric device according to the characteristic vector, and giving a corresponding judgment result; wherein a process of extracting the target characteristic related to the defect, damage and corrosion comprises the following steps of: identifying a target characteristic of the characteristic in the segmented electric device area, extracting the target characteristic of a segmented to-be-identified electric device image and a segmented preset electric device image, to obtain a plurality of characteristic vectors, wherein the characteristic vectors correspond to texture characteristic, shape characteristic and color characteristic information of the segmented to-be-detected electric device image; calculating a similarity of the characteristic vectors of the segmented to-be-identified electric device image and the segmented preset electric device image under the texture characteristic, shape characteristic and color characteristic of the same electric device image, to obtain a first similarity of the texture similarity, a second similarity of the shape similarity and a third similarity of the color similarity, wherein a computed expression of the similarity Sim(L p ,L q ) is Sim ⁢ ( L p , L q , L s ) = 2 ⁢ ∑ k = 1 N ⁢ min ⁡ ( i pk , i qk , i s ⁢ k ) ∑ k = 1 N ⁢ ( i p ⁢ k + i q ⁢ k + i s ⁢ k ) ; wherein L p , L q , L s correspond to the characteristic vectors of the texture characteristic, shape characteristic and color characteristic in respective, i pk represents a k th element of the texture characteristic vector L p , i qk represents a k th element of the shape characteristic vector L p , i sk represents a k th element of the color characteristic vector L s , min(⋅) represents a function taking the minimum, N represents the number of elements in the characteristic vectors, specifically for the texture characteristic, shape characteristic and color characteristic, each element in the characteristic vectors corresponds to a certain specific quantified quantity or statistic quantity of the respective characteristic; for the texture characteristic, each element possibly represents a value of a certain texture statistic indicator; for the shape characteristic, each element possibly represents a value of a certain geometrical characteristic; and for the color characteristic, each element possibly represents a value of a certain color attribute; and obtaining a difference of the electric device image in the texture characteristic, shape characteristic and color characteristic according to the first similarity, the second similarity and the third similarity that are obtained upon calculation, thus obtaining the change of the target characteristic related to the defect, damage and corrosion.
2 . The electric patrol inspection control method based on the unmanned aerial vehicle according to claim 1 , wherein the device comprises a high-definition camera, a thermal camera and a laser radar.
3 . The electric patrol inspection control method based on the unmanned aerial vehicle according to claim 1 , wherein the position coordinates are the position information, the plurality of electric devices are divided into a plurality of flight path nodes according to the different position information, and the flight path nodes comprising the position information constitute the training trajectory dataset.
4 . The electric patrol inspection control method based on the unmanned aerial vehicle according to claim 1 , wherein a process of generating the patrol inspection electronic report comprises the following steps of: receiving a result of the analysis situation of the ground station, sending, by the ground station, a request of generating the patrol inspection electronic report, acquiring an electronic report template corresponding to the electric device with the corresponding position information, and confirming items comprised in the patrol inspection electronic report, wherein the request of the patrol inspection electronic report comprises an electric report identifier and position information; confirming a basic parameter and a global parameter of the patrol inspection electronic report according to the items, wherein the basic parameter refers to a parameter for defining a basic content of the patrol inspection electronic report, and the global parameter refers to a normal parameter of the electric device quoted in the patrol inspection electronic report; and generating a root node of the patrol inspection electronic report based on an interface that the basic parameter is on the patrol inspection electronic report, a title of the root node being the name of the electric device corresponding to the position information, adding a child node instruction in response to the root node, and unifying, by a child node, the result of the analysis situation of the electric device.
5 . The electric patrol inspection control method based on the unmanned aerial vehicle according to claim 4 , wherein the service life, maintenance expense, maintenance measure of the electric device are given at the same time according to the patrol inspection electronic report, and maintenance personnel are informed of the position information of the electric device.
6 . An electric patrol inspection control system based on an unmanned aerial vehicle, comprising: an unmanned aerial vehicle control module, configured to formulate a flight path according to an electric patrol inspection area, and to collect an image and position information of an electric device by a plurality of types of devices equipped on the unmanned aerial vehicle, wherein the image and the position information are transmitted to a receiving terminal of a ground station in a form of wireless transmission; an image processing and analyzing module, configured to receive the real-time collected image and position information by the ground station, to process and analyze the image, and then to obtain analysis on defects, damages and corrosion of the electric device; and a patrol and examine electronic reports generation module, configured to generate a patrol inspection electronic report comprising the analysis situations of a plurality of electric devices according to the analysis situation of the ground station and the position information as a distinguishing characteristic, to give the service life, maintenance expense, maintenance measure of the electric device at the same time according to the patrol inspection electronic report, and to inform maintenance personnel of the position information of the electric device; wherein the unmanned aerial vehicle control module comprises: a position information acquisition submodule, configured to acquire an electric device distribution map in the electric patrol inspection area, and at the same time to acquire position coordinates of various electric devices, wherein the position coordinates are the position information, the plurality of electric devices are divided into a plurality of flight path nodes according to the different position information, and the flight path nodes comprising the position information constitute a training trajectory dataset; a flight path generation submodule, configured to input the training trajectory dataset to a flight path generation model, to generate a flight path in real time, and to input the flight path to a controller of the unmanned aerial vehicle; a patrol inspection time minimization submodule, configured to minimize time that the unmanned aerial vehicle completes the specified electric patrol inspection area in combination with wireless transmission power and the flight path of the unmanned aerial vehicle, wherein a trial flight is performed on the unmanned aerial vehicle according to the flight path, to check the time; a first background field formation submodule, configured to continue the plurality of flight path nodes to obtain a flight route of the adjacent flight path nodes, to divide the flight route into a plurality of grids, and to construct a flight path background field comprising the plurality of grids; a second background field formation submodule, configured to acquire geographical environment data of the electric patrol inspection area by the laser radar, to preprocess the geographical environment data, to construct a geographical environment background field of the electric patrol inspection area, and to divide the geographical environment background field into a plurality of grids; and a fly-around judgment submodule, configured to merge the grids of the flight path background field with the grids of the geographical environment background field to form a grid matrix, to judge a significance of a flight direction of the unmanned aerial vehicle based on the grids in the grid matrix, and to confirm whether fly-around is required or not in the current geographical environment; wherein the image processing and analysis module comprises: an image preprocessing submodule, configured to preprocess the received image, wherein the preprocessing comprises operations of image denoising, enhancing a contrast ratio and adjusting a brightness, the electric device in the image is subjected to object detection and segmentation, to identify and position a position and a bounding box of the electric device; a characteristic vector acquisition submodule, configured to extract a target characteristic related to a defect, damage and corrosion in a segmented electric device area, and to transform the image information into a characteristic vector capable of being quantified and analyzed, wherein the target characteristic comprises a texture characteristic, a shape characteristic and a color characteristic; a situation judgment submodule, configured to perform a defect analysis and a classification on the extracted target characteristic by using a classifier, to judge the defect, damage and corrosion situations of the electric device according to the characteristic vector, and to give a corresponding judgment result; wherein extracting the target characteristic related to the defect, damage and corrosion from the characteristic vector acquisition submodule comprises: identifying the target characteristic of the characteristic in the segmented electric device area, extracting the target characteristic of a segmented to-be-identified electric device image and a segmented preset electric device image, to obtain a plurality of characteristic vectors, wherein the characteristic vectors correspond to texture characteristic, shape characteristic and color characteristic information of the segmented to-be-detected electric device image; calculating a similarity of the characteristic vectors of the segmented to-be-identified electric device image and the segmented preset electric device image under the texture characteristic, shape characteristic and color characteristic of the same electric device image, to obtain a first similarity of the texture similarity, a second similarity of the shape similarity and a third similarity of the color similarity, wherein a computed expression of the similarity Sim(L p ,L q ) is Sim ⁢ ( L p , L q , L s ) = 2 ⁢ ∑ k = 1 N ⁢ min ⁡ ( i pk , i qk , i s ⁢ k ) ∑ k = 1 N ⁢ ( i p ⁢ k + i q ⁢ k + i s ⁢ k ) ; wherein L p , L q , L s correspond to the characteristic vectors of the texture characteristic, shape characteristic and color characteristic in respective, i pk represents a k th element of the texture characteristic vector L p , i qk represents a k th element of the shape characteristic vector L p , i sk represents a k th element of the color characteristic vector L s , min(⋅) represents a function taking the minimum, N represents the number of elements in the characteristic vectors, specifically for the texture characteristic, shape characteristic and color characteristic, each element in the characteristic vectors corresponds to a certain specific quantified quantity or statistic quantity of the respective characteristic; for the texture characteristic, each element possibly represents a value of a certain texture statistic indicator; for the shape characteristic, each element possibly represents a value of a certain geometrical characteristic; and for the color characteristic, each element possibly represents a value of a certain color attribute; and obtaining a difference of the electric device image in the texture characteristic, shape characteristic and color characteristic according to the first similarity, the second similarity and the third similarity that are obtained upon calculation, thus obtaining the change of the target characteristic related to the defect, damage and corrosion.
7 . The electric patrol inspection control system based on the unmanned aerial vehicle according to claim 6 , wherein the patrol and examine electronic reports generation module comprises: a report generation request submodule, configured to receive a result of the analysis situation of the ground station, wherein the ground station sends a request of generating the patrol inspection electronic report, the request of the patrol inspection electronic report comprises an electric report identifier and position information; and to acquire an electronic report template corresponding to the electric device with the corresponding position information, and to confirm items comprised in the patrol inspection electronic report; a parameter definition submodule, configured to confirm a basic parameter and a global parameter of the patrol inspection electronic report according to the items, wherein the basic parameter refers to a parameter for defining a basic content of the patrol inspection electronic report, and the global parameter refers to a normal parameter of the electric device quoted in the patrol inspection electronic report; and a demarcation definition submodule, configured to generate a root node of the patrol inspection electronic report based on an interface that the basic parameter is on the patrol inspection electronic report, wherein a title of the root node is the name of the electric device corresponding to the position information, a child node instruction is added in response to the root node, and a child node unifies the result of the analysis situation of the electric device.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application is a continuation of International Application No. PCT/CN2024/108059, filed on Jul. 29, 2024, which claims priority to Chinese Patent Application No. 202410438837.8, filed on Apr. 12, 2024. All of the aforementioned applications are incorporated herein by reference in their entireties. TECHNICAL FIELD The present disclosure relates to the technical field of remote monitoring of power facilities, and in particular to an electric patrol inspection control method and an electric patrol inspection control system based on an unmanned aerial vehicle. BACKGROUND Power facilities refer to various devices and facilities used to generate, transmit and distribute electricity, including a power station, an electric transmission line, a transformer substation, a power distribution network and the like. They are the basis of energy supply and electric system operation, and crucial to guarantee the normal operation of the modern society. The importance is mainly reflected in the following aspects: energy supply: the power facilities are important infrastructures for providing electric energy, and supply power to various industries, families and public institutions, to support economic and social development. Economic development: the construction and operation of the power facilities promote the economic growth, provide reliable power supply to industrial production, commercial operation and service industries, and promote the development of economic activities. Life convenience: the popularization of the power facilities enables people's life to be more convenient, supports the normal operation of families, businesses and social facilities, and provides basic services such as lighting, heating and communication. At the same time, the application of new technologies will promote the intelligent and automation development of the power facilities, such as artificial intelligence, Internet of Things and big data analysis, thus improving the device operation and maintenance efficiency and system operation reliability. With the rise of distributed energy systems, the power facilities will pay more attention to flexibility and sustainability, including a small solar panel, a wind turbine and the like, to achieve more reliable and sustainable energy supply. As the energy storage technology makes a progress, the power facilities will better respond to an energy fluctuation and a peak-valley difference, to provide a stable power supply. With the continuous increase and decentralization of the power facilities, the traditional manual patrol inspection becomes more and more difficult and inefficient; patrol inspection personnel manually record line defects on paper at the site, then the line defects are counted manually, and this working way exists the following obvious defects: 1. Scientific supervision and examination means are lack for the field patrol inspection personnel. Management personnel cannot examine whether or not the patrol inspection personnel reach each pole tower and check the device that should be checked carefully, therefore a situation of missing inspection for the pole tower and other devices on the electric transmission line, caused by lacking a sense of responsibility of the patrol inspection personnel, exists, and the patrol inspection quality is difficult to be ensured. 2. The personnel quality is an important factor affecting the patrol inspection quality. The respective knowledge and experience accumulated of the patrol inspection personnel are uneven, each person has different understandings on devices and items that should be checked, and therefore the inspection quality may be greatly different from the field inspection record. 3. The patrol inspection data is saved in a paper form, existing difficult statistics and inquiry. A great number of inspection records will generate after each patrol inspection, the workload to collect, summarize, analyze and count these recorded data is considerable, and the paper data has shortcomings of more difficult long-term storage and easy missing. 4. By checking the inspection record only, the operation and management personnel are difficult to evaluate the working quality and quantity of the patrol inspection personnel accurately and qualitatively. 5. Error and omission frequently occur due to the manual management for the power transmission and distribution power data. It is inconvenient to inquire data manually, and takes a lot of work and time to count the statement. Since the patrol inspection method for the traditional power transmission line exists shortcomings such as more human factors, high management cost and incapability of monitoring the working state of the patrol inspection personnel, developing an efficient, real-time and intelligent patrol inspection system is of great important practical significance to improve the scientific management level of the patrol inspection work of the power transmissio