Search

KR-20260065968-A - Optimal grid-based information collection and operation means using integrated information from drones and CCTV

KR20260065968AKR 20260065968 AKR20260065968 AKR 20260065968AKR-20260065968-A

Abstract

The present invention relates to a grid-based optimal information collection and operation means and method utilizing integrated information from drones and CCTVs, and, It is composed of drones (1) for regularly patrolling the area; CCTVs (2) deployed in large numbers in the community; static information (3) such as a map of the area, topographic information, and building information; an operation server (4) connected to the drones (1), CCTVs (2), and static information (3) via a communication network; and a monitor (5) connected to the operation server (4) to display collected images from the drones and CCTVs. The above-mentioned operation server (4) includes an object information management system (42) for detecting objects by analyzing video information collected from drones and CCTVs, extracting real-world latitude and longitude coordinates by location analysis, and mapping object information to a grid of a target area to generate object-grid mapping information of various topics; A drone operation system (41) for generating a drone flight path suitable for flight purposes and collecting multiple object information using grid-object mapping statistical information generated in the object information management system (42) above; It is characterized by being composed of a database (43) in which dynamic information collected from the above-mentioned drone (1) and CCTV (2), static information (3) such as map grid information, terrain information and building information, object latitude and longitude detection information, object-grid mapping information, and a drone flight path generated suitable for flight purpose and collection of multiple object information are stored.

Inventors

  • 홍종유
  • 김성환
  • 이승주
  • 옥종광
  • 김근부

Assignees

  • 주식회사 제이비티

Dates

Publication Date
20260512
Application Date
20241101

Claims (10)

  1. It is composed of drones (1) for regularly patrolling the area; CCTVs (3) deployed in large numbers in the community; static information (3) such as a map of the area, topographic information, and building information; an operation server (4) connected to the drones (1), CCTVs (2), and static information (3) via a communication network; and a monitor (5) connected to the operation server (4) to display collected images from the drones and CCTVs. The above-mentioned operation server (4) includes an object information management system (42) for detecting objects by analyzing video information collected from drones and CCTVs, extracting real-world latitude and longitude coordinates by location analysis, and mapping object information to a grid of a target area to generate object-grid mapping information of various topics; A drone operation system (41) for generating a drone flight path suitable for flight purposes and collecting multiple object information using grid-object mapping statistical information generated in the object information management system (42) above; A grid-based optimal information collection and operation means utilizing integrated information of a drone and a CCTV, characterized by being composed of dynamic information collected from the above-mentioned drone (1) and CCTV (2), static information (3) such as grid information, terrain information and building information of a map, latitude and longitude detection information of an object, object-grid mapping information, and a database (43) in which a drone flight path generated suitable for flight purposes and collection of multiple object information is stored.
  2. In Article 1, The above-mentioned drone operating system (41) comprises a route management unit (41a) for providing an operating route that operates across the entire area of the sector and a mission route that operates an optimal flight route based on a 3D grid to suit special missions such as crime prevention patrol, traffic volume survey, and road inspection; A flight control unit (41b) for controlling the mission flight of the drone based on the generated mission and flight path and monitoring collected data; Grid-based optimal information collection and operation means utilizing integrated information of drones and CCTVs, characterized by being composed of a data communication unit (41c) that transmits mission flight commands in conjunction with a drone remote control system and collects and stores data from a drone in flight.
  3. In Article 1, The above object information management system (42) comprises a grid management unit (42a) for forming a grid map by matching a grid on a map provided as static information (3); A video analysis unit (42b) for detecting objects by analyzing video information collected from a drone (1) and a CCTV (2); A position analysis unit (42c) for analyzing the location of a detected object to extract real-world latitude and longitude coordinates; A grid-based optimal information collection and operation means utilizing integrated information of drones and CCTVs, characterized by being composed of an object grid mapping unit (42d) for generating object-grid mapping information of various topics by mapping the latitude and longitude coordinates of an object onto a grid map.
  4. In Article 1, The above database (43) includes an image information section (43a) for storing images collected from the drone (1) and CCTV (2) as they are; An object information unit (43b) for storing the latitude and longitude coordinates of an object analyzed by collected image information; A grid information section (43c) for constructing grid data on a map; A grid statistics unit (43d) for storing object-grid mapped information for various topics; Grid-based optimal information collection and operation means utilizing integrated information of drones and CCTVs, characterized by being composed of a building information unit (43e) for storing latitude and longitude coordinates for buildings.
  5. An object information management system (42) for generating object-grid mapping information of various topics by analyzing video information collected from the drone and CCTV to detect objects and extracting real-world latitude and longitude coordinates by location analysis and mapping object information to a grid of the target area; A drone operation system (41) for generating a drone flight path suitable for flight purposes and collecting multiple object information using grid-object mapping statistical information generated in the object information management system (42) above; A grid-based optimal information collection and operation means utilizing integrated information of a drone and CCTV, comprising dynamic information collected from the above-mentioned drone (1) and CCTV (2), static information (3) such as map grid information, terrain information and building information, object latitude and longitude detection information, object-grid mapping information, and a database (43) in which a drone flight path generated suitable for flight purpose and collection of multiple object information is stored. The process of collecting video footage captured by the drone (1) and CCTV (2) into the operation server (4); A process in which the image analysis unit (42b) of the object information management system (42) of the operation server (4) analyzes image information to detect an object, the location analysis unit (42c) analyzes the location of the detected object to extract real-world latitude and longitude coordinates, and the object grid mapping unit (42d) maps the latitude and longitude coordinates of the object onto a grid map, thereby generating object-grid mapping information of various topics; The video footage collected from the drone (1) and CCTV (2) and transmitted to the operation server (4) is stored in the video information section (43a) of the database section (43), the latitude and longitude coordinates of the object analyzed by the collected video information are stored in the object information section (43b) of the database section (43), grid information for constructing grid data on a map is stored in the grid information section (43c), information that has been object-grid mapped for various topics is stored in the grid statistics section (43d), and the latitude and longitude coordinates of the building are stored in the building information section (43e); A method for collecting and operating grid-based optimal information using integrated information of a drone and a CCTV, characterized by a process in which the flight management unit (41a) of the drone operation system (41) of the operation server (4) generates a flight path in mission mode that passes through grids marked with objects based on the object-grid mapping information, and generates a path by purpose/topic to suit special missions such as crime prevention patrol, traffic volume survey, and road inspection, and the flight control unit (41b) controls the mission flight of the drone based on the generated mission and flight path, thereby allowing the collection of video information to be repeated in the drone (1) and the CCTV (2).
  6. In Paragraph 5, A grid-based optimal information collection and operation method utilizing integrated information from drones and CCTVs, characterized by recognizing objects in video collected from drones and CCTVs through an 'object detection AI model,' acquiring actual location information of objects through photogrammetry techniques such as 'SfM (Structure From Motion),' and acquiring object classification information such as "vehicle, two-wheeled vehicle, bicycle, PM, pedestrian" using additionally learned information.
  7. In Paragraph 5, In the process of collecting video footage captured by the initial drone (1) and CCTV (2) into the operation server (4), the flight path is set in an operation mode that circulates all space on the ground without omission, and After object detection, a flight path is set in mission mode via the grids marked with objects based on object-grid mapping information, and repetitive operation and information collection are carried out. A grid-based optimal information collection and operation method utilizing integrated information of a drone and CCTV, characterized by switching to an operation mode in the flight control unit (41b) after repeating the mission mode, and setting a flight path to pass through grids that were omitted in the mission mode, thereby confirming the movement of objects that were not found in the previous mission mode and upgrading the mission mode to enable repetitive operation and information collection.
  8. In Paragraph 5, A grid-based optimal information collection and operation method utilizing integrated information of drones and CCTVs, characterized in that static information (3), such as building information, is provided to the operation server (4) in addition to video of the drone and CCTV, so that the flight control unit (41b) sets a flight path so that the drone operates while avoiding buildings.
  9. In Paragraph 5 or 7, A grid-based optimal information collection and operation method utilizing integrated information of a drone and CCTV, characterized in that the image analysis unit (42b) can produce various statistical/spatial information of the grid network that can be used for path generation based on information mapped to the grid, so the object grid mapping unit (42d) generates object-grid mapping information of various topics, and the path management unit (41a) of the drone operation system (41) of the operation server (4) generates a flight path passing through the object-marked grids in mission mode for the object-grid mapped information.
  10. In Paragraph 5 or 7, A grid-based optimal information collection and operation method utilizing integrated information of drones and CCTVs, characterized in that the generation of a flight path is achieved by using a Traveling Salesman Problem (TSP) algorithm that can generate a path circulating target points in the path management unit (41a) of the drone operation system (41).

Description

Grid-based optimal information collection and operation means and method using integrated information from drones and CCTV The present invention relates to the field of information collection and monitoring technology utilizing drones and CCTV systems, and in particular, to a method for automatically generating an optimal drone flight path through grid-based data analysis and efficiently collecting information. This invention can be effectively utilized in various application fields such as urban surveillance, traffic management, disaster response, and security monitoring. Its purpose is to provide flight paths for collecting more accurate and extensive information when operating drones for patrol or information gathering purposes. Since drones have limited flight times and flight cycles are limited due to charging times even with the introduction of drone stations, this invention enables the collection of more accurate and extensive information by constructing and analyzing data collected from CCTVs and drones in grid units for efficient drone information gathering, and by generating optimal drone flight paths based on the frequency of appearance and characteristic information of moving objects within each grid. CCTV (Closed-Circuit Television) is one of the most widely used surveillance and monitoring tools worldwide, and is an essential element in urban and public facilities, traffic surveillance, and security. Since CCTVs are installed in fixed locations, record video for extended periods, and can continuously monitor the situation in specific areas, the CCTV system has the advantage of enabling continuous data collection within the installed area. However, CCTVs can only collect data from fixed angles, and there is a problem in that the observable area is limited by the installation location, the camera's field of view, and the rotation range. Even with advanced CCTV cameras equipped with PTZ (Pan, Tilt, Zoom) functions, monitoring large areas is subject to physical constraints, and overcoming this requires installing more cameras. Consequently, there is a problem where real-time tracking becomes impossible when a specific object moves out of the camera's line of sight. In addition, drones (UAVs, Unmanned Aerial Vehicles) have the advantage of being able to fly over wide areas and collect data, and are being utilized in various fields, particularly for monitoring road and traffic conditions, surveillance of disaster zones, search and rescue operations, and environmental monitoring. While drones can complement the limitations of fixed CCTVs by allowing for the free setting of flight altitude and routes, they have limitations in that flight time is restricted by battery capacity and continuous surveillance is difficult. Generally, commercial drones can only fly for a maximum of 20 to 30 minutes and require recharging thereafter. Also, since the size and resolution of objects captured vary depending on the altitude, the object recognition rate decreases when capturing a wide area at high altitudes, so there are limitations to accurate monitoring of a wide area over a long period of time using a drone alone. As such, while drone technology and CCTV systems each play important roles individually, their efficiency is limited when used alone; therefore, methods for integrating their use must be considered. In addition, while drones offer excellent maneuverability and flexibility, their flight time is limited by battery life; therefore, it is necessary to establish an optimal flight path to cover as wide an area as possible. Existing drone path optimization technologies primarily rely on GPS-based route planning or flying along predefined patterns; however, these methods have the disadvantage of being unable to flexibly respond to various environmental changes or real-time data, and they cannot utilize the drone's energy efficiently. Furthermore, since existing CCTV data is used only for individual surveillance purposes, there is a need for an integrated system that enables more efficient information collection through integration with drones. FIG. 1 is a block diagram schematically illustrating a basic system for collecting and operating integrated information of drones and CCTVs to implement the present invention, and FIG. 2 is a configuration diagram of a basic system for collecting and operating integrated information of drones and CCTVs to implement the present invention, and FIG. 3 is a flowchart illustrating the processing process of a system for collecting and operating integrated information of drones and CCTVs to implement the present invention, and FIG. 4 is a flowchart specifically illustrating the processing steps within the operating server in the present invention, and FIG. 5 is an exemplary diagram showing the flight path of the operating mode in the present invention, and FIG. 6 is an exemplary diagram showing another flight path of the operating mode in the present invention, and FIG. 7 is an