CN-121071174-B - Compact storage and management method and system for live-action three-dimensional data products

CN121071174BCN 121071174 BCN121071174 BCN 121071174BCN-121071174-B

Abstract

The application discloses a compact storage and management method and a system for a live-action three-dimensional data product, wherein the method comprises the steps of obtaining live-action three-dimensional data; creating a real-scene three-dimensional data product assembly task, formulating a real-scene three-dimensional data product content standard, compiling a geographic entity data mapping table, carrying out structural reconstruction on geographic entity data according to the geographic entity data mapping table, regenerating geographic scene data according to a data range and a data format specified by the assembly task, and specified center point coordinates and tile block requirements, establishing an Internet of things perception data product mapping table, realizing Internet of things perception data content assembly, readjusting map configuration information according to the map data list, realizing map data content assembly, writing assembled data into the real-scene three-dimensional data product, completing data verification, and storing all configuration information and verification information of a data product assembly process. The method can realize high-efficiency and high-quality sharing management of the live-action three-dimensional data.

Inventors

LIU HUAGUANG
LUO SI
ZHANG ZHENGQIANG
WANG JUNJUN
HU XIAODAN
LUO JIANXIN
CHEN TAO
KOU YUAN
SHEN YONGWEI
PENG HAO
GUAN XIANGYU
An guanxing
LUO HAILING

Assignees

湖南省第一测绘院

Dates

Publication Date: 20260512
Application Date: 20250904

Claims (9)

1. A compact storage and management method for a live-action three-dimensional data product, the method comprising: acquiring live three-dimensional data, and constructing an original database, wherein the live three-dimensional data comprises geographic entity data, geographic scene data, internet of things perception data and map data; creating a live three-dimensional data product assembly task and formulating a content standard of the live three-dimensional data product; Comparing the real three-dimensional data product content standard with a real three-dimensional database standard to obtain a conversion relation of data content, compiling a geographic entity data mapping table according to the conversion relation, extracting, converting and loading the original database data by using an ETL technology according to the geographic entity data mapping table, reconstructing a structure of geographic entity data, and fully deriving, without cutting and filtering, recording geographic entity data metadata for ensuring data integrity by using intersection rules for data at boundaries so as to realize the assembly of the geographic entity data content; Converting the geographic scene data in the format of 3dtile in the original database into a metadata table, an organization structure data table and a tile file data table according to the data range, the data format and the specified center point coordinate and the tile block requirement specified by the assembly task, storing the metadata table, the organization structure data table and the tile file data table in a live-action three-dimensional data product file, associating the organization structure data table and the tile file data table through indexes, and adding the assembled geographic scene data item into a live-action three-dimensional data product data catalog; According to the content and the data range of the assembly task selected internet of things sensing data, extracting data from an original database, establishing a data mapping table for the internet of things sensing data needing to be changed in data structure, converting the internet of things sensing data by using an ETL data conversion tool, and adding an assembly internet of things sensing data item into a real-scene three-dimensional data product data catalog; the map configuration information is readjusted according to the entity of the map data and the scene data list, the layers, of which the data sources of the layers are not assembled, in the map are judged to be invalid layers, and an invalid layer cleaning tool is utilized to delete the invalid layers so as to realize the assembly of the map data content; Writing the assembled geographic entity data, geographic scene data, internet of things perception data and map data into the live three-dimensional data product, calculating the check value of the data in the live three-dimensional database and the check value of the live three-dimensional data product, comparing the consistency of the check values, and finishing data check; Storing all configuration information and verification information of the data product assembly process; The live three-dimensional data product assembly task comprises a product name, a data range and a data time point, and the live three-dimensional data product content standard comprises a geographic entity identification data structure definition, a modal data list and a data structure definition, an internet of things perception data list and a data structure definition, a relation data list and a data structure definition, a geographic scene data list and a data format, a symbol data list and a data structure definition, a map data list and a data format.
2. The method of claim 1, wherein the geographic entity data comprises geographic entity identification data, modality data, relationship data, symbol data, the symbol data being stored in JSON format in a data file.
3. The method of claim 1, wherein regenerating the geo-scene data includes adjusting a center point of the geo-scene data within a specified range of the live-action three-dimensional data product when the geo-scene data center point in the live-action three-dimensional data product is inconsistent with the geo-scene data center point in the live-action three-dimensional database, the center point being offset by a distance that does not exceed the expressible effectiveness of floating point, and re-adjusting the tile data and adjusting the data center point when the assembly tile partitioning requirements are inconsistent with the data tile partitioning scheme in the system.
4. The method of claim 1, wherein the Internet of things perception data is divided into three types, namely structured data, semi-structured data and unstructured data, wherein the semi-structured data and the unstructured data are stored in a data product file by using a BLOB field according to data types, and unified space-time identification is added to form a structured relational data table.
5. The method of claim 1, wherein the map data includes map configuration information and map service information.
6. The method of claim 1, wherein the MD5 algorithm is used to calculate a verification value of the data in the live-action three-dimensional database, and the data is verified in batches according to the size of the data during verification.
7. A compact storage and management system for a live three-dimensional data product, for implementing the method of any one of claims 1-6, comprising a data acquisition and creation data product assembly module for acquiring live three-dimensional data, creating a live three-dimensional data product assembly task, and formulating a live three-dimensional data product content standard, wherein the live three-dimensional data comprises geographic entity data, geographic scene data, internet of things perception data, and map data, and the assembly task comprises a product name, a data range, and a data time point, and the live three-dimensional data product content standard comprises geographic entity identification data structure definition, modal data list and data structure definition, internet of things perception data list and data structure definition, relational data list and data structure definition, geographic scene data list and data format, symbol data list and data structure definition, map data list and data format; a geographic entity data assembly module for comparing the real three-dimensional data product content standard with the real three-dimensional database standard, compiling a geographic entity data mapping table, defining the conversion relation of data content, carrying out extraction, conversion and loading operation on the original library data by using ETL technology according to the geographic entity data mapping table, carrying out structural reconstruction on the geographic entity data, for the data at the boundary, deriving the data by using the whole intersecting rule, not cutting and filtering, recording the metadata of the geographic entity data, realizing the assembly of the geographic entity data content, a geographic scene data assembly module for obtaining the data range, the data format and the appointed central point coordinate and tile blocking requirement according to the assembly task, regenerating the geographic scene data, realizing the content assembly of the geographic scene data, and recording the geographic scene metadata; the system comprises an Internet of things sensing data assembly module, a map data assembly module, a data product generation and verification module, a data product verification module and a data product verification module, wherein the Internet of things sensing data type, data range and specified data format are selected according to an assembly task, the Internet of things sensing data product mapping table is established to realize Internet of things sensing data content assembly, internet of things sensing metadata is recorded, the map data assembly module is used for readjusting map configuration information according to a map data list to realize map data content assembly, the data product generation and verification module is used for writing the assembled geographic entity data, geographic scene data, internet of things sensing data and map data into the live-action three-dimensional data product, calculating the consistency of a verification value of data in a live-action three-dimensional database and a verification value of the live-action three-dimensional data product, comparing the verification value, and storing all configuration information and verification information of the data product assembly process after verification is completed.
8. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, said processor realizing compact storage and management of a live three-dimensional data product based on the method of any of claims 1-6 when said computer program is executed.
9. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, enables compact storage and management of a realistic three-dimensional data product based on the method of any of claims 1-6.

Description

Compact storage and management method and system for live-action three-dimensional data products Technical Field The application relates to the technical field of computer information, in particular to a compact storage and management method and system for a live-action three-dimensional data product. Background At present, the types of real-scene three-dimensional data elements relate to vector data, raster data, three-dimensional model data, video data, picture data, relational data and the like, the data are respectively stored in different data formats and are scattered at different positions of a file system catalog, the data organization mode is not uniform, the data description information is imperfect, the data is inconvenient to uniformly manage, the data is inconvenient to uniformly display and inconvenient to share and transmit, a distribution mechanism is simple, data copies can be repeatedly copied, the data content can be manually modified, different departments have different expression standards for uniform geographic entities, the data accuracy is not verified, the accuracy of the shared data cannot be ensured, and the production unit of the source data cannot be traced. Disclosure of Invention Aiming at the problems that a live-action three-dimensional platform data storage scheme is inconvenient for desktop GIS software to view, the live-action three-dimensional data format is various and inconvenient to manage uniformly, shared data cannot be traced, and the like, the invention provides a compact storage and management method for a live-action three-dimensional data product, which comprises the following steps: and acquiring live three-dimensional data, and constructing an original database, wherein the live three-dimensional data comprises geographic entity data, geographic scene data, internet of things perception data and map data. And creating a live three-dimensional data product assembly task and formulating a content standard of the live three-dimensional data product. Comparing the real-scene three-dimensional data product content standard with the real-scene three-dimensional database standard to obtain a conversion relation of data content, compiling a geographic entity data mapping table according to the conversion relation, extracting, converting and loading the original database data by utilizing an ETL technology according to the geographic entity data mapping table, reconstructing a structure of geographic entity data, and fully deriving, without cutting and filtering, recording geographic entity data metadata for guaranteeing data integrity by utilizing intersection rules for data at boundaries so as to realize the assembly of the geographic entity data content. According to the data range, the data format and the appointed central point coordinates and the tile block requirement specified by the assembling task, converting the geographic scene data in the format of 3dtile in the original database into a metadata table, organizing the structural data table and the tile file data table to be stored in a live three-dimensional data product file, associating the organizing structural data table and the tile file data table through indexes, and adding the assembled geographic scene data item into a live three-dimensional data product data catalog. And extracting data from the original database according to the content and the data range of the internet of things sensing data selected by the assembly task, establishing a data mapping table for the internet of things sensing data needing to change the data structure, converting the internet of things sensing data by using an ETL data conversion tool, and adding the assembly internet of things sensing data item into a real-scene three-dimensional data product data catalog. And readjusting map configuration information according to the entity of the map data and the scene data list, judging the layers of which the data sources of the layers in the map are not assembled as invalid layers, deleting the invalid layers by using an invalid layer cleaning tool, and realizing the assembly of map data contents. And writing the assembled geographic entity data, geographic scene data, internet of things sensing data and map data into the live three-dimensional data product, calculating the check value of the data in the live three-dimensional database and the check value of the live three-dimensional data product, and comparing the consistency of the check value to finish data check. All configuration information and verification information of the data product assembling process are saved. Further, the assembly task includes a product name, a data range, and a data time point, and the live three-dimensional data product content standard includes a geographic entity identification data structure definition, a modal data list and data structure definition, an internet of things perception data list and data structure definition, a relations