CN-121070933-B - National region geological map data organization and storage method and system

CN121070933BCN 121070933 BCN121070933 BCN 121070933BCN-121070933-B

Abstract

The invention discloses a national regional geological map data organization and storage method and system, wherein the method comprises the steps of selecting items to which regional geological survey data belong, judging data types, selecting data types, uploading files of the geological map data, updating a PostgreSQL service database and a MinIO original file database in a management system, updating an associated information table of the PostgreSQL service database, extracting attribute information, spatial position information and service associated information of the geological map data, and storing the attribute information table and the associated information table of the PostgreSQL service database. The method has the advantages that the method is simple to realize, the mixed database is uniformly stored in a regional geological map data layering organization mode of project number, map frame number, data type and data file, and the storage address is utilized for data association, so that the organization management efficiency of regional geological map data is improved.

Inventors

LI FENGDAN
LIU YUANYUAN
LIU CHANG
YANG LE
LV XIA
RAN QUAN
LIU SHUANG
ZHANG MING

Assignees

中国地质调查局自然资源综合调查指挥中心

Dates

Publication Date: 20260508
Application Date: 20250904

Claims (6)

1. A method for organizing and storing geological map data of a national region, comprising the steps of: Step one, selecting items to which regional geological survey data belong; Judging the data type, if the uploaded data is geological map filling data, selecting a map number where the corresponding data is located; Step three, data type selection, namely determining the classification of the geological map data and/or the classification of other geological survey data; Step four, uploading the geological map data files at the PC end, the Web end and the mobile end, and caching the uploaded data file compression package to the local; And fifthly, storing the entity file of the regional geological map data in a PostgreSQL service database and MinIO original file database in the management system, updating the storage path and file directory structure information to an associated information table of the PostgreSQL service database, extracting attribute information, spatial position information and service associated information of the geological map data, and storing the attribute information table and the associated information table of the PostgreSQL service database.
2. The method for organizing and storing geological map data of a national area according to claim 1, wherein if the geological map data is uploaded by a PC side and a Web side, the fifth step further comprises: Step a1, judging whether the current data exist under the project, the picture and the corresponding data types, if so, deleting the related attribute information table in the service database and the historic data in the object storage database, and then executing step b1, if not, writing the project number and the picture number information into the related information table of the service database, decompressing the file compression package to obtain a regional geological survey data file, and reading the directory structure information of the data file; Data format conversion, namely carrying out data format conversion, analyzing a data directory structure, converting and analyzing the data into geojson format, extracting space element data, extracting vector data and storing the vector data into a PostGIS space database; Step a2, if the multimedia file exists and is a photo, generating a photo thumbnail, uploading the photo thumbnail to an original file library of an object storage database, recording thumbnail storage position information in an associated information table of a service database, if the multimedia file is a video file or an audio file, not processing the multimedia file, and executing step b2, if the multimedia file does not exist, synchronously uploading a compressed packet of the local area geologic map data file and the local area geologic map data file to the MinIO original file library, and recording a file storage path and file directory structure information to an associated information table of the PostgreSQL service database; The method comprises the steps of extracting attribute and space position information, namely reading local regional geological map data files, calling data format conversion service through a message queue, converting the attribute files of regional geological survey data into geojson format, extracting attribute information and space position information of the regional geological map data from geojson files, storing the attribute information into an attribute information table of a service database, and storing the space position information into a PostGIS space database.
3. The method for organizing and storing regional geological map data of a country according to claim 1, wherein if the field route geological survey data is uploaded by a mobile terminal, the fifth step further comprises: Judging the data type of the data uploaded by the mobile terminal, if the data is the field route geological survey data uploaded by the PC terminal, replacing and updating the original data under the acquisition day backup folder stored in the MinIO original file library, otherwise, uploading the data uploaded by the user to the acquisition day backup folder under the corresponding project and the image in the MinIO original file library in a compressed package mode if the data is not uploaded by the PC terminal; Data format conversion, namely carrying out data format conversion, analyzing a data directory structure, converting and analyzing the data into geojson format, extracting space element data, extracting vector data and storing the vector data in a PostGIS space database; Step a2, if the multimedia file exists and is a photo, generating a photo thumbnail, uploading the photo thumbnail to an original file library of an object storage database, recording thumbnail storage position information in an associated information table of a service database, if the multimedia file is a video file or an audio file, not processing the multimedia file, and executing step b2, if the multimedia file does not exist, synchronously uploading a compressed packet of the local area geologic map data file and the local area geologic map data file to the MinIO original file library, and recording a file storage path and file directory structure information to an associated information table of the PostgreSQL service database; The method comprises the steps of extracting attribute and space position information, namely reading local regional geological map data files, calling data format conversion service through a message queue, converting the attribute files of regional geological survey data into geojson format, extracting attribute information and space position information of the regional geological map data from geojson files, storing the attribute information into an attribute information table of a service database, and storing the space position information into a PostGIS space database.
4. The method for organizing and storing regional geological map data of the country according to claim 1, wherein if other types of geological survey data are uploaded, the fifth step further comprises: Judging whether a multimedia file exists in the regional geological map data file cached locally; Step a2, if the multimedia file exists and the multimedia file is a photo, photo thumbnail is firstly generated and uploaded to an original file library of the object storage database, and the storage position information of the thumbnail is recorded in an associated information table of the service database, if the multimedia file is a video file or an audio file, the processing is not performed, step b2 is executed, if the multimedia file does not exist, a local regional geological map data file compression packet and a local regional geological map data file are synchronously uploaded to an original file library MinIO, and a file storage path and file directory structure information are recorded to an associated information table of the PostgreSQL service database.
5. The method for organizing and storing the geological map data of the national area according to claim 1, wherein the classification of the geological map data comprises the steps of collecting daily backups, field hand maps, exploration engineering libraries, map prb libraries, actual material maps, manuscript originals and space databases, and the classification of the other geological survey data comprises the prior geological data and result reports.
6. A national regional geologic map data organization storage system, comprising: The first selection unit is used for selecting items to which the regional geological survey data belong; the second selection unit is used for judging the data type, and selecting the picture number of the corresponding data if the uploaded data is geological map filling data, and selecting no picture number if the uploaded data is other geological survey data; a third selection unit for data type selection, determining the classification of the geological map data and/or the classification of other geological survey data; The processing unit is used for uploading the geological map data files at the PC end, the Web end and the mobile end, and caching the uploaded data file compression packets to the local; And the execution unit is used for managing a PostgreSQL service database and a MinIO original file database in the system, storing the entity file of the regional geological map data, updating the storage path and file directory structure information to an associated information table of the PostgreSQL service database, extracting attribute information, spatial position information and service associated information of the geological map data, and storing the attribute information table and the associated information table of the PostgreSQL service database.

Description

National region geological map data organization and storage method and system Technical Field The invention belongs to the technical field of geology, and relates to a national regional geological map data organization and storage method and system. Background The digital geological investigation technology is a technology for digitally acquiring, storing, sorting, analyzing, mapping and building a library of various geological information acquired by field geological investigation by applying a geographic information system, a global satellite positioning system, a remote sensing technology and the like in regional geological investigation work. For many years, the digital geological investigation technology has been widely applied to the regional geological map filling process of 1:5 ten thousand and 1:25 ten thousand in China, so that geological map filling data is promoted to be increased in an explosive manner, the data volume is developed from GB to TB, and the current PB order of magnitude is reached. It has been counted that since 2002, the 1:5 ten thousand area geologic map databases including the original data database and the result map database established by digital geologic survey technology have been nearly 4300, accounting for 19.55% of the range of 22000 multiple 1:5 ten thousand maps in the country. And the number of pictures per year is increasing. These data can play a role in (1) data retrieval services. After the geological information is organized and processed, the comprehensive, fine-classification, accurate and effective attribute data query and retrieval results are provided for the user. (2) user-interactive custom services. And generating customized maps of different topics according to the requirements of the users. Custom map styles including different geological elements, online interactive, editable, freely markable vector diagrams, static maps, etc. can be formed. (3) comprehensive analysis function. The data island is broken, and general data analysis can be performed on the drawing information and the attribute data. And carrying out statistical analysis, correlation analysis, cluster analysis and the like on the distribution states of data such as chronology, ground physical tele-control and the like, and the relation between the digital characteristics and the random variables to form a visual chart. (4) an auxiliary decision function. And an intelligent evaluation and auxiliary decision making function is provided. And extracting expert experience, knowledge or effective structured evaluation flow in the related field, constructing a decision model and an evaluation model, and outputting a short report for reference. (5) making a series of thematic maps. The method is used for carrying out basic geological information display and analysis and the like around supporting a new round of mining breakthrough strategic actions and national major strategic implementation. In addition, in view of the diversified needs of different users across fields and multiple scenes, a series of thematic galleries (stratum, structure, magma, volcanic, fossil, precious jade, geological remains, etc.) need to be formed. Currently, these data are in a "fragmented" state, dispersed throughout the production units. The specific data content of each map generated by the geological map comprises a field hand map, a map PRB library, actual material map data, a manuscript original map, a geological map space database, unstructured geological report data and the like, and the specific data content is respectively stored in different types of lightweight databases and files, so that the problems of scattered storage positions, insufficient data relevance, inconvenient data management, weak comprehensive application capacity and the like are caused by the traditional mode of respectively building storage management according to data types. When further business application demands such as comprehensive application of geological map data exist, data such as field route geological survey data, actually measured geological section data, rock geochemical sample analysis results, sheet identification results and the like are subjected to classified integration and orderly management, direct or indirect spatial and time relevance of various data is enhanced, the calculated amount is very large, and the data retrieval and extraction efficiency is low. Disclosure of Invention The invention aims to overcome the defects and provide a national regional geological map data organization and storage method and system, which can solve various problems existing in the prior art. In order to achieve the purpose, the technical scheme adopted by the invention is that the method for organizing and storing the geological map data of the national region is characterized by comprising the following steps: Step one, selecting items to which regional geological survey data belong; Judging the data type, if the uploaded data