CN-122018825-A - Multidimensional construction data storage system and method
Abstract
The invention provides a multidimensional construction data storage system and a method, which relate to the technical field of data storage, the invention realizes the remarkable improvement of construction data storage efficiency and the breakthrough of intelligent management capability by introducing multidimensional feature extraction, resolution factor calculation and dimension perception hash algorithm, firstly, four-dimensional original feature values are extracted from each construction data unit, standardized coding processing is carried out, unified dimension codes are generated, the method comprises the steps of calculating a time resolution factor, a space resolution factor and a coding similarity factor, quantitatively evaluating the fineness and the association strength of data, dynamically adjusting a storage strategy, intelligently generating logic storage coordinates by using the factors by a dimension perception hash algorithm, naturally gathering data with similar characteristics on physical storage, temporarily storing data items in a memory management layer by maintaining an ordered structure, sequencing according to the logic coordinates, effectively reducing random writing operation of a disk, and improving writing performance.
Inventors
- TANG YANCHI
- YAN CHENGYAN
- HU CHAOYING
Assignees
- 云南农业大学
Dates
- Publication Date
- 20260512
- Application Date
- 20260416
Claims (10)
- 1. A multi-dimensional construction data storage method, characterized in that the storage method comprises: S1, extracting original characteristic values of four dimensions of time, space, objects and types of each construction data unit to be stored, and carrying out normalized coding processing to generate a time dimension code, a space dimension code, an object dimension code and a type dimension code respectively; s2, calculating a time resolution factor based on the time dimension code, calculating a space resolution factor based on the space dimension code, and calculating a coding similarity factor based on the object dimension code and the type dimension code; s3, combining the time dimension code, the space dimension code, the object dimension code and the type dimension code into a multidimensional feature identifier corresponding to each construction data unit to be stored; s4, calculating the logic storage coordinates of each construction data unit to be stored through a dimension perception hash algorithm based on the multidimensional feature identifier and combining a time resolution factor, a space resolution factor and a coding similarity factor; S5, based on the sequence of the logic storage coordinates, combining each construction data unit to be stored and the corresponding logic storage coordinates thereof into an ordered structure in which memory data items are inserted into a memory; And S6, when the total data amount of all the memory data items accumulated in the ordered structure in the memory reaches a preset refreshing threshold value, converting all the memory data items into ordered data blocks in batches according to the sequence of the logic storage coordinates, refreshing the ordered data blocks to a disk storage layer, and recording a physical storage address.
- 2. The multi-dimensional construction data storage method according to claim 1, wherein in step S1, the original characteristic value is extracted from metadata of a construction data unit, wherein the metadata is standardized description information pre-associated to the construction data unit, including creation time, spatial location, construction object identification, and data type identification.
- 3. The multi-dimensional construction data storage method according to claim 2, wherein in step S1, the normalized encoding process includes: and mapping the original characteristic values of the four dimensions into standardized codes in a fixed format by adopting a preset code conversion table.
- 4. A multi-dimensional construction data storage method according to claim 3, wherein in step S2, the step of calculating the time resolution factor comprises: The number of complete time units contained in the time dimension code is determined as the coding granularity by matching the format of the time dimension code through the regular expression; Dividing the coding granularity by the preset maximum time unit number, and normalizing the coding granularity to a time resolution factor with a numerical value between 0 and 1.
- 5. The multi-dimensional construction data storage method according to claim 4, wherein in step S2, the step of calculating the spatial resolution factor comprises: Counting the number of times of occurrence of a predefined separator in the space dimension code, and adding 1 to the number of times to obtain the level depth of the space dimension code; the hierarchical depth is divided by a preset maximum hierarchical depth value and normalized to a spatial resolution factor having a value between 0 and 1.
- 6. The multi-dimensional construction data storage method according to claim 5, wherein in step S2, the step of calculating the coding similarity factor includes: respectively extracting structural feature vectors of object dimension codes and type dimension codes; And calculating the similarity of the two structural feature vectors, and normalizing the similarity to a coding similarity factor with a numerical value between 0 and 1.
- 7. The multi-dimensional construction data storage method according to claim 6, wherein in step S4, the calculating step of the logical storage coordinates includes: based on a splicing sequence determined by the numerical value size relation of the time resolution factor and the space resolution factor, splicing the space dimension code and the time dimension code in the multidimensional feature identifier to generate space-time joint codes, and carrying out hash operation on the space-time joint codes to obtain an initial hash value; Based on the numerical value of the coding similarity factor, a preset threshold interval and a predefined combination strategy, splicing object dimension codes and type dimension codes in the multidimensional feature identifiers to generate a combination character string, and performing checksum algorithm calculation on the combination character string to obtain a combination checksum; Performing bit operation fusion on the initial hash value and the combined checksum to generate an intermediate hash value; Calculating a weighted sum of the time resolution factor, the spatial resolution factor and the coding similarity factor, determining a displacement parameter based on the weighted sum, and performing displacement transformation on the intermediate hash value based on the displacement parameter to obtain a final hash value; and inputting the final hash value into an address mapping function, and calculating to obtain a logic storage coordinate.
- 8. The method according to claim 7, wherein the displacement parameter is a number of bits shifted left in a cycle, and the number of bits shifted left in a cycle is obtained by calculating an integer part of the weighted sum and modulo the bit width of the intermediate hash value by the integer part.
- 9. The multi-dimensional construction data storage method according to claim 8, wherein step S6 further comprises a multi-dimensional index construction step comprising: after the ordered data blocks are written into the disk storage layer, establishing a multidimensional inverted index; the multidimensional inverted index comprises four independent inverted index tables, namely a time dimension inverted index table, a space dimension inverted index table, an object dimension inverted index table and a type dimension inverted index table; each inverted index table maps a particular dimension code value to a list of physical memory addresses of all ordered data blocks containing the code value.
- 10. A multi-dimensional construction data storage system, characterized in that it is applied to a multi-dimensional construction data storage method according to any one of claims 1 to 9, said storage system comprising: The feature extraction and coding module is used for extracting original feature values of four dimensions of time, space, object and type of each construction data unit to be stored, carrying out normalized coding processing and respectively generating a time dimension code, a space dimension code, an object dimension code and a type dimension code; the resolution factor calculation module is used for calculating a time resolution factor based on the time dimension code, calculating a space resolution factor based on the space dimension code and calculating a coding similarity factor based on the object dimension code and the type dimension code; the feature identifier generation module is used for combining the time dimension code, the space dimension code, the object dimension code and the type dimension code into a multidimensional feature identifier corresponding to each construction data unit to be stored; the logic storage coordinate calculation module is used for calculating the logic storage coordinate of each construction data unit to be stored through a dimension perception hash algorithm based on the multidimensional feature identifier and combining the time resolution factor, the space resolution factor and the coding similarity factor; the memory ordered structure management module is used for combining each construction data unit to be stored and the corresponding logic storage coordinates thereof into an ordered structure in which memory data items are inserted into a memory based on the sequence of the logic storage coordinates; And the batch persistence storage module is used for converting all the memory data items into ordered data blocks in batches according to the sequence of the logic storage coordinates when the total data amount of all the memory data items accumulated in the ordered structure in the memory reaches a preset refreshing threshold value, refreshing the ordered data blocks to a disk storage layer and recording a physical storage address.
Description
Multidimensional construction data storage system and method Technical Field The invention relates to the technical field of data storage, in particular to a multidimensional construction data storage system and a multidimensional construction data storage method. Background In the field of modern construction engineering construction management, along with the wide application of intelligent construction site technology, a building information model and Internet of things equipment, massive multi-source heterogeneous construction data are continuously generated in the whole life cycle of engineering projects, and the data need to be effectively stored. The traditional construction data storage method mainly relies on a relational database or a file system to organize data, and has obvious limitation in processing multidimensional associated data. The relational database depends on a predefined table structure, is difficult to flexibly adapt to multidimensional data association which dynamically changes in the construction process, causes stiffness of a data model, and cannot effectively express complex relations among time sequences, spatial distribution, object levels and type classification. In addition, the prior storage technology generally adopts a single dimension such as time sequence to organize data, neglects the inherent multidimensional association characteristic of construction data, leads to the distributed distribution of data with close logical association on physical storage, and increases the seek time of a magnetic disk. The prior art has not thoroughly solved the problem of inherent relevance of multidimensional data, particularly insufficient performance in handling construction-specific dynamic relevance of spatio-temporal object types. Therefore, an innovative storage method is urgently needed in the field of building engineering, the multidimensional nature of construction data can be deeply understood, different dimensional characteristics are intelligently fused, and the data layout is dynamically optimized, so that the overall efficiency of construction data storage, retrieval and analysis is comprehensively improved. Therefore, it is necessary to provide a multidimensional construction data storage system and method to solve the above technical problems. Disclosure of Invention In order to solve the technical problems, the invention provides a multidimensional construction data storage system and a multidimensional construction data storage method, which achieve the beneficial effect of efficiently and intelligently storing multidimensional construction data. The invention provides a multidimensional construction data storage method, which comprises the following steps: S1, extracting original characteristic values of four dimensions of time, space, objects and types of each construction data unit to be stored, and carrying out normalized coding processing to generate a time dimension code, a space dimension code, an object dimension code and a type dimension code respectively; s2, calculating a time resolution factor based on the time dimension code, calculating a space resolution factor based on the space dimension code, and calculating a coding similarity factor based on the object dimension code and the type dimension code; s3, combining the time dimension code, the space dimension code, the object dimension code and the type dimension code into a multidimensional feature identifier corresponding to each construction data unit to be stored; s4, calculating the logic storage coordinates of each construction data unit to be stored through a dimension perception hash algorithm based on the multidimensional feature identifier and combining a time resolution factor, a space resolution factor and a coding similarity factor; S5, based on the sequence of the logic storage coordinates, combining each construction data unit to be stored and the corresponding logic storage coordinates thereof into an ordered structure in which memory data items are inserted into a memory; And S6, when the total data amount of all the memory data items accumulated in the ordered structure in the memory reaches a preset refreshing threshold value, converting all the memory data items into ordered data blocks in batches according to the sequence of the logic storage coordinates, refreshing the ordered data blocks to a disk storage layer, and recording a physical storage address. Preferably, in step S1, the original feature value is extracted from metadata of the construction data unit, where the metadata is standardized description information associated with the construction data unit in advance, and includes creation time, spatial location, construction object identifier, and data type identifier. Preferably, in step S1, the normalized encoding process includes: and mapping the original characteristic values of the four dimensions into standardized codes in a fixed format by adopting a preset code conver