CN-115640360-B - Dynamic compression type distributed data storage method, storage system and device

Abstract

The invention discloses a dynamic compression type distributed data storage method, a storage system and a device, which comprise the steps of setting a distributed storage node plug-in, starting a private distributed storage node, triggering a content addressing identification intelligent contract according to a storage request of an external system, generating a corresponding key pair of the distributed storage node, enabling the distributed storage node to adapt to a dynamic distributed network based on the content addressing identification intelligent contract, selecting a weighting factor for storage data by the distributed storage node, calculating the data value of the storage data, setting storage data attributes by the distributed storage node, distributing the whole storage area, reserving a storage space for the storage data according to the data value, determining a default storage period, compressing the storage data according to the data value, the data attributes, the reserved storage space and the storage period, and storing the compressed data into a database.

Inventors

• LUO CHUNFENG
• HUANG BUTIAN
• YIN YUYU
• HE QINMING
• LIU ZHENGUANG
• CHEN JIANHAI

Assignees

• 杭州云象网络技术有限公司

Dates

Publication Date

20260505

Application Date

20221031

Claims (7)

1. 1. A method of dynamic compression type distributed data storage, comprising the steps of: Setting a distributed storage node plug-in to start a private distributed storage node, triggering a content addressing identification intelligent contract to start a stored data automatic processing flow according to a storage request of an external system; the content addressing identification intelligent contract appoints block link point addresses and generates corresponding key pairs of the distributed storage nodes; the block chain node selects a weighting factor for the stored data and calculates the stored data value of the stored data; setting storage data attributes by the distributed storage nodes, distributing the whole storage area, reserving storage space for the storage data according to the value of the storage data, and determining a default storage period; and acquiring a key pair, acquiring the value, the attribute, the reserved storage space and the default storage period of the stored data, encrypting and compressing the stored data, and storing the encrypted and compressed stored data into a database.
2. 2. The method of claim 1, wherein the step of starting the automatic processing flow of the storage data comprises the steps of receiving the storage data of an external system, storing the storage data in the external system when the distributed storage node plug-in is set, triggering a content addressing identification intelligent contract, detecting the condition of the storage data, and designating the block chain node address according to the detection result.
3. 3. The method of claim 1, wherein setting the weighting factor comprises setting a frequency of use of the stored data to a, setting a number of downloads of the stored data to b, setting a user instance of the stored data to c, and setting a product price of the stored data to d.
4. 4. A method of dynamically compressed distributed data storage according to claim 1 or 3, wherein the calculating of the stored data value based on the weighting factors is performed by: Setting the weighting factor coefficients of the a, b, c, d th component as E1, E2, E3 and E4; Calculation of stored data value=a×e1 +bxE2 +c×E +c XE.
5. 5. The method of dynamic compression distributed data storage according to claim 1, wherein compressing the stored data is achieved by a direct compression method, the specific implementation steps comprising: Acquiring a data set; the data group is divided into 16 sections with 128 bit word length, 8 bits are respectively arranged in each section, the 1 st section is a compression control section, the rest sections are data sections, and the data sections and the compression control section jointly determine storage data.
6. 6. A computer-readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the method steps of any one of claims 1 to 5.
7. 7. A dynamically compressed distributed data storage device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the method steps of any one of claims 1 to 5 when the computer program is executed.

Description

Dynamic compression type distributed data storage method, storage system and device Technical Field The invention belongs to the technical field of blockchain, and particularly relates to a dynamic compression type distributed data storage method, a storage system and a storage device. Technical Field Database technology is an important component of advanced information technology, and is the foundation and core of modern computer information systems and computer application systems, beginning in the mid 60 s of the 20 th century. According to the development of the data model, the method can be divided into three development stages, namely a first generation mesh-shaped hierarchical database system, a second generation relational database system and a third generation database system taking an object-oriented model as a main characteristic. With the continuous advancement of scientific technology, various industries put more demands on database technology, and are combined with various new technologies, such as distributed processing technology, to gradually apply to multiple fields, so that various new database technologies are derived. Blockchain technologies include the use of P2P networking technologies, cryptography technologies, data storage technologies, consensus algorithms, and smart contract technologies. Essentially a de-centralized database, and cryptographically associating blocks of data with each other to form a block chain data structure, each block of data containing asset transaction information for verifying the validity of the information and generating the next block. The maintenance of the blockchain database is de-centralized and de-trusted. Compared with the traditional centralization technology, the blockchain database has no advantages in data transmission, processing and storage, the system transaction amount per unit time exceeds the bearing capacity of a software-hardware network environment or exceeds the performance of the node with the weakest processing capacity, and related transactions can be similar to a message processing system to generate backlog queues, so that the processing is slow, and therefore, the blockchain technology needs a CPU with high performance and also needs to ensure network bandwidth and storage space, so that under the condition of limited current resources, particularly internet bandwidth, if the transaction behavior with high effectiveness completely depends on the blockchain data storage technology, the good performance requirement cannot be achieved. Conventional databases have the advantage of strong consistency, high speed reliable processing power, multidimensional analysis, and persistence over blockchains. The distributed database allows the application program developed by the user to treat a plurality of databases which are physically separated and interconnected through a network as a complete database, and the operation of the user on the database in the traditional database is that (1) the database is created, (2) the database is read, (3) the database is updated, and (4) the database is deleted. The blockchain database only supports two types of operations of users on the database, namely (1) reading and (2) adding, namely new data can only be added into the blockchain database in the form of additional blocks, and the data in the previous database can be permanently stored and cannot be changed only by reading. The block chain database technology and the traditional database technology have various advantages and disadvantages, and combining and complementing the two technologies not only helps to improve the efficiency of processing data of the block chain database, but also can realize the function of decentralizing and not falsifying. Therefore, there is a need to design a transaction network that dynamically addresses blockchain dynamics in a dynamic network compression type distributed data storage method. Disclosure of Invention Based on the background and the problems existing in the prior art, the invention aims to design a storage method of a compression type database adapting to a block chain dynamic network, which can solve the problem of slow processing and realize permanent storage and alteration of data based on the characteristics of the block chain. The storage system can improve the efficiency of data storage so as to dynamically process the backlog of the network transaction data. To achieve these objects and other advantages and in accordance with the purpose of the invention, as embodied and broadly described herein, there is provided a dynamic compression type distributed data storage method, comprising: Setting a distributed storage node plug-in to start a private distributed storage node, triggering a content addressing identification intelligent contract to start a stored data automatic processing flow according to a storage request of an external system; The intelligent contract can realize the adaptation of