CN-121979954-A - Intelligent terminal decentralizing data storage and calling method, system and storage medium
Abstract
The application relates to an intelligent terminal decentralizing data storage and calling method, a system and a storage medium, wherein the method comprises the steps that a cloud data center divides full data into a plurality of logic data fragments, allocates a main storage area and generates and maintains a total key rule base; the method comprises the steps of issuing data items to regional monitoring equipment, storing the data items in an intelligent terminal through the regional monitoring equipment, recording data item identifiers and mapping relations of intelligent terminal addresses for storing the data items to form and maintain a metadata index table, sending a query request to the regional monitoring equipment of a region when a first intelligent terminal obtains target data, determining an address of a second intelligent terminal for storing the target data through the regional monitoring equipment, returning the address, and establishing point-to-point connection with the second intelligent terminal based on the returned address to obtain the target data. The cloud storage system and the cloud storage method thereof reduce cloud storage pressure, improve data access efficiency and enhance system reliability.
Inventors
- CHEN WEICAI
Assignees
- 深圳市海威达科技有限公司
Dates
- Publication Date
- 20260505
- Application Date
- 20260120
Claims (10)
- 1. The method for storing and calling the decentralised data of the intelligent terminal is characterized by being applied to a system comprising a cloud data center, at least one area monitoring device and a plurality of intelligent terminals, and comprises the following steps: Dividing the total data into a plurality of logic data fragments by the cloud data center, distributing a main storage area for each logic data fragment, and generating and maintaining a total key rule base, wherein the main storage area corresponds to the area monitoring equipment; Responding to a system initialization or data import instruction, and transmitting data items corresponding to each logic data fragment to the area monitoring equipment corresponding to the main storage area through the cloud data center according to the total key rule base; storing the received data items in at least one intelligent terminal managed by the area monitoring equipment through the area monitoring equipment, recording the data item identification and the mapping relation of the intelligent terminal address storing the data items, and forming and maintaining a metadata index table of the area; when a first intelligent terminal acquires target data, a query request containing a target data identifier is sent to the regional monitoring equipment of the region; Inquiring the metadata index table through the area monitoring equipment according to the target data identification in the inquiry request, determining the address of one or more second intelligent terminals for storing the target data, and returning the address to the first intelligent terminal; And establishing point-to-point connection with at least one second intelligent terminal by the first intelligent terminal based on the returned address so as to acquire the target data.
- 2. The method for storing and invoking data in a decentralized manner according to claim 1, wherein the cloud data center divides the total amount of data into a plurality of logical data slices, allocates a main storage area for each logical data slice, and generates and maintains a rule base of total keys, comprising: acquiring a unique identifier set of the full data; Calculating based on each unique identifier in the unique identifier set by adopting a consistent hash algorithm to obtain a target hash value; dividing a hash value space corresponding to the target hash value into a plurality of continuous intervals, wherein each interval corresponds to one logic data fragment; and allocating the main storage area for each logic data fragment, and generating and maintaining the total key rule base.
- 3. The method for storing and invoking data in the decentralized data according to claim 1, wherein after said establishing a point-to-point connection with at least one of the second intelligent terminals via the first intelligent terminal based on the returned address to obtain the target data, the method further comprises: Recording an access log of the target data through the area monitoring equipment or the first intelligent terminal; predicting the access heat of the data item by using a machine learning model based on a historical access log through the area monitoring equipment; and according to the predicted access heat, caching the data items higher than the preset access heat threshold to other intelligent terminals except the original storage terminal in the area.
- 4. The intelligent terminal de-centralized data storage and recall method of claim 1, further comprising a data synchronization step comprising: the locally generated incremental data are asynchronously uploaded to the regional monitoring equipment of the local region through each intelligent terminal; packaging the incremental data through the area monitoring equipment to obtain packaged incremental data; And when the network is determined to be idle, uploading the packed incremental data to the cloud data center in batches for backup.
- 5. The intelligent terminal de-centralized data storage and invocation method of claim 4, further comprising a global optimization step comprising: Periodically collecting access logs and system state reports uploaded by each regional monitoring device through the cloud data center to obtain global data; Dynamically adjusting the total key rule base based on the global data, wherein an adjustment strategy comprises at least one of marking hot spot data fragments and increasing recommended copy numbers, adjusting a main storage area of the logic data fragments to balance storage loads among areas, and adjusting weights of virtual nodes in consistent hashes to balance node loads; And transmitting the adjusted strategy to each regional monitoring device so that the regional monitoring device updates local data management and caching behaviors according to the adjusted strategy.
- 6. The intelligent terminal decentralizing data storage and retrieval method of claim 1, wherein after the storing, by the area monitoring device, the received data item in at least one intelligent terminal managed by the area monitoring device, the method further comprises: and creating a plurality of copies for the data item, and respectively storing the copies on different intelligent terminals.
- 7. The intelligent terminal de-centralized data storage and invocation method according to any one of claims 1 to 6, further comprising: the data items stored in the intelligent terminal are all encrypted; and after the first intelligent terminal acquires the encrypted target data from the second intelligent terminal, decrypting the encrypted target data by using a pre-shared secret key, wherein the target data is encrypted by adopting an HMAC-SHA256 algorithm.
- 8. An intelligent terminal de-centralized data storage and invocation system for implementing the method of any of claims 1 to 7, said system comprising: The cloud data center is used for generating and maintaining a total key rule base and executing global backup and policy optimization of data; The area monitoring equipment is in communication connection with the cloud data center and is used for receiving data slicing tasks from the cloud data center, managing data storage of a plurality of intelligent terminals in a logic area, generating and maintaining a metadata index table, responding to a data query request of the intelligent terminals and returning data storage addresses; The intelligent terminals are in communication connection with the area monitoring equipment, point-to-point connection is established among the intelligent terminals, and the intelligent terminals are used as distributed storage nodes for storing encrypted data items and exchanging data with other intelligent terminals according to the returned address of the area monitoring equipment.
- 9. The intelligent terminal de-centralized data storage and retrieval system of claim 8, wherein the area monitoring device comprises: an index management module, configured to maintain the metadata index table; the coordination scheduling module is used for distributing data storage tasks and executing a data caching strategy according to the storage capacity and the online state of the intelligent terminal; and the communication module is used for communicating with the cloud data center and the intelligent terminal in the local area.
- 10. A computer readable storage medium, characterized in that it has stored thereon a computer program, which when executed by a processor implements the intelligent terminal de-centralizing data storing and invoking method according to any of claims 1-7.
Description
Intelligent terminal decentralizing data storage and calling method, system and storage medium Technical Field The application relates to the technical field of data processing, in particular to an intelligent terminal decentralizing data storage and calling method, an intelligent terminal decentralizing data storage and calling system and a storage medium. Background With the wide application of big data technology, a large number of small intelligent terminal devices such as attendance terminals, consumption terminals and guest machines are deployed in an enterprise scene. Such devices continue to generate massive traffic data in daily operation, but due to hardware resource limitations, their local storage capacity is extremely limited, and it is difficult to meet long-term data accumulation requirements. Meanwhile, the centralized storage of the cloud data center is excessively depended on, so that the operation cost of enterprises is obviously increased, the cloud service cost is high, and the server performance requirement is severe. Under the scene that the data volume exceeds the effective storage threshold of the terminal, the terminal frequently initiates real-time cloud data requests, network communication congestion is easily caused, data updating is delayed or even interrupted, and service continuity is seriously affected. In addition, the processing capacity of the local computer server is weak, and the large-scale data management task cannot be effectively supported, so that the data utilization efficiency of the intelligent terminal is further restricted. The bottleneck makes it difficult for enterprises to balance the contradiction between data storage cost, system response speed and service reliability, and a scheme capable of optimizing terminal data distribution, reducing cloud load and improving access efficiency is needed. Disclosure of Invention The embodiment of the application aims to provide an intelligent terminal decentralizing data storage and calling method, an intelligent terminal decentralizing data storage and calling system and a storage medium, and the intelligent terminal decentralizing data storage and calling method, the intelligent terminal decentralizing data storage and calling system and the storage medium have the advantages of reducing cloud storage pressure, improving data access efficiency and enhancing system reliability. In order to solve the above technical problems, an embodiment of the present application provides a method for storing and invoking decentralised data of an intelligent terminal, which is applied to a system including a cloud data center, at least one area monitoring device and a plurality of intelligent terminals, and the method includes: Dividing the total data into a plurality of logic data fragments by the cloud data center, distributing a main storage area for each logic data fragment, and generating and maintaining a total key rule base, wherein the main storage area corresponds to the area monitoring equipment; Responding to a system initialization or data import instruction, and transmitting data items corresponding to each logic data fragment to the area monitoring equipment corresponding to the main storage area through the cloud data center according to the total key rule base; storing the received data items in at least one intelligent terminal managed by the area monitoring equipment through the area monitoring equipment, recording the data item identification and the mapping relation of the intelligent terminal address storing the data items, and forming and maintaining a metadata index table of the area; when a first intelligent terminal acquires target data, a query request containing a target data identifier is sent to the regional monitoring equipment of the region; Inquiring the metadata index table through the area monitoring equipment according to the target data identification in the inquiry request, determining the address of one or more second intelligent terminals for storing the target data, and returning the address to the first intelligent terminal; And establishing point-to-point connection with at least one second intelligent terminal by the first intelligent terminal based on the returned address so as to acquire the target data. In order to solve the above technical problems, an embodiment of the present application provides an intelligent terminal decentralizing data storage and recall system, including: The cloud data center is used for generating and maintaining a total key rule base and executing global backup and policy optimization of data; The area monitoring equipment is in communication connection with the cloud data center and is used for receiving data slicing tasks from the cloud data center, managing data storage of a plurality of intelligent terminals in a logic area, generating and maintaining a metadata index table, responding to a data query request of the intelligent terminals and returning dat