CN-122018781-A - Data management method, device and storage medium based on object storage

CN122018781ACN 122018781 ACN122018781 ACN 122018781ACN-122018781-A

Abstract

The application discloses a data management method, equipment and a storage medium based on object storage, wherein the method comprises the steps of receiving object data to be stored and object names of the object data, and sending the object data and the object names to an object storage end for associated storage; and visually displaying the directory structure in the data management page, and realizing the management of the object data associated with the storage address under the directory structure in the object storage terminal based on the data management operation received by the data management page. The expression form of the directory structure not only accords with the use habit of a user, but also does not need to operate the object data actually stored by the object storage end when the user needs to manage any object data, and only needs to modify the directory structure, thereby reducing the difficulty and cost of data management.

Inventors

JIANG WENLONG
ZHU SHENG
WAN YUZHU
WANG HUI
XU TAO

Assignees

浙江大华技术股份有限公司

Dates

Publication Date: 20260512
Application Date: 20251216

Claims (10)

1. A method of object storage-based data management, the method comprising: Receiving object data to be stored and an object name of the object data, and sending the object data and the object name to an object storage end for associated storage; determining a directory structure corresponding to the object data based on the object name, and associating the object name as a storage address under the directory structure; And visually displaying the directory structure in a data management page, and managing object data associated with a storage address under the directory structure in the object storage terminal based on data management operation received by the data management page.
2. The method of claim 1, wherein the directory structure is comprised of a plurality of directory hierarchies, wherein the determining the directory structure to which the object data corresponds based on the object name, associating the object name as a storage address under the directory structure, comprises: Determining an upper directory corresponding to the object data based on the object name; And if the object name does not exist, creating an upper-layer directory corresponding to the object data, and associating the object name as a storage address under the upper-layer directory.
3. The method of claim 2, wherein after the determining a directory structure to which the object data corresponds based on the object name, associating the object name as a storage address under the directory structure, the method further comprises: Generating a file directory tree based on an upper directory corresponding to each directory hierarchy and an upper directory corresponding to the object data, and generating metadata corresponding to each directory hierarchy and metadata corresponding to the object data; the visual display of the directory structure and the directory in the data management page comprises the following steps: and visually displaying the directory structure and the object data based on the file directory tree, the metadata corresponding to each directory hierarchy and the metadata corresponding to the object data.
4. The method of claim 1, wherein the directory structure is composed of a plurality of directory hierarchies, metadata corresponding to the object data includes an upper directory of the object data, and the managing the object data associated with the storage address under the directory structure in the object storage based on the data management operation received by the data management page includes: Determining a directory hierarchy to be moved in to obtain a target directory hierarchy in response to directory movement operation performed by a user on the object data; Determining a new upper-layer directory corresponding to the object data based on the target directory hierarchy; And updating an upper-layer directory in metadata corresponding to the object data into the new upper-layer directory so as to move a storage address corresponding to the object data into the target directory level.
5. The method of claim 1, wherein metadata corresponding to the object data includes a data name of the object data, and wherein the managing the object data associated with the storage address in the directory structure in the object storage based on the data management operation received by the data management page includes: Responding to renaming operation executed by a user on the data name of the object data, and acquiring the input new name of the object data; and updating the data name in the metadata corresponding to the object data to the new name.
6. The method of claim 1, wherein the managing the object data associated with the storage address in the directory structure in the object storage based on the data management operation received by the data management page comprises: Responding to a query operation, a deletion operation or a modification operation executed by a user aiming at a management interface of the object data, and acquiring a storage address corresponding to the object data to obtain a target address; Generating a data query instruction or a data deletion instruction or a data modification instruction carrying the target address; and sending the data query instruction, the data deletion instruction or the data modification instruction to the object storage end so as to enable the object storage end to query, delete or modify the object data of which the object name is matched with the target address.
7. The method of claim 1, applied to any node in a distributed cluster, the node being deployed with a traffic receiver and a traffic processor: the service receiver is used for receiving object data to be stored and object names of the object data; The service processor is configured to determine a directory structure corresponding to the object data based on the object name, associate the object name as a storage address under the directory structure, calculate metadata corresponding to the object data, send the directory structure and the metadata to a metadata storage end for storage, query an object storage end matched with the object data, and send the object storage end to the service receiver; and the service receiver sends the object data and the object name to the object storage end for associated storage based on the object storage end sent by the service processor.
8. The method of claim 7, wherein the metadata store is implemented based on a distributed cluster, the method further comprising: creating a plurality of database instances on the nodes when the number of the nodes in the metadata storage end is single, wherein the database instances are used for storing the directory structure and the metadata; When the number of the nodes in the metadata storage end is a plurality of, a main database instance and a standby database instance are created on different nodes.
9. An electronic device comprising a memory and a processor for executing program instructions stored in the memory to implement the steps of the method according to any of claims 1-8.
10. A computer readable storage medium storing program instructions executable by a processor to perform the steps of the method according to any one of claims 1-8.

Description

Data management method, device and storage medium based on object storage Technical Field The present application relates to the field of data processing technologies, and in particular, to a method, an apparatus, and a storage medium for managing data based on object storage. Background Object storage, also known as object-based storage, is adapted for storage of unstructured data, such as video data, image data, etc., each in the same level of flat address space, referred to as a storage pool. However, the data management of the object storage is very inconvenient, and the object to be modified is generally required to be deleted and rewritten, so that the difficulty and cost of data management are increased. Disclosure of Invention In order to solve the technical problems, the application at least provides a data management method, equipment and a storage medium based on object storage. The first aspect of the application provides a data management method based on object storage, which comprises the steps of receiving object data to be stored and object names of the object data, sending the object data and the object names to an object storage end for associated storage, determining a directory structure corresponding to the object data based on the object names, associating the object names as storage addresses under the directory structure, visually displaying the directory structure in a data management page, and managing the object data associated with the storage addresses under the directory structure in the object storage end based on data management operation received by the data management page. In one embodiment, the directory structure is composed of a plurality of directory levels, the directory structure corresponding to the object data is determined based on the object names, the object names are associated with the directory structure as storage addresses, the method comprises the steps of determining upper-layer directories corresponding to the object data based on the object names, judging whether the upper-layer directories exist, if so, associating the object names with the upper-layer directories as storage addresses, and if not, creating the upper-layer directories corresponding to the object data, and associating the object names with the upper-layer directories as storage addresses. In one embodiment, after determining the directory structure corresponding to the object data based on the object name and associating the object name as a storage address under the directory structure, the method further includes generating a file directory tree based on the upper directory corresponding to each directory level and the upper directory corresponding to the object data, and generating metadata corresponding to each directory level and metadata corresponding to the object data, and visually displaying the directory structure and the metadata corresponding to the object data in the data management page, including visually displaying the directory structure and the metadata corresponding to the object data based on the file directory tree, the metadata corresponding to each directory level, and the metadata corresponding to the file directory tree. In one embodiment, the directory structure is composed of a plurality of directory levels, and metadata corresponding to the object data contains an upper directory of the object data; the method comprises the steps of determining a directory hierarchy to be moved in to obtain a target directory hierarchy in response to directory moving operation executed by a user on the object data, determining a new upper directory corresponding to the object data based on the target directory hierarchy, and updating the upper directory in metadata corresponding to the object data into the new upper directory so as to move the storage address corresponding to the object data into the target directory hierarchy. In one embodiment, metadata corresponding to the object data contains a data name of the object data, and the management of the object data associated with a storage address under a directory structure in an object storage terminal based on a data management operation received by a data management page comprises obtaining a new name of the input object data in response to a renaming operation executed by a user on the data name of the object data, and updating the data name in the metadata corresponding to the object data to the new name. In one embodiment, a management interface of the object data is displayed in a data management page, the object data associated with a storage address under a directory structure in an object storage terminal is managed based on a data management operation received by the data management page, and the method comprises the steps of responding to a query operation or a deletion operation or a modification operation executed by a user on the management interface of the object data, obtaining a storage address correspondin