CN-121979449-A - Data acquisition method, data transmission method and data acquisition system

CN121979449ACN 121979449 ACN121979449 ACN 121979449ACN-121979449-A

Abstract

The application relates to the technical field of storage and discloses a data acquisition method, a data transmission method and a data acquisition system, wherein the method is applied to a RAID controller, the RAID controller is connected with a terminal and at least two storage devices, the method is used for inquiring an address identification management table in the RAID controller based on a logic address in the read command in response to the read command sent by the terminal so as to acquire a first type identification of data corresponding to the logic address, if the first type identification is a characteristic data identification, specific data is generated and transmitted to the terminal, and if the first type identification is a non-characteristic data identification, data corresponding to the read command is acquired from the storage devices based on the read command and transmitted to the terminal, so that the data transmission quantity between the RAID controller and the storage devices can be reduced, and the data acquisition efficiency is improved.

Inventors

FANG HAOJUN
WANG LU
HUANG YUNXIN

Assignees

深圳大普微电子股份有限公司

Dates

Publication Date: 20260505
Application Date: 20251231

Claims (10)

1. The data acquisition method is characterized by being applied to a RAID controller, wherein the RAID controller is connected with a terminal and at least two storage devices, and the method comprises the following steps: Responding to a read command sent by the terminal, and inquiring an address identification management table in the RAID controller based on a logic address in the read command to acquire a first type identification of data corresponding to the logic address, wherein the first type identification comprises a characteristic data identification or a non-characteristic data identification; If the first type identifier is the characteristic data identifier, specific data are generated, and the specific data are sent to the terminal; and if the first type identifier is the non-characteristic data identifier, initiating a read operation to the storage device based on the read command.
2. The method of claim 1, wherein a read operation is initiated to the storage device, the method further comprising: based on the read command, acquiring a second type identifier returned by the storage device, wherein the second type identifier at least comprises a characteristic data identifier or a non-characteristic data identifier; If the second type identifier is the characteristic data identifier, generating the specific data and sending the specific data to the terminal; And if the second type identifier is the non-characteristic data identifier, acquiring data corresponding to the read command from the storage device based on the read command.
3. The method of claim 2, wherein after retrieving the data corresponding to the read command from the storage device, the method further comprises: Performing feature recognition on the data corresponding to the read command to determine the type of the data corresponding to the read command, wherein the type of the data comprises feature data or non-feature data; if the type of the data corresponding to the read command is characteristic data, updating an address identification management table and sending the data corresponding to the read command to the terminal; and if the type of the data corresponding to the read command is the non-characteristic data, directly returning the data corresponding to the read command to the terminal.
4. The method of claim 3, wherein the step of, Before the data corresponding to the read command is acquired from the storage device, the method further includes: Pre-configuring the characteristic data in the RAID controller; The feature recognition is performed on the data corresponding to the read command to determine the type of the data corresponding to the read command, including: and the RAID controller compares the data corresponding to the read command with the characteristic data to determine the type of the data corresponding to the read command.
5. A method according to claim 3, characterized in that the method further comprises: Responding to a write command sent by the terminal to receive data corresponding to the write command; After updating the address identification management table, writing the data corresponding to the write command into the storage device.
6. The method according to claim 1, wherein the method further comprises: Generating a data reconstruction command when the RAID controller is in a reconstruction state, wherein the data reconstruction command comprises a source storage device and a target storage device, and the source storage device and the target storage device are storage devices in the at least two storage devices; Sending the data reconstruction command to the source storage device to acquire a third type identifier returned by the source storage device, wherein the third type identifier comprises a characteristic data identifier or a non-characteristic data identifier; If the third type identifier is the characteristic data identifier, a first instruction is generated, and the first instruction is sent to the target storage device, so that the target storage device executes an operation corresponding to the first instruction; And if the third type identifier is the non-characteristic data identifier, generating a second instruction, acquiring the data of the source storage device based on the second instruction, and transmitting the data of the source storage device to the target storage device.
7. A data transmission method applied to a storage device, the storage device being connected to a RAID controller, the method comprising: responding to a read command sent by the RAID controller, and inquiring a mapping table in the storage equipment based on a logic address corresponding to the read command to acquire a fourth type identifier of the logic address, wherein the fourth type identifier comprises a characteristic data identifier or a non-characteristic data identifier; if the fourth type identifier is a characteristic data identifier, the characteristic data identifier is sent to the RAID controller; and if the fourth type identifier is a non-characteristic data identifier, sending the data corresponding to the read command to the RAID controller.
8. The data acquisition system is characterized by comprising a terminal, a RAID controller and storage equipment, wherein the RAID controller comprises a RAID processing engine and a first interface module, and the RAID processing engine comprises a central processing unit, a second interface module and a data characteristic identification module; The first interface module is connected with the terminal, the second interface module and the storage device and is used for receiving a read command sent by the terminal; The central processing unit is connected with the second interface module and is used for inquiring an address identification management table based on the read command sent by the terminal to determine the type identification corresponding to the logic address in the read command, generating specific data if the type identification corresponding to the logic address is determined to be the characteristic data identification, returning the specific data to the terminal, and sending the read command to the second interface module if the type identification corresponding to the logic address is determined to be the non-characteristic data identification; the second interface module is connected with the central processing unit, the data characteristic identification module and the first interface module and is used for sending the read command to the first interface module, and the first interface module is used for sending the read command to the storage device; The storage device is connected with the first interface module, and is used for receiving the read command, inquiring a mapping table to determine a type identifier corresponding to a logic address in the read command, if the type identifier corresponding to the logic address is determined to be a characteristic data identifier, the characteristic data identifier is sent to the first interface module, and if the type identifier corresponding to the logic address is determined to be a non-characteristic data identifier, the data corresponding to the read command is sent to the first interface module; the data characteristic identification module is connected with the second interface module and is used for identifying the data returned by the storage device to obtain the type of the data, the type of the data is sent to the central processing unit through the second interface module, and the central processing unit determines whether specific data is generated or not.
9. The system of claim 8, wherein the data feature recognition module comprises an interface processing module, a feature configuration module, a process control module; the interface processing module is connected with the characteristic configuration module, the processing control module and the second interface module and is used for receiving data corresponding to a read command returned by the storage device and sent by the second interface module; The feature configuration module is connected with the interface processing module and the processing control module and is used for configuring preset feature data; The processing control module is connected with the feature configuration module and the interface processing module and is used for identifying the data returned by the storage device to determine the type of the data, sending the type of the data to the interface processing module, and sending the type of the data to the central processor by the interface processing module.
10. The system of claim 8, wherein the type of data comprises characteristic data and non-characteristic data, the characteristic data corresponds to a characteristic data identifier, and the storage device comprises a front-end module, a data processing module, an algorithm module, a back-end module and a data storage module; The front-end module is connected with the first interface module and the data processing module and is used for receiving the read command and sending the read command to the data processing module; the data processing module is connected with the front-end module and the algorithm module, and is used for distributing a buffer area for data corresponding to the read command and sending the read command to the algorithm module; the algorithm module is connected with the data processing module and the back-end module and is used for inquiring a mapping table based on the read command, if the type identifier corresponding to the logic address in the read command is a characteristic data identifier, the characteristic data identifier is sent to the data processing module, and if the type identifier corresponding to the logic address in the read command is a non-characteristic data identifier, a data reading instruction is generated and sent to the back-end module; The back-end module is connected with the algorithm module and the data storage module and is used for acquiring data from the data storage module based on the data reading instruction.

Description

Data acquisition method, data transmission method and data acquisition system Technical Field The embodiment of the application relates to the technical field of storage, in particular to a data acquisition method, a data transmission method and a data acquisition system. Background The redundant array of independent disks technology (Redundant Array of INDEPENDENT DISKS, RAID) combines a plurality of disks to form a unified logic storage unit, thereby realizing the optimization and improvement of the performance, the reliability and the capacity of the storage system. At present, when a host reads data from a disk and then transmits the data to the host or reconstructs the data in the disk, the RAID directly stores the copied data in another disk after reading the data in the disk, however, for some data with obvious characteristics, such as data recovered by the host garbage, the data still needs to be read or copied in full from a storage device, a large amount of bandwidth inside the RAID needs to be occupied, and the overall operation efficiency of the system is reduced. Disclosure of Invention In order to solve the above technical problems, embodiments of the present application provide a data acquisition method, a data transmission method, and a data acquisition system, which can reduce the data transmission amount between a RAID controller and a storage device, so as to improve the data acquisition efficiency. In order to solve the technical problems, the embodiment of the application provides the following technical scheme: in a first aspect, an embodiment of the present application provides a data acquisition method, which is applied to a RAID controller, where the RAID controller is connected to a terminal and at least two storage devices, and the method includes: responding to a read command sent by a terminal, and inquiring an address identification management table in the RAID controller based on a logic address in the read command to obtain a first type identification of data corresponding to the logic address, wherein the first type identification comprises a characteristic data identification or a non-characteristic data identification; If the first type identifier is the characteristic data identifier, generating specific data and sending the specific data to the terminal; And if the first type identifier is a non-characteristic data identifier, initiating a read operation to the storage device based on a read command. In some embodiments, the method further comprises initiating a read operation to the storage device, the method further comprising: Based on the read command, acquiring a second type identifier returned by the storage device, wherein the second type identifier at least comprises a characteristic data identifier or a non-characteristic data identifier; If the second type identifier is the characteristic data identifier, generating specific data and sending the specific data to the terminal; And if the second type identifier is the non-characteristic data identifier, acquiring data corresponding to the read command from the storage device based on the read command. In some embodiments, after the data corresponding to the read command is obtained from the storage device, the method further includes: Performing feature recognition on data corresponding to the read command to determine the type of the data corresponding to the read command, wherein the type of the data comprises feature data or non-feature data; If the type of the data corresponding to the read command is characteristic data, updating an address identification management table and sending the data corresponding to the read command to the terminal; if the type of the data corresponding to the read command is non-characteristic data, the data corresponding to the read command is directly returned to the terminal. In some embodiments, before the data corresponding to the read command is obtained from the storage device, the method further includes: Pre-configuring characteristic data in a RAID controller; performing feature recognition on data corresponding to the read command to determine the type of the data corresponding to the read command, including: the RAID controller compares the data corresponding to the read command with the characteristic data to determine the type of the data corresponding to the read command. In some embodiments, the method further comprises: responding to a write command sent by a terminal to receive data corresponding to the write command; after updating the address identification management table, writing the data corresponding to the write command into the storage device. In some embodiments, the method further comprises: when the RAID controller is in a reconstruction state, generating a data reconstruction command, wherein the data reconstruction command comprises a source storage device and a target storage device, and the source storage device and the target storage device are s