CN-121979448-A - Data verification method and system

CN121979448ACN 121979448 ACN121979448 ACN 121979448ACN-121979448-A

Abstract

The application relates to the technical field of storage and discloses a data verification method and a system thereof, wherein the method is applied to a data verification system, the data verification system comprises a RAID controller and at least two storage devices, the RAID controller is in communication connection with the at least two storage devices, the storage devices comprise a data storage module, the method obtains information of the storage devices through the RAID controller, generates a rapid consistency check instruction based on the information of the storage devices, the storage devices obtain data corresponding to the rapid consistency check instruction from the data storage module based on the rapid consistency check instruction, calculates the data corresponding to the rapid consistency check instruction to obtain a calculated value, and sends the calculated value to the RAID controller, and the RAID controller compares the calculated values of the at least two storage devices to obtain a first verification result, so that the data transmission quantity between the RAID controller and the plurality of storage devices in the consistency check process can be reduced, and the consistency check efficiency of the plurality of storage devices is improved.

Inventors

FANG HAOJUN
WANG LU
HUANG YUNXIN

Assignees

深圳大普微电子股份有限公司

Dates

Publication Date: 20260505
Application Date: 20251231

Claims (10)

1. A data verification method, applied to a data verification system, the data verification system including a RAID controller and at least two storage devices communicatively connected to the RAID controller, the storage devices including a data storage module, the method comprising: The RAID controller acquires information of a storage device and generates a quick consistency check instruction based on the information of the storage device; The storage device obtains data corresponding to the rapid consistency check instruction from the data storage module based on the rapid consistency check instruction, calculates the data corresponding to the rapid consistency check instruction to obtain a calculated value, and sends the calculated value to the RAID controller; And the RAID controller acquires the calculated values sent by at least two storage devices, compares the calculated values of at least two storage devices, and obtains a first check result.
2. The method of claim 1, wherein the step of determining the position of the substrate comprises, The information of the storage device comprises a calculation mode, the calculation mode comprises at least two data integrity verification algorithms, the rapid consistency check instruction comprises a calculation algorithm, and the calculation algorithm is one of the at least two data integrity verification algorithms; Before the data corresponding to the rapid consistency check instruction is acquired from the data storage module, the method further comprises: the storage device starts a quick consistency check based on the quick consistency check instruction; the calculating the data corresponding to the rapid consistency check instruction to obtain a calculated value comprises the following steps: And calculating the data corresponding to the rapid consistency check instruction based on the calculation algorithm to obtain the calculated value.
3. The method of claim 1, wherein the RAID controller comprises a hardware accelerator, a preset alignment program; comparing the calculated values of at least two storage devices to obtain a first verification result, and further comprising: If the data length of the calculated value is greater than or equal to the preset data length, the RAID controller starts the hardware accelerator to compare the calculated values of at least two storage devices through the hardware accelerator, and the first check result is obtained; And if the data length of the calculated value is smaller than the preset data length, comparing the calculated values of at least two storage devices by the RAID controller through the preset comparison program to obtain the first check result.
4. The method according to claim 1, wherein the method further comprises: The RAID controller generates a comprehensive consistency check instruction based on a preset period, and sends the comprehensive consistency check instruction to the storage equipment to acquire data corresponding to the comprehensive consistency check instruction returned by at least two storage equipment; And the RAID controller checks the data corresponding to the comprehensive consistency check instruction returned by at least two storage devices to obtain a second check result.
5. The method of claim 4, wherein the step of determining the position of the first electrode is performed, Before generating the full-face consistency check instruction, the method further comprises: Acquiring configuration information; Setting operation parameters of the hardware accelerator based on the configuration information; After the data corresponding to the full consistency check instruction returned by the at least two storage devices is obtained, the method further includes: and verifying the data corresponding to the comprehensive consistency check instruction returned by at least two storage devices based on the operation parameters of the hardware accelerator to obtain the second verification result.
6. A data verification system, which is characterized by comprising a RAID controller and at least two storage devices, wherein the RAID controller comprises a central processing unit and a consistency verification module, and the storage devices comprise a data storage module; The central processing unit is connected with the at least two storage devices and is used for generating a rapid consistency check instruction and sending the rapid consistency check instruction to the at least two storage devices; The storage device is connected with the central processing unit and the consistency check module and is used for acquiring data corresponding to the quick consistency check instruction from the data storage module based on the quick consistency check instruction, calculating the data corresponding to the quick consistency check instruction to obtain a calculated value and sending the calculated value to the RAID controller; and the consistency verification module is connected with the storage equipment and is used for comparing calculated values corresponding to the data with the same logical block address in at least two storage equipment to obtain a third verification result.
7. The system of claim 6, wherein the system further comprises a controller configured to control the controller, The central processing unit is also used for acquiring configuration information, generating a comprehensive consistency check instruction based on the configuration information, and acquiring data returned by at least two storage devices based on the comprehensive consistency check instruction; and the consistency verification module is also used for verifying the data returned by the at least two storage devices to obtain a third verification result.
8. The system of claim 7, wherein the consistency check module comprises a management control module, a check configuration module, a data comparison module; The management control module is connected with the central processing unit, the checking configuration module and the data comparison module and is used for generating configuration information; the checking configuration module is connected with the management control module and is used for configuring the number of logic blocks checked each time based on the configuration information; And the data comparison module is connected with the management control module and is used for comparing calculated values corresponding to the data of the same logical block address in the at least two storage devices or checking the data corresponding to the same logical address in the at least two storage devices when the number of the logical blocks is determined to be larger than or equal to the preset number of the logical blocks, so as to obtain the third checking result.
9. The system of claim 6, wherein the storage device comprises a front-end module, a data processing module, an algorithm module, a back-end module, a cache space; the front-end module is connected with the central processing unit, the consistency check module and the data processing module and is used for receiving a rapid consistency check instruction sent by the central processing unit or receiving a full consistency check instruction sent by the central processing unit, wherein the rapid consistency check instruction comprises a first logic address and a calculation algorithm type, and the full consistency check instruction comprises a second logic address; The data processing module is connected with the front-end module and the algorithm module and is used for calculating data corresponding to the rapid consistency check instruction based on the calculation algorithm type to obtain the calculated value; the algorithm module is connected with the data processing module and the back-end module and is used for converting a first logic address into a first physical address or converting a second logic address into a second physical address; The back-end module is connected with the algorithm module and the data storage module and is used for acquiring data corresponding to the rapid consistency check instruction from the data storage module based on a first physical address or acquiring data corresponding to the full consistency check instruction from the data storage module based on a second physical address and caching the data corresponding to the rapid consistency check instruction or the data corresponding to the full consistency check instruction in the cache space.
10. The system of claim 6, wherein the data processing module comprises a computing engine comprising a management control module, a computing configuration module, a computing algorithm engine; The management control module is connected with the front-end module and is used for analyzing the rapid consistency check instruction to obtain the type of a calculation algorithm and the number of calculation logic blocks; the calculation configuration module is connected with the management control module and the algorithm engine and is used for configuring the operation parameters of the algorithm engine based on the calculation algorithm type and the calculation logic block number; The computing algorithm engine is connected with the management control module and the computing configuration module and is used for computing the data corresponding to the rapid consistency check instruction based on the operation parameters to obtain the computing value and sending the computing value to the front-end module.

Description

Data verification method and system Technical Field The embodiment of the application relates to the technical field of storage, in particular to a data verification method and a system thereof. Background The redundant array of independent disks technology (Redundant Array of INDEPENDENT DISKS, RAID) combines a plurality of disks to form a unified logic storage unit, so that the optimization and improvement of the performance, the reliability and the capacity of a storage system are realized, and the data consistency check (Consistency Check, CC) is an advanced maintenance function of the RAID array controller, and ensures the consistency of data of a plurality of disks by checking the data on the array in advance. At present, when the RAID card detects data of all the disks, the data of the different disks are generally read from different disks, and the data of the different disks are compared by a controller in the RAID card to confirm whether the data are consistent, however, full-quantity reading and transmission comparison are still performed on valid data and idle blank areas which are kept consistent in the disks, so that a large number of invalid reading and writing operations are generated, bandwidth resources between the RAID and the SSD are excessively occupied, centralized computing load of the RAID card is increased, and efficiency of data consistency verification is reduced. Disclosure of Invention In order to solve the technical problems, embodiments of the present application provide a data verification method and a system thereof, which can reduce the data transmission amount between a RAID controller and a plurality of storage devices in a consistency check process, and improve the efficiency of consistency check on the plurality of storage devices. In order to solve the technical problems, the embodiment of the application provides the following technical scheme: In a first aspect, an embodiment of the present application provides a data verification method, applied to a data verification system, where the data verification system includes a RAID controller and at least two storage devices communicatively connected to the RAID controller, the storage devices include a data storage module, and the method includes: The RAID controller acquires information of the storage device and generates a quick consistency check instruction based on the information of the storage device; The storage device acquires data corresponding to the rapid consistency check instruction from the data storage module based on the rapid consistency check instruction, calculates the data corresponding to the rapid consistency check instruction to obtain a calculated value, and sends the calculated value to the RAID controller; The RAID controller obtains calculated values sent by at least two storage devices, compares the calculated values of the at least two storage devices, and obtains a first check result. In some embodiments, the information of the storage device includes a computing pattern including at least two data integrity verification algorithms, the rapid consistency check instruction includes a computing algorithm, the computing algorithm being one of the at least two data integrity verification algorithms; Before the data corresponding to the rapid consistency check instruction is acquired from the data storage module, the method further comprises the following steps: the storage device starts a quick consistency check based on the quick consistency check instruction; Calculating the data corresponding to the rapid consistency check instruction to obtain a calculated value, wherein the method comprises the following steps: And calculating the data corresponding to the rapid consistency check instruction based on a calculation algorithm to obtain a calculated value. In some embodiments, the RAID controller comprises a hardware accelerator, a preset alignment program; comparing the calculated values of the at least two storage devices to obtain a first check result, including: If the data length of the calculated value is greater than or equal to the preset data length, the RAID controller starts a hardware accelerator to compare the calculated values of at least two storage devices through the hardware accelerator, and a first check result is obtained; If the data length of the calculated value is smaller than the preset data length, the RAID controller compares the calculated values of at least two storage devices through a preset comparison program to obtain a first check result. In some embodiments, the method further comprises: The RAID controller generates a comprehensive consistency check instruction based on a preset period, and sends the comprehensive consistency check instruction to the storage equipment to acquire data corresponding to the comprehensive consistency check instruction returned by at least two storage equipment; And the RAID controller checks the data corresponding to the compreh