CN-122019267-A - File distributed backup method of sonar database system

CN122019267ACN 122019267 ACN122019267 ACN 122019267ACN-122019267-A

Abstract

The invention discloses a file distributed backup method of a sonar database system, which belongs to the technical field of sonar data processing and comprises the steps of obtaining file data containing underwater sound signal data from the sonar database system, conducting slicing processing on the file data, generating data blocks and dynamically adjusting the size, generating unique identifiers for the data blocks based on content hash values and metadata, selecting distributed storage nodes based on availability, storage capacity, network delay and geographic distribution factors, transmitting the data blocks to use encryption protocols, updating backup metadata to record storage positions and states, periodically verifying the integrity and availability of backup data, executing a data recovery flow to recover original file data, and dynamically adjusting the backup strategy based on real-time operation requirements and data importance levels. The method improves backup efficiency, data safety and system reliability through distributed storage and dynamic optimization, and is suitable for sonar data management in an underwater detection system.

Inventors

Chen Shuaike
XU JIALIN
WANG CHAO
YUAN JIAWEI

Assignees

中国舰船研究设计中心

Dates

Publication Date: 20260512
Application Date: 20260410

Claims (9)

1. The file distributed backup method of the sonar database system is characterized by comprising the following steps of: s1, acquiring file data to be backed up from a sonar database system, wherein the file data comprises underwater sound signal data, and the underwater sound signal data is derived from sonar equipment in an underwater detection system; s2, carrying out slicing processing on the file data, dividing the file data into a plurality of data blocks, dynamically adjusting the size of each data block according to preset block size parameters, and generating a unique identifier for each data block; S3, selecting a plurality of distributed storage nodes based on the availability, storage capacity, network delay and geographic distribution factors of the nodes to store the data blocks, and evaluating the node states in real time through a node health monitoring module; S4, updating backup metadata in the sonar database system to record the storage position and the backup state of each data block; s5, executing a data recovery process, and when data loss or damage is detected, positioning and recovering original file data according to the backup metadata; S6, dynamically adjusting the backup frequency and the redundancy level based on the real-time operation requirement of the underwater detection system and the importance level of the underwater sound data.
2. The method for file distributed backup of sonar database system of claim 1, wherein the dynamic adjustment mode of the block size parameter is: In the formula, Representing the data block size; representing the amount of file data; representing a file type coefficient; And To adjust the constant; the file type comprises format characteristics of underwater sound signal data, and the file data volume is calculated by monitoring the storage load of a sonar database system in real time; the block size parameter dynamic adjustment further includes adjusting the block size to minimize transmission delay based on network bandwidth limitations.
3. The distributed backup method of files in a sonar database system as set forth in claim 1, wherein in step S2, the calculation of the identifier includes hashing the content of the data block using a SHA-256 hash function in combination with a concatenation of metadata, wherein the metadata includes a time stamp of the data block, a source device identification based on a unique code of the sonar device, and a data priority assigned based on a target detection importance of the underwater sound signal data, and wherein the identifier generation process further includes using a digital signature algorithm to ensure an inoperability of the identifier.
4. The method for distributed backup of files in a sonar database system of claim 1, wherein when selecting a plurality of distributed storage nodes, evaluating the nodes using a weighted scoring model, the scoring being based on availability, storage capacity, network delay and geographical distribution factors of the nodes, the scoring formula being: In the formula, Representing the node comprehensive score; Representing node availability; representing node storage capacity; representing network delay; representing a geographical distribution factor; 、、、 is a weight coefficient, satisfies + + + =1; The node health monitoring module evaluates the node state in real time through a heartbeat mechanism and preferentially selects high-scoring nodes according to the scoring result.
5. The method for distributed backup of files in a sonar database system as set forth in claim 1, wherein in step S3, the encryption protocol employed in the transmission of the data block is AES-256 encryption, the encryption process includes generating a symmetric key and performing a key exchange using a public key infrastructure, the transmission further includes a data compression process to reduce network bandwidth occupation, and the compression algorithm adaptively adjusts the compression level based on the LZ77 algorithm.
6. The method for distributed backup of files in a sonar database system as claimed in claim 1, wherein in step S4, the backup metadata includes a data block identifier, a storage node address, a backup time stamp, and verification information; the updating process uses transactional database operation to ensure the consistency and atomicity of metadata; The backup metadata is stored in a JSON format and comprises a nested structure, wherein a data block identifier is used as a main key, a storage node address is an IP address and port number combination, a backup time stamp records the data storage completion time, and check information is a CRC32 value of a data block; The updating step also comprises the steps of constructing a metadata index, optimizing the query efficiency by using a B tree index, and regularly compressing the metadata storage space, wherein the metadata is synchronous with a main database of the sonar database system, and is automatically updated after the data block is stored through a trigger mechanism.
7. The method for distributed backup of files in a sonar database system as set forth in claim 1, wherein the verification of the backup data comprises a checksum verification and a node health check, wherein the checksum verification is performed by calculating a hash value of the data block and comparing the hash value with the original value, and calculating a data integrity difference rate : In the formula, Representing a currently calculated data chunk hash value; representing the originally stored chunk hash value; If it is If the data block is larger than the preset threshold value, marking the data block as a damaged state; the node health check includes monitoring the presence and response time of the storage node, and triggering a node replacement procedure by sending a probe packet and recording a response delay, the response delay exceeding a threshold.
8. The distributed backup method of files in a sonar database system of claim 1, wherein when a data recovery process is performed, when a data loss or corruption is detected, the recovery process includes locating related data blocks according to backup metadata, retrieving the data blocks from storage nodes, reorganizing the data blocks into original file data, and verifying the correctness of the reorganized data, the reorganizing process uses data block sequence numbers and identifiers to sort and ensure data consistency through verification and authentication, the recovery process further includes priority scheduling to allocate recovery resources based on importance levels of the underwater sound data, and the data with high importance levels is recovered preferentially, the recovery step uses multithreading parallel processing to improve reorganization efficiency, and logs the recovery process for fault analysis.
9. A method of distributed backup of files of a sonar database system according to claim 1, wherein: In step S6, dynamically adjusting importance level based on real-time operation requirement of the underwater detection system and underwater sound data, wherein the importance level is set according to sonar type of data source and target priority, and adjusting and using a decision model, wherein the expression is as follows: In the formula, Representing a backup frequency adjustment factor; representing the real-time operation demand coefficient of the underwater detection system, and calculating through the system load and the task priority; representing the importance level coefficient of the underwater sound data, and obtaining the underwater sound data based on sonar type and target priority mapping; And Training and optimizing by historical data for weight parameters; redundancy level based on Dynamically setting values, wherein the redundancy level comprises the number of data copies and the distribution density of storage nodes; The dynamic adjustment also comprises policy execution monitoring, and parameters are optimized through a feedback mechanism, so that the backup policy is ensured to cooperate with the underwater detection system.

Description

File distributed backup method of sonar database system Technical Field The invention belongs to the technical field of sonar data processing, and particularly relates to a file distributed backup method of a sonar database system. Background In the field of file backup of sonar database systems, the prior art generally adopts a centralized backup method, and the methods have a plurality of defects. First, centralized backup is prone to single point failure, and once the primary storage node fails, the entire backup data may be lost, severely affecting the reliability of the underwater detection system. Secondly, the traditional backup method lacks dynamic adjustment capability, and can not optimize backup frequency and redundancy level according to real-time operation requirements and data importance, so that resource waste or insufficient backup is caused. In addition, the existing methods are inefficient in terms of sharding, identifier generation, and node selection, e.g., shards are fixed in size and cannot accommodate different file types and data volumes, thereby increasing backup time and network load. The underwater acoustic signal data has high real-time and high importance characteristics, and originates from sonar equipment for detecting underwater targets, but the prior art fails to effectively integrate encryption protocols, metadata management and health monitoring, so that the data security and integrity face challenges. For example, in military applications, sonar data backups need to ensure low latency and high availability, but existing approaches tend to ignore geographical distribution and network latency factors, resulting in slow recovery flows. Therefore, there is a need for an efficient, adaptive and safe distributed backup method to solve the above-mentioned problems and improve the overall performance of the sonar database system. Disclosure of Invention Therefore, the present invention aims to provide a file distributed backup method for a sonar database system, so as to improve the overall performance of the sonar database system. In order to achieve the above purpose, the present invention provides the following technical solutions: the invention discloses a file distributed backup method of a sonar database system, which comprises the following steps: s1, acquiring file data to be backed up from a sonar database system, wherein the file data comprises underwater sound signal data, and the underwater sound signal data is derived from sonar equipment in an underwater detection system; s2, carrying out slicing processing on the file data, dividing the file data into a plurality of data blocks, dynamically adjusting the size of each data block according to preset block size parameters, and generating a unique identifier for each data block; S3, selecting a plurality of distributed storage nodes based on the availability, storage capacity, network delay and geographic distribution factors of the nodes to store the data blocks, and evaluating the node states in real time through a node health monitoring module; S4, updating backup metadata in the sonar database system to record the storage position and the backup state of each data block; s5, executing a data recovery process, and when data loss or damage is detected, positioning and recovering original file data according to the backup metadata; S6, dynamically adjusting the backup frequency and the redundancy level based on the real-time operation requirement of the underwater detection system and the importance level of the underwater sound data. Further, when the file data is fragmented, the dynamic adjustment mode of the block size parameter is as follows: In the formula, Representing the data block size; representing the amount of file data; representing a file type coefficient; And To adjust the constant; the file type comprises format characteristics of underwater sound signal data, and the file data volume is calculated by monitoring the storage load of a sonar database system in real time; the block size parameter dynamic adjustment further includes adjusting the block size to minimize transmission delay based on network bandwidth limitations. Further, in step S2, the calculation of the identifier comprises the steps of hashing the content of the data block by using a SHA-256 hash function and combining serial operation of metadata, wherein the metadata comprises a time stamp of the data block, a source device identification and a data priority, the source device identification is based on unique encoding of a sonar device, the data priority is distributed according to target detection importance of underwater sound signal data, and the identifier generation process further comprises the step of ensuring non-tamper modification of the identifier by using a digital signature algorithm. Further, when selecting a plurality of distributed storage nodes, the nodes are evaluated using a weighted scoring model, the scoring bein