Search

CN-122019490-A - Multi-channel satellite frequency point file processing method and system based on threshold optimization

CN122019490ACN 122019490 ACN122019490 ACN 122019490ACN-122019490-A

Abstract

The invention discloses a multi-channel satellite frequency point file processing method and system based on threshold optimization, which relate to the technical field of satellite communication data processing and comprise the steps of calculating burst positions and burst lengths of a main channel file; the method comprises the steps of counting the burst number in a history main channel file, calculating a threshold value according to the burst number in the history main channel file, selecting a low burst processing mode if the burst number of the main channel file is smaller than the threshold value, otherwise selecting a high burst processing mode, and reading and processing data corresponding to the burst from the main channel file and the auxiliary channel file according to the selected mode. The method is suitable for efficiently processing burst data in the multichannel satellite frequency point file, and solves the problems of burst performance, low delay requirement and accurate reading according to the position of data access in a satellite positioning scene.

Inventors

  • TIAN ZHENYU
  • ZHOU XIAO

Assignees

  • 齐鲁空天信息研究院

Dates

Publication Date
20260512
Application Date
20260415

Claims (10)

  1. 1. A multi-channel satellite frequency point file processing method based on threshold optimization is characterized by comprising the following steps: calculating the burst position and the burst length of the main channel file; Counting the burst number in the history main channel file, and calculating a threshold value according to the burst number in the history main channel file, wherein if the burst number of the main channel file is smaller than the threshold value, a low burst processing mode is selected, otherwise, a high burst processing mode is selected; and reading the data corresponding to the burst from the primary and secondary channel files according to the selected mode and processing the data.
  2. 2. The method for processing a multi-channel satellite frequency point file based on threshold optimization of claim 1, wherein the burst location comprises a file offset, the file offset being expressed in bits, and the burst length comprises a number of bits.
  3. 3. The method for processing the multichannel satellite frequency point file based on threshold optimization as claimed in claim 1, wherein the calculation formula of the threshold T is: Wherein, the Average transmission cost for history; Average burst number for history; Network transmission costs for each burst of content; Seek cost for a single disk; Delay costs for the network.
  4. 4. A method of processing a multi-channel satellite frequency point file based on threshold optimization as claimed in claim 3 wherein the high burst mode is selected when the threshold is less than 0.
  5. 5. The method for processing the multi-channel satellite frequency point file based on threshold optimization of claim 1, wherein the low burst mode is to directly read the content of the corresponding burst from the main and auxiliary channel files in the disk array each time according to the file offset and the burst length of each burst, and store the content in the memory.
  6. 6. The method for processing the multichannel satellite frequency point file based on the threshold optimization of claim 1 is characterized in that the high burst mode is to store all burst positions and burst lengths as burst information files, read the main channel file and the auxiliary channel file into a memory at one time, and establish a burst position and burst content hash table according to the burst information files to index burst contents.
  7. 7. A multi-channel satellite frequency point file processing system based on threshold optimization, comprising: the burst detection module is configured to calculate the burst position and the burst length of the main channel file; The system comprises a mode selection module, a high-burst processing mode and a low-burst processing mode, wherein the mode selection module is configured to count the number of bursts in a history main channel file, calculate a threshold according to the number of bursts in the history main channel file, select the low-burst processing mode if the number of bursts in the main channel file is smaller than the threshold, and select the high-burst processing mode if the number of bursts in the main channel file is not smaller than the threshold; and the positioning processing module is configured to read and process the data corresponding to the burst from the main and auxiliary channel files according to the selected mode.
  8. 8. An electronic device comprising a memory and a processor and computer instructions stored on the memory and running on the processor, which when executed by the processor, perform the method of any one of claims 1-6.
  9. 9. A computer readable storage medium storing computer instructions which, when executed by a processor, perform the method of any of claims 1-6.
  10. 10. A computer program product comprising a computer program which, when executed by a processor, implements the method of any of claims 1-6.

Description

Multi-channel satellite frequency point file processing method and system based on threshold optimization Technical Field The invention relates to the technical field of satellite communication data processing, in particular to a multi-channel satellite frequency point file processing method and system based on threshold optimization. Background In the technical fields of three-dimensional GIS (geographic information system ) topography visualization, large-scale data synchronization and file transmission, the prior art mainly extends around how to efficiently organize, schedule and load mass data files. In particular, when the satellite positioning is used in the scene requiring high real-time performance, the core challenge is to quickly position and load the required data, and meanwhile, the problems of network I/O delay, mismatching of file size and transmission bandwidth, low loading efficiency of a large file memory and the like are overcome. Related existing schemes include creating pre-indexed files to speed up data positioning, dynamically adjusting file size according to network conditions to optimize transmission, and improving large file loading efficiency through file splitting and message queuing techniques. But for the pre-indexing scheme, while database query latency is reduced, it relies on pre-created static index files. In a satellite positioning scene, hot spots or burst access areas of observed data are dynamic and unpredictable, and cannot be completely covered by static indexes in advance, so that the method has insufficient real-time performance. While the overall efficiency of file transfer is optimized for a dynamically resized solution, it incorporates small files into the best size operation, which is not applicable to scenarios that require immediate access to specific locations in the file. Because the merging process requires time and memory for file integration, which conflicts with the immediate response required by satellite positioning scenarios, its optimization goal is transmission efficiency rather than access accuracy. For the scheme adopting the file segmentation and message queuing technology, although the throughput of large file loading is improved, the segmentation strategy is only based on the file size, the inherent semantics or spatial distribution of data is not considered, and the requirement of accurately reading the relevant part in the file according to the burst position cannot be supported. Meanwhile, the design does not sufficiently consider the processing of a large number of small files. Thus, existing schemes have significant limitations in coping with data access burstiness, stringent low latency requirements, and the need to read data from a specific location (rather than the entire file) that are typical of satellite positioning scenarios. Disclosure of Invention In order to solve the problems, the invention provides a multi-channel satellite frequency point file processing method and system based on threshold optimization, which are used for estimating a dynamic threshold and selecting a reading mode according to the dynamic threshold, are suitable for efficiently processing burst data in a multi-channel satellite frequency point file and solve the problems of burst performance, low delay requirement and accurate reading according to positions of data access in a satellite positioning scene. In order to achieve the above purpose, the present invention adopts the following technical scheme: in a first aspect, the present invention provides a method for processing a multi-channel satellite frequency point file based on threshold optimization, including: calculating the burst position and the burst length of the main channel file; Counting the burst number in the history main channel file, and calculating a threshold value according to the burst number in the history main channel file, wherein if the burst number of the main channel file is smaller than the threshold value, a low burst processing mode is selected, otherwise, a high burst processing mode is selected; and reading the data corresponding to the burst from the primary and secondary channel files according to the selected mode and processing the data. Alternatively, the burst location includes a file offset, the file offset being expressed in bits, and the burst length includes a number of bits. Alternatively, the calculation formula of the threshold T is: Wherein, the Average transmission cost for history; Average burst number for history; Network transmission costs for each burst of content; Seek cost for a single disk; Delay costs for the network. As an alternative embodiment, the high burst mode is selected when the threshold is less than 0. As an alternative implementation mode, the low burst mode is that according to the file offset and the burst length of each burst, the content of the corresponding burst is directly read from the main and auxiliary channel files in the disk ar