CN-121996912-A - Flight parameter data preprocessing method and device based on custom template

CN121996912ACN 121996912 ACN121996912 ACN 121996912ACN-121996912-A

Abstract

The invention relates to the technical field of aviation data processing, in particular to a flight parameter data preprocessing method and device based on a custom template. The method comprises the steps of S1, configuring the pre-processing requirement of the flight parameter data by a user through a custom template, S2, reading an original flight parameter file to a memory or a streaming buffer area according to a storage path and calling a decoder, S3, analyzing the original data in the original flight parameter file to generate a structured data set, S4, encoding according to an output data format and writing the encoded data into the file to generate a final pre-processing result file. The device comprises a configuration receiving module, a file acquisition module, a format identification module, a template management module, a data processing module, a format conversion module, a storage module and a system parameter library. The invention supports cross-platform operation and large-scale batch processing through the templatization configuration and parallel processing technology, and realizes the efficient and flexible pretreatment of the flight parameter data.

Inventors

LI YU
HUANG YANBING
YU XIAONING

Assignees

中国航空综合技术研究所

Dates

Publication Date: 20260508
Application Date: 20260107

Claims (10)

1. A flight parameter data preprocessing method based on a custom template is characterized by comprising the following steps: s1, a user configures the preprocessing requirement of flight parameter data through a custom template; the user inputs the flight parameter data preprocessing requirements through a graphical interface or a configuration file, and the flight parameter data preprocessing requirements comprise a flight parameter file storage path, an output data format and parameter extraction, wherein the parameter extraction at least comprises a target parameter and a sampling frequency; s2, reading an original flight parameter file to a memory or a streaming buffer area according to a storage path and calling a decoder; when a plurality of original flight parameter files exist, each original flight parameter file is executed as an independent task by creating a thread pool or a process pool; S3, analyzing the original data in the original flight parameter file to generate a structured data set; Firstly, decoding original data by using a decoder to obtain a data frame, then resampling the data frame according to a set sampling frequency to obtain a resampled frame, then judging whether a conversion relation is needed for target parameters, if so, obtaining the corresponding conversion relation of the target parameters, converting an original code value in the resampled frame into an actual value of the target parameters by the conversion relation, and finally, aligning and serializing all the target parameters according to a uniform time axis to generate a structured data set; S4, encoding the structured data set generated in the S3 according to an output data format, writing the encoded structured data set into a file, and generating a final preprocessing result file.
2. The method for preprocessing flight parameter data based on a custom template according to claim 1, wherein the step S1 specifically comprises the steps of: S101, determining a flight parameter file path; the storage path of the original flight parameter files is determined by directly inputting or selecting a file directory, so that the flight parameter data preprocessing of the specified flight parameter files is realized, or the storage path of the batch of original flight parameter files is obtained by directly inputting or selecting a root directory and then setting the screening condition of the original flight parameter files, so that the flight parameter data preprocessing of the batch of flight parameter files is realized; S102, at an output format, determining a desired output data format by directly inputting or selecting the format of an output file; S103, selecting whether an existing parameter extraction template is imported at a parameter extraction position, if yes, executing S104, and if not, directly executing S105; S104, selecting a parameter extraction template, obtaining a target parameter and a sampling frequency from the parameter extraction template, and ending the steps after the target parameter and the sampling frequency are respectively and automatically filled; S105, selecting target parameters from a system parameter library in a checking or searching mode at the target parameters of parameter extraction; S106, setting a frequency range at the sampling frequency of parameter extraction; And S107, saving the configured parameter extraction as a parameter extraction template.
3. The method for preprocessing the flight data based on the custom template as claimed in claim 2, wherein S101 is implemented by directly inputting or selecting a root directory and then setting the screening condition of the original flight file to obtain a storage path of the batch of original flight files, specifically: The screening condition is date range or airplane number or the combination of the date range and airplane number, the specific screening process is that all files under a root directory are recursively scanned, then original flight parameter files conforming to the date range and the airplane number are screened out according to file names, finally, format identification confirmation files in file heads of the files which pass through the primary screening are read to confirm that the files are flight parameter files, finally, an original flight parameter file list conforming to the condition is obtained, and a storage path of each original flight parameter file is obtained according to the original flight parameter file list.
4. The method of claim 2, wherein the system parameter library in S103 comprises meta information of all available parameters of the aircraft and conversion relations, and the conversion relations comprise conversion formulas, conversion curves or conversion tables.
5. The method for preprocessing the flight parameter data based on the custom template as claimed in claim 2, wherein the parameter extraction template in S107 is stored in the form of JSON, XML or database.
6. The method of claim 1, wherein S2, the decoder is determined based on model information of the original flight file obtained by analyzing file extension, file magic word and file header information of the original flight file.
7. The method of claim 6, wherein S2, based on the model information of the original flight document, the decoder is determined by reading the timestamp and the version information of the aircraft in the document.
8. The method for preprocessing the flight data based on the custom template of claim 1, wherein S3, the method comprises the following specific steps of: S301, calling a decoder determined in S2, and analyzing the binary stream into a data frame containing a time stamp and an original code value; S302, resampling the parsed data frame according to the sampling frequency of each target parameter in the parameter extraction to obtain a resampled frame, wherein the resampling comprises upsampling, downsampling or interpolation, and resampling each target parameter to be the set sampling frequency; s303, judging whether the target parameters need a conversion relation, and directly executing S305 without the need; s304, acquiring a conversion relation of a pre-stored target parameter from a system parameter library, and converting an original code value in a resampling frame into an actual value of the target parameter through the conversion relation, wherein after the conversion relation of all the target parameters is executed, S305 is executed; S305, organizing time sequence, integrating resampled frame sequences of all target parameters by linear interpolation, nearest neighbor interpolation or mean value aggregation and the like according to a time stamp sequence to form a structured data set with time as an index and each parameter as a column, wherein the time stamp in the structured data set is based on the highest sampling frequency in all the target parameters.
9. The method for preprocessing flight data based on a custom template according to claim 1, further comprising S5, performing interaction through a graphical interface; In the flight parameter data preprocessing process, a user monitors the execution progress of a preprocessing task in real time through a graphical interface, and the method comprises the steps of displaying predicted remaining processing time, current processing state, processed file number, processing speed and error information, and supporting the user to pause, continue or cancel the preprocessing task through an interactive interface.
10. The device for preprocessing the flight parameter data based on the custom template according to claim 1 is characterized by comprising a configuration receiving module, a file acquisition module, a format identification module, a template management module, a data processing module, a format conversion module, a storage module and a system parameter library, wherein the specific connection relation is as follows: the configuration receiving module is used for providing configuration input of an interface receiving user, wherein the configuration input comprises a flight parameter file storage path, an output data format and parameter extraction, the configuration receiving module sends the flight parameter file storage path to the file acquisition module, sends the output data format to the format conversion module, sends new parameter extraction to the template management module or directly calls an existing parameter extraction template from the template management module, and sends target parameters and sampling frequency in parameter extraction to the data processing module; The template management module is used for storing, retrieving and loading parameter extraction templates; The file acquisition module is used for reading the file from the storage path received by the configuration receiving module to the memory or the streaming buffer area; The format recognition module automatically detects and recognizes the format of the original flight parameter file according to the file extension name, the file magic word and the information of the original flight parameter file in the memory or the streaming buffer area, and determines a corresponding decoder; the data processing module decodes the original flight parameter file by using a decoder, resamples the original flight parameter file according to the target parameters, the sampling frequency and the conversion relation in the system parameter library received from the configuration receiving module to obtain target parameters, and sequences all the target parameters to obtain a structured data set; the system parameter library is used for storing meta information and conversion relations of all the parameters which can be acquired by the aircraft; the format conversion module is used for encoding the structured data set into an output data format received from the configuration receiving module to obtain a preprocessing result file, and sending the preprocessing result file to the storage module; And the storage module is used for storing the preprocessing result file.

Description

Flight parameter data preprocessing method and device based on custom template Technical Field The invention relates to the technical field of aviation data processing, in particular to a flight parameter data preprocessing method and device based on a custom template. Background The flight parameter (flight parameter for short) data is the original data collected by various sensors of the aircraft during the flight process, and comprises key data such as aircraft state, engine parameters, navigation information and the like. These data are usually stored in proprietary binary formats, with large data volumes and complex structures, and direct analysis is difficult. The existing fly parameter data processing method has the following technical problems that 1, the processing efficiency is low, a single file is processed by manually analyzing binary files in the traditional method, 2, compatibility is poor, fly parameter data formats generated by different aircraft models and different recording devices are not uniform and lack a uniform processing method, 3, parameter extraction is inflexible, parameters required to be extracted cannot be flexibly selected according to specific analysis requirements, 4, batch processing capability is weak, a large amount of historical fly parameter data cannot be processed efficiently, and 5, cross-platform support is insufficient, and an existing tool can only normally run on a specific operating system. Therefore, there is a need for a method and apparatus for converting any original flight parameter data into flight parameter data satisfying user requirements, so as to facilitate various operations such as prediction, evaluation, and judgment of an aircraft using various flight parameter data using existing application programs. Disclosure of Invention The invention aims to provide a flight parameter data preprocessing method and device based on a custom template, which are used for solving the problems of poor flexibility, low efficiency and insufficient reliability of flight parameter data processing in the prior art. In order to achieve the above object, in one aspect, the present invention provides a flight parameter data preprocessing method based on a custom template, which includes the following steps: s1, a user configures the preprocessing requirement of flight parameter data through a custom template; the user inputs the flight parameter data preprocessing requirements through a graphical interface or a configuration file, and the flight parameter data preprocessing requirements comprise a flight parameter file storage path, an output data format and parameter extraction, wherein the parameter extraction at least comprises a target parameter and a sampling frequency; s2, reading an original flight parameter file to a memory or a streaming buffer area according to a storage path and calling a decoder; when a plurality of original flight parameter files exist, each original flight parameter file is executed as an independent task by creating a thread pool or a process pool; S3, analyzing the original data in the original flight parameter file to generate a structured data set; Firstly, decoding original data by using a decoder to obtain a data frame, then resampling the data frame according to a set sampling frequency to obtain a resampled frame, then judging whether a conversion relation is needed for target parameters, if so, obtaining the corresponding conversion relation of the target parameters, converting an original code value in the resampled frame into an actual value of the target parameters by the conversion relation, and finally, aligning and serializing all the target parameters according to a uniform time axis to generate a structured data set; S4, encoding the structured data set generated in the S3 according to an output data format, writing the encoded structured data set into a file, and generating a final preprocessing result file. Preferably, the step S1 specifically includes the steps of: S101, determining a flight parameter file path; the storage path of the original flight parameter files is determined by directly inputting or selecting a file directory, so that the flight parameter data preprocessing of the specified flight parameter files is realized, or the storage path of the batch of original flight parameter files is obtained by directly inputting or selecting a root directory and then setting the screening condition of the original flight parameter files, so that the flight parameter data preprocessing of the batch of flight parameter files is realized; S102, at an output format, determining a desired output data format by directly inputting or selecting the format of an output file; S103, selecting whether an existing parameter extraction template is imported at a parameter extraction position, if yes, executing S104, and if not, directly executing S105; S104, selecting a parameter extraction template, obtaining a target parameter an