CN-121995442-A - Data resource pool building system

CN121995442ACN 121995442 ACN121995442 ACN 121995442ACN-121995442-A

Abstract

The invention relates to the technical field of geographic information systems and seismic observation applications, in particular to a data resource pool building system which comprises a data acquisition module, a non-seismic event elimination module, a physical performance detection module and an anomaly cause tracing module. The method comprises the steps of periodically collecting seismic waveform original data, comparing storage time length, judging seismic observation data types based on multidimensional parameters, identifying physical performance fault types through hardware, software and architecture state parameters, specifically, extracting and analyzing data geographic positions to judge scheduling paths, identifying and cleaning repeated observation contents, calculating waveform stacking pressure and signal writing deflection, judging frequency domain sequencing delay, calculating time adjustment factors based on frequency drift and correcting storage time threshold values, and realizing dynamic adjustment of the data storage time threshold values through multidimensional data verification and load optimization, thereby improving data storage efficiency and system stability.

Inventors

BO TAO
CHANG JIANJUN
CHEN YANAN
WANG ZHANYING
DONG BIN
JIANG WEIMIN
YAN TING

Assignees

北京市地震局

Dates

Publication Date: 20260508
Application Date: 20251205

Claims (10)

1. A data resource pool building system, comprising: The data acquisition module is used for periodically acquiring the original data of the seismic waveform and acquiring a comparison result of the actual storage duration and the standard storage duration of the original data of the seismic waveform in the current acquisition period; the non-seismic event elimination module is connected with the data acquisition module and is used for judging the type of the seismic waveform original data based on the interference event elimination parameters under the comparison result of the first storage duration; The physical performance detection module is connected with the non-seismic event removal module and is used for executing layering detection operation based on hardware running state parameters, software running state parameters and architecture running state parameters when the seismic waveform original data are of a first observation data category so as to judge whether a data pool has faults or not and determining a corresponding physical performance fault category when the faults exist; The abnormal cause tracing module is connected with the non-seismic event removing module and is used for removing interference events when the seismic waveform original data are of a second observation data category, executing abnormal cause judging operation to judge whether a data pool has faults or not, triggering data behavior performance fault detection when the faults exist, and determining whether to adjust standard storage time according to a time adjustment factor based on a detection result; wherein the physical performance failure categories include hardware performance failure, storage logic performance failure, and architecture performance failure.
2. The system for building a data resource pool according to claim 1, wherein the non-seismic event rejection module includes a parameter discrimination unit and a category discrimination unit; The parameter judging unit is used for carrying out multidimensional feature analysis on the seismic waveform original data based on the interference event eliminating parameters so as to identify suspected abnormal data; The category judging unit is used for dividing suspected abnormal data into data categories of the seismic waveform original data, and outputting classification results, wherein the classification results comprise a first classification result and a second classification result; the data category corresponding to the first classification result is a first observed data category, and the data category corresponding to the second classification result is a second observed data category.
3. The data resource pool building system according to claim 2, wherein the parameter discrimination unit includes a waveform characteristic analysis subunit, a spatial residual calculation subunit, an environmental interference discrimination subunit, and a scene enhancement identification subunit; the waveform characteristic analysis subunit is used for extracting a plurality of waveform structural characteristic parameters in the seismic waveform original data and determining waveform structural abnormal data based on the comparison result of each waveform structural characteristic parameter and the corresponding judgment threshold value or interval; the space residual calculation subunit is used for calculating a travel time residual value of the seismic source inversion fitting based on the seismic phase arrival time information, and determining waveform structure abnormal data according to a comparison result of the seismic source positioning deviation and a preset tolerance threshold; The environment interference judging subunit is used for identifying abnormal waveform structure data caused by environment factors based on the comparison result of the environment interference characteristic parameters and the corresponding judging threshold values; The environment interference characteristic parameters comprise meteorological disturbance indexes, electromagnetic field intensity and traffic harmonic characteristics; The scene enhancement recognition subunit is used for re-executing the operation of parameter comparison on the data processed by the waveform characteristic analysis subunit, the space residual error calculation subunit and the environment interference discrimination subunit.
4. The data resource pool building system according to claim 1, wherein the physical performance detection module includes a failure detection unit and an architecture defect detection unit; The fault detection unit is used for detecting hardware running state parameters and software running state parameters in the storage system so as to judge whether a hardware performance fault or a storage logic performance fault exists in the data pool or not; The architecture defect detection unit is used for detecting the architecture running state parameters in the storage pool so as to judge whether the data pool architecture performance faults exist.
5. The data resource pool building system of claim 4, wherein the failure detection unit comprises a hardware failure detection subunit and a software failure detection subunit; The hardware fault detection subunit is used for detecting hardware running state parameters in the storage system so as to judge whether a data pool hardware performance fault exists or not; the software fault detection subunit is used for detecting software running state parameters in the storage system so as to judge whether a data pool storage logic performance fault exists or not.
6. The data resource pool building system according to claim 1, wherein the anomaly cause tracing module includes a distribution rationality checking unit and a write load distribution identifying unit; The distribution rationality checking unit is used for extracting and analyzing the geographical position information of the seismic waveform original data corresponding to the second observation data category, identifying repeated data based on waveform content, time stamp and space coverage in the same acquisition period, extracting the area of an overlapping area and executing difference value processing; The write load distribution identification unit is used for identifying and dispatching and optimizing the write load state of the data pool.
7. The data resource pool building system according to claim 6, wherein the distribution rationality checking unit includes a path schedule identification subunit; The path schedule identification subunit is configured to analyze geographic location information of the observed data.
8. The data resource pool building system of claim 6, wherein the distribution rationality checking unit further comprises a repeated observation content cleaning subunit; The repeated observation content cleaning subunit is configured to compare the waveform data, the time stamp and the spatial coverage in the same acquisition period, and if the data are completely consistent and the geographic coverage overlaps, perform a difference processing to remove the redundant portion.
9. The data resource pool building system according to claim 6, wherein the write load distribution identifying unit includes a waveform stacking pressure determining subunit; The waveform accumulation pressure judging subunit is used for obtaining the ratio of the waveform writing quantity and the cleaning residue in unit time, obtaining an actual waveform accumulation ratio, identifying whether writing accumulation pressure exists or not based on the comparison result of the actual waveform accumulation ratio and a waveform accumulation ratio threshold value, and calling a standby pool when judging that the writing accumulation pressure exists.
10. The data resource pool building system of claim 6, wherein the write load distribution identification unit comprises a threshold calibration subunit; The threshold calibration subunit is configured to adjust the storage time threshold to a calibrated storage time based on a time adjustment factor when the first data write distribution determination result is obtained.

Description

Data resource pool building system Technical Field The invention relates to the technical field of geographic information systems and earthquake monitoring application, in particular to a data resource pool building system. Background With the rapid expansion of the seismic observation network, the mass seismic waveform data generated by the seismic observation network exceeds the bearing capacity of the traditional storage architecture and processing mode. At present, the management of the seismic data at home and abroad is mostly dependent on a static data resource warehouse or an offline filing mode, and an integral solution for carrying out real-time monitoring and dynamic adjustment on the data acquisition period, the storage time length, the data quality and the system running state is lacking. For example, in the prior art, standard storage duration is often adopted to perform unified control, abnormal data accumulation caused by sudden observation load peaks or interference factors cannot be handled, and data writing blocking, redundant storage or misclassification cleaning operation failure is caused, so that the operation efficiency of a terminal system is reduced. In addition, conventional seismic data processing systems focus on data archiving and format unification, as well as lifecycle management and metadata cataloging. Most schemes lack automatic detection and fault localization mechanisms for performance degradation of the physical layer and the behavior layer, such as system hardware degradation, logic anomaly, resource distribution imbalance, and the like. In addition, the existing massive seismic data resource pools generally lack the functions of analyzing and dynamically optimizing real-time performance indexes such as frequency domain sequencing delay, write-in channel load distribution and the like. Therefore, in the prior art, under the scenes of high concurrency seismic observation, high-frequency storage request, environmental disturbance influence and the like, the problems of system response delay, data quality fluctuation, resource scheduling non-uniformity and the like often exist. What is needed is a system for building a data resource pool that can cooperatively operate from multiple dimensions, such as acquisition, interference rejection, performance detection, anomaly localization, and dynamic threshold adjustment, to improve the real-time performance, accuracy, and system stability of seismic data processing. CN106777271A discloses a construction method of an automatic construction system based on a service resource pool, which comprises the steps of S1, constructing a container frame of the automatic construction system, S2, constructing a data resource pool, a plug-in resource pool and an interface resource pool, S3, setting a title, logo, a base map, a range, a scale, a navigation bar and copyright information of a WebGIS system based on the data resource pool, S4, setting functional components of the WebGIS system based on the plug-in resource pool, S5, setting an interface skin style of the WebGIS system based on the interface resource pool, S6, previewing the WebGIS system automatically constructed based on the resource pool, and S7, storing the automatically constructed WebGIS system. Meanwhile, the original data is directly put into storage to pollute the data pool, and the fixed standard storage time length causes accumulation or loss risk when burst data is increased suddenly, so that the operation and maintenance fault positioning efficiency is low. Disclosure of Invention Therefore, the invention provides a data resource pool building system, which is used for solving the problems that in the prior art, the storage of a data pool lacks a real-time operation monitoring mechanism, so that the quality of original data pollution is out of control, the immobilized parameters are difficult to deal with sudden loads, the data accumulation or loss is caused, and the fault positioning efficiency is low. To achieve the above object, the present invention provides a data resource pool building system, including: The data acquisition module is used for periodically acquiring the original data of the seismic waveform and acquiring a comparison result of the actual storage duration and the standard storage duration of the current acquisition period; the non-seismic event elimination module is connected with the data acquisition module and is used for judging the type of the seismic waveform original data based on the interference event elimination parameters under the comparison result of the first storage duration; The physical performance detection module is connected with the non-seismic event removal module and is used for executing layering detection operation based on hardware running state parameters, software running state parameters and architecture running state parameters when the seismic waveform original data are of a first observation data category so as to ju