CN-121978755-A - Data processing system and device for dense array

CN121978755ACN 121978755 ACN121978755 ACN 121978755ACN-121978755-A

Abstract

The embodiment of the specification discloses a data processing system of a dense array and a device thereof. The data processing system of the dense array comprises an equipment unit, an acquisition unit, a data unit, a software functional unit and an application unit, wherein the equipment unit comprises an array and mobile communication equipment, the array consists of seismometers of different types, the acquisition unit is used for providing a gateway for data synchronization and information transmission of the mobile communication equipment and providing a format conversion tool for ensuring data transmission according to a unified format, the data unit is used for facing multi-source heterogeneous data and providing unified data access, data management and index management, and data overall process management and access such as data acquisition, management, archiving storage, query access and the like, the software functional unit is used for carrying out standardized processing on the data in the data unit and carrying out task management on array layout in the equipment unit, and the application unit is used for providing a plurality of platform products according to the functions of the data unit and the software functional unit.

Inventors

WANG WEITAO
HUANG XIANG
MA XIAONA
ZHANG YUNPENG
LI LU
XU SHANHUI

Assignees

中国地震局地球物理研究所

Dates

Publication Date: 20260505
Application Date: 20260113

Claims (10)

1. A densely populated data processing system comprising: the equipment unit comprises an array and mobile communication equipment, wherein the array consists of seismometers with different models; the acquisition unit is used for providing a gateway for data synchronization and information transmission of the mobile communication equipment and providing a format conversion tool for ensuring that data are transmitted according to a uniform format; The data unit is used for providing unified data access, data management and index management for multi-source heterogeneous data, and providing overall process management and access of data such as data acquisition, management, archiving storage, query access and the like; The software functional unit is used for carrying out standardized processing on the data in the data unit and carrying out task management on the array layout in the equipment unit; And the application unit is used for providing a plurality of platform products according to the functions of the data unit and the software functional unit so that a user can access the system based on the platform products.
2. The system of claim 1, wherein the plurality of platform products comprises: the dense array task management platform is used for carrying out site layout planning, task formulation and personnel grouping according to the observation area and the scientific research target, decomposing specific tasks and distributing the decomposed specific tasks to a plurality of construction teams to complete array layout; The dense array site task platform is used for the construction team to execute an array layout task and record auxiliary data such as construction logs, equipment states, environmental information and the like; The dense array data processing platform is used for receiving data uploaded by the arrays after the arrays are distributed, carrying out multidimensional automatic processing and analysis, inverting the underground medium structure, identifying microseismic events and quantitatively evaluating the data quality.
3. The system of claim 2, wherein the dense array task management platform receives instructions of an administrator, creates a construction team comprising task types in the system, and the collection unit collects the distributed array information so that the administrator can monitor and audit the status of the tasks.
4. The system of claim 2, wherein the dense array data processing platform performs multidimensional automated processing and analysis for quantitative assessment of data quality, comprising: Providing a customizable data processing flow, processing the observed data according to the customizable data processing flow, and generating standardized format data; The quantitative evaluation of the data quality comprises the steps of calculating the continuity rate and the noise level of the observed data and evaluating the data quality.
5. The system of claim 1, wherein the data unit for providing unified and index management for multi-source heterogeneous seismic service data comprises: Dividing the received observation data according to the record number, and constructing an index structure for each observation data, wherein the index structure comprises a starting time, a starting position, a file size of the observation data, a time stamp of the starting time of each data record, a data position and a sampling rate; determining metadata of the index structure; and storing the data position, the index file position and the metadata into a database, and constructing a secondary partition according to the date and the station position by the observation data.
6. The system of claim 5, wherein when the observation is unstructured data, the data unit, prior to constructing an index structure of the observation, is further to: Reading and analyzing the file type of the observed data, and integrating the data according to the file type of the observed data, wherein the method specifically comprises the following steps: Reading the seismic phase file according to the rows, analyzing according to different service attributes, and constructing a data object for the analyzed data; for a table file, dividing each field in each row of data through a regular expression, and constructing the divided fields into different data objects; Aiming at the XML file, analyzing the file into a DOM tree or SAX event stream, or constructing a data object by acquiring the label name, attribute value, text content and the like of the element in the XML file; And reading header information and data information of the seismological observation data file aiming at the fixed seismological observation data file, and constructing a data object.
7. The system of claim 1, wherein the data unit is further to: Judging whether the obtained observation data meets a combination condition or not, and if so, combining the observation data, wherein the combination condition comprises: The type of the observation supports merging, and the header of the previous observation may be compatible with the header of the observation to be merged, and the ending event of the previous observation is equal to the starting time of the observation to be merged; After merging, the header of the previous observation is updated to reflect the new block size and the updated previous observation is stored.
8. The system of claim 1, wherein the software functional unit performs normalization processing on the data in the data unit, including preprocessing the observed data, including de-averaging, normalization, de-linear trend, band pass filtering, and de-tilting operations.
9. The standardized data processing module of claim 1 wherein the software functional unit performs a standardized process on the data in the data unit comprising: And receiving the customization of the time length and the site information of the waveform contained in the observed data by a user, and processing most observed data according to the customized time length and the site information as follows: The same station pair, different components and different filters are circularly calculated in the following way to generate standardized related data And stores: Wherein R, T, E and N represent seismic waveforms of different components, R represents a radial component pointing to the direction of a seismic source, T represents a tangential component perpendicular to the radial direction and in the horizontal plane, E represents an east component, N represents a north component, az is an azimuth angle, X and Y are any one of R, T, E and N, and X (f) is the complex conjugate of X (f).
10. A densely populated data processing apparatus comprising: The data receiving module is used for receiving the data uploaded by the station array; the data storage module is oriented to multi-source heterogeneous data, provides unified data access, data management and index management, and provides overall process management and access of data such as data acquisition, management, archiving storage, query access and the like; The data processing module is used for carrying out standardized processing on the data in the data unit and generating standardized format data; and the quality evaluation module evaluates the continuity rate and the noise level of the data and performs quality evaluation of the data.

Description

Data processing system and device for dense array Technical Field The present disclosure relates to the field of geophysics, and more particularly, to a data processing system for a dense array and apparatus therefor. Background In recent years, with the improvement of the earthquake monitoring precision requirement and the increase of the disaster prevention and reduction requirements, the intensive array observation technology with different scales is increasingly widely applied to the fields of seismology research, urban active fault detection, oil and gas resource exploration and the like. The arrays have different scale distributions. The dense array of the area scale is generally about tens of kilometers in distance, and is mainly used for scientific researches such as shell curtain structure imaging, earthquake activity analysis, deep pregnant earthquake environment detection and the like in a large range. Short-period dense arrays with distance of kilometers and even smaller scale are widely used in the fields of shallow surface structure imaging, active fault detection, resource exploration and the like. The dense array observation with different scales provides an economic and reliable technical means for detecting the underground medium fine structure and monitoring the earthquake activity, and has a very good application prospect. However, the expansion of seismic array size and the proliferation of data volumes present significant challenges to conventional data acquisition and processing approaches. On the one hand, the collection, storage, management and sharing of massive waveform data lack of unified standards, so that the data collection efficiency and the later data processing efficiency and the utilization rate are low. On the one hand, the acquisition processing flows adopted by different institutions have various differences, and the basic processing flows such as data continuous rate statistics, data quality evaluation, data preprocessing and the like lack unified standards, so that the later stage of further processing the observed data to develop different data products and obtain related research results becomes very difficult. In other words, the task processing of the dense array is lack of controllability, data processing irregularity, and the result is difficult to trace. Based on this, a system for normalizing data of a dense array is needed. Disclosure of Invention The embodiment of the specification provides a data processing system and a device thereof for a dense array, which are used for solving the technical problem that a system for carrying out standardized processing on data of the dense array is required. To solve the above technical problems, one or more embodiments of the present specification are implemented as follows: In a first aspect, an embodiment of the present disclosure provides a data processing system of a dense array, including an equipment unit, including an array and a mobile communication device, where the array is composed of seismometers of different models, an acquisition unit that provides a gateway for data synchronization and information transmission of the mobile communication device, and a format conversion tool that ensures data transmission according to a unified format, a data unit that is used for heterogeneous data oriented to multiple sources, provides unified data access, data management, and index management, and provides overall process management and access of data such as data acquisition, management, archiving storage, and query access, a software function unit that performs standardized processing on data in the data unit, and performs task management on array layout in the equipment unit, and an application unit that provides a plurality of platform products according to functions of the data unit and the software function unit, so that a user accesses the system based on the platform products. In a second aspect, one or more embodiments of the present disclosure provide a data processing apparatus of a dense array, including a data receiving module, a data storage module, a quality evaluation module, and a quality evaluation module, where the data receiving module receives data uploaded by the dense array, the data storage module provides unified data access, data management, index management, and overall process management and access of data such as data acquisition, management, archival storage, and query access for heterogeneous data, and the data processing module performs standardized processing on data in the data unit to generate standardized format data, and the quality evaluation module evaluates continuity rate and noise level of the data, and performs quality evaluation on the data. The technical scheme adopted by one or more embodiments of the specification can achieve the following beneficial effects by providing a data processing system of a dense array, comprising an equipment unit, an acquisition unit, a data un