Search

CN-121984932-A - Data processing method of multifunctional edge computing gateway and related equipment

CN121984932ACN 121984932 ACN121984932 ACN 121984932ACN-121984932-A

Abstract

The present invention relates to the field of data processing, and in particular, to a data processing method and related device for a multifunctional edge computing gateway. The method comprises the steps of collecting standard data streams of access gateways, carrying out dynamic priority assessment on the standard data streams to obtain priority sequences, identifying operation state parameters of a plurality of edge computing gateways, carrying out load capacity assessment to obtain load assessment values of the gateways, carrying out transmission demand matching on the load assessment values according to the priority sequences to generate priority task queues of the gateways, carrying out sequential transmission processing on the priority task queues, and outputting a transmission operation report. The invention improves the operation stability and the overall data processing efficiency of the edge computing gateway.

Inventors

  • XU SHENGGUO

Assignees

  • 广东传畅信息科技有限公司

Dates

Publication Date
20260505
Application Date
20260310

Claims (10)

  1. 1. A data processing method for a multifunctional edge computing gateway, comprising the steps of: S1, collecting standard data flow of an access gateway; S2, carrying out dynamic priority evaluation on the standard data stream to obtain a priority sequence; Step S3, identifying operation state parameters of a plurality of edge computing gateways, and carrying out load capacity assessment to obtain load assessment values of the gateways; S4, carrying out transmission demand matching on the load evaluation value according to the priority sequence to generate priority task queues of a plurality of gateways; And S5, carrying out sequential transmission processing on the priority task queue and outputting a transmission job report.
  2. 2. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the step S1 specifically comprises the steps of: The method comprises the steps of collecting multi-source data streams of an access gateway, wherein the multi-source data streams comprise industrial sensor data streams, video monitoring data streams, internet of things equipment data streams and cloud issuing instruction streams; identifying heterogeneous device timestamps for the multi-source data stream; Performing cross-device time sequence synchronization on the heterogeneous device time stamps, and outputting a synchronous data stream; Detecting abnormal data of the synchronous data stream and marking abnormal data noise points; and cleaning, filtering and format standardization are carried out on abnormal data noise points, and standard data streams are generated.
  3. 3. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the step S2 specifically comprises the steps of: Performing value quantitative evaluation on the standard data streams to obtain a value coefficient of each data stream; calculating the data request frequency in the period of the standard data stream to obtain the request rate; Performing dynamic priority assessment based on the request rate and the value coefficient to generate dynamic priority of each data stream; And carrying out data stream serialization processing according to the dynamic priority to obtain a priority sequence.
  4. 4. A data processing method of a multifunctional edge computing gateway according to claim 3, wherein the specific steps of performing value quantization evaluation on standard data streams to obtain a value coefficient of each data stream are as follows: Defining a sliding time window period; carrying out statistical calculation on the standard data stream according to the sliding time window period to obtain a transmission frequency characteristic, wherein the transmission frequency characteristic comprises a burstiness coefficient, periodic intensity, silence interval distribution and peak duration; deep protocol analysis is carried out on the standard data stream, and semantic features of an application layer are extracted; setting a data stream value evaluation index; And carrying out value quantitative evaluation on the transmission frequency characteristics and the application layer semantic characteristics according to the data stream value evaluation indexes to obtain a value coefficient of each data stream, wherein the data stream value evaluation indexes comprise data timeliness weights, service criticality coefficients, data scarcity indexes and processing complexity factors.
  5. 5. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the specific steps of step S3 are: Identifying operation state parameters of a plurality of edge computing gateways, wherein the operation state parameters comprise CPU/GPU occupancy rate, memory fragmentation, I/O queue delay, network bandwidth jitter and power consumption states; calculating real-time load data of a plurality of gateways based on the running state parameters; And carrying out load capacity evaluation on the real-time load to obtain load evaluation values of a plurality of gateways.
  6. 6. The data processing method of a multifunctional edge computing gateway according to claim 1, wherein the specific step of computing real-time load data of a plurality of gateways based on the operation state parameters is: Calculating a bandwidth variance coefficient and a dithering frequency based on the running state parameters to obtain throughput instantaneous fluctuation; calculating a gateway energy efficiency ratio based on the power consumption state; Identifying the number of idle CPU cores and the total number of cores of the running state parameters to obtain the CPU core availability; Counting the access times of an L1 cache, an L2 cache, an L3 cache and a main memory based on the running state parameters, and calculating to obtain a memory cache hit rate; Performing multi-layer distribution analysis on the memory cache hit rate to obtain multi-layer cache hit rate distribution; And carrying out comprehensive load assessment according to the instantaneous fluctuation of throughput, the gateway energy efficiency ratio, the CPU core availability and the multi-level cache hit rate distribution to obtain real-time load data of a plurality of gateways.
  7. 7. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the specific steps of step S4 are: Calculating the data flow density, the memory occupation amount, the I/O access frequency and the network bandwidth requirement of the standard data flow to obtain resource requirement data; Carrying out transmission demand matching on the load evaluation value according to the resource demand data to obtain matching data; and fitting the queues to be transmitted according to the matching data and the priority sequence, and generating priority task queues of the gateways.
  8. 8. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the specific steps of step S5 are: performing intelligent compression on the priority task queue to obtain a plurality of task compression packets; performing data sensitivity evaluation on the task compression packet to obtain a sensitivity level; Performing adaptive coding processing based on the sensitivity level to generate a plurality of coding task packets; And carrying out corresponding gateway sequential transmission processing on the plurality of coding task packets, and outputting a transmission job report.
  9. 9. The data processing method of the multifunctional edge computing gateway according to claim 1, wherein the intelligent compression is specifically: carrying out data stream type analysis on the priority task queue to obtain a data stream type; the data stream type comprises structured data, time sequence data and image video data; adopting column type storage compression to the structured data, and adopting differential coding to the time sequence data; h.265 encoding is used on the image video data.
  10. 10. A data processing related apparatus of a multifunctional edge computing gateway, for performing the data processing method of the multifunctional edge computing gateway as claimed in claim 1, comprising: the acquisition unit is used for acquiring standard data streams of the access gateway; the evaluation unit is used for carrying out dynamic priority evaluation on the standard data stream to obtain a priority sequence; The load computing unit is used for identifying the running state parameters of the plurality of edge computing gateways and carrying out load capacity evaluation to obtain load evaluation values of the plurality of gateways; The transmission matching unit is used for carrying out transmission demand matching on the load evaluation value according to the priority sequence and generating priority task queues of a plurality of gateways; And the sequential transmission unit is used for carrying out sequential transmission processing on the priority task queue and outputting a transmission job report.

Description

Data processing method of multifunctional edge computing gateway and related equipment Technical Field The present invention relates to the field of data processing, and in particular, to a data processing method and related device for a multifunctional edge computing gateway. Background The multifunctional edge computing gateway generally needs to be simultaneously connected with a large number of sensors, controllers and intelligent terminal equipment, and different data streams have significant differences in terms of delay sensitivity, importance degree, processing complexity and the like. Meanwhile, the computing resources, storage resources and network bandwidth of the edge computing gateway are limited by hardware conditions, and the problems of resource contention, processing delay increase and incapability of timely transmission of key data are easy to occur under the conditions of high concurrent data access and complex service. Lack of an efficient data processing and scheduling mechanism may lead to traffic response timeouts, system performance degradation, and even cause operational anomalies in the local network or edge nodes. The existing data processing method of the multifunctional edge computing gateway mostly adopts a fixed priority or simple polling mode to process and forward data, and often cannot fully consider the dynamic relationship between the data flow characteristics and the real-time running state of the gateway. In addition, the existing method is generally rough in evaluation of gateway load capacity, and changes of computing resources, network states and operation loads are difficult to reflect timely, so that flexibility and pertinence of a data scheduling strategy are poor. In an application environment of multi-gateway collaborative deployment, the problems are particularly remarkable, and partial gateway overload is easy to cause, other gateway resources are idle, so that the processing efficiency and the service quality of the whole system are affected. Disclosure of Invention The present invention provides a data processing method and related equipment for a multifunctional edge computing gateway to solve at least one of the above technical problems. In order to achieve the above object, the present invention provides a data processing method of a multifunctional edge computing gateway, including the following steps: S1, collecting standard data flow of an access gateway; S2, carrying out dynamic priority evaluation on the standard data stream to obtain a priority sequence; Step S3, identifying operation state parameters of a plurality of edge computing gateways, and carrying out load capacity assessment to obtain load assessment values of the gateways; S4, carrying out transmission demand matching on the load evaluation value according to the priority sequence to generate priority task queues of a plurality of gateways; And S5, carrying out sequential transmission processing on the priority task queue and outputting a transmission job report. In this specification, there is provided a data processing related apparatus of a multifunctional edge computing gateway for performing a data processing method of the multifunctional edge computing gateway as described above, comprising: the acquisition unit is used for acquiring standard data streams of the access gateway; the evaluation unit is used for carrying out dynamic priority evaluation on the standard data stream to obtain a priority sequence; The load computing unit is used for identifying the running state parameters of the plurality of edge computing gateways and carrying out load capacity evaluation to obtain load evaluation values of the plurality of gateways; The transmission matching unit is used for carrying out transmission demand matching on the load evaluation value according to the priority sequence and generating priority task queues of a plurality of gateways; And the sequential transmission unit is used for carrying out sequential transmission processing on the priority task queue and outputting a transmission job report. The method has the advantages that by carrying out dynamic priority evaluation on the standard data flow, factors such as data type, time delay sensitivity, service importance level, data source and the like can be comprehensively considered to form a priority sequence which is adjusted along with the change of the system state. The method avoids the problem of stiffness caused by the traditional static rules, and can ensure that data related to high real-time performance, high safety or key business is processed and transmitted preferentially. The dynamic priority mechanism enables the edge computing gateway to flexibly adjust the processing sequence according to the current service load and the data characteristics, and adapts to complex application scenes of multi-service concurrent and multi-data type mixed transmission, thereby improving the overall dispatching intelligence level o