CN-122027397-A - Industrial edge data acquisition gateway system and implementation method

CN122027397ACN 122027397 ACN122027397 ACN 122027397ACN-122027397-A

Abstract

The application relates to an industrial edge data acquisition gateway system and an implementation method thereof, which solve the technical problems of poor multi-protocol compatibility, low acquisition efficiency, lack of state self-adaptive scheduling and insufficient remote security of the traditional industrial data acquisition gateway; the system comprises a data acquisition module, a data processing module, a data uploading module, a state monitoring module, a trend prediction congestion, a remote management module, a reverse proxy long-connection safety access and configuration issuing module, wherein the data acquisition module is used for multiplexing a connection pool, collecting differentiated frequencies in batches, the data processing module is used for standardizing data, the data uploading module is used for reconnecting a binary protocol heartbeat, the state monitoring module is used for carrying out trend prediction congestion, adaptively switching channels, adjusting frequencies and cleaning idle connections, and integrating and uploading. The method has the following effects that the protocol dynamic expansion and efficient collection are realized, the network load is effectively reduced by the self-adaptive scheduling mechanism based on trend prediction, the real-time reliable transmission of key data is ensured, and the gateway stability and the remote operation and maintenance safety are obviously improved.

Inventors

LIU FULIANG
HE CHENGJIE
YU PEIFENG
FENG HONGYU
TIAN RUILIN
WU ZHIJUN

Assignees

宁波万德高科智能科技有限公司

Dates

Publication Date: 20260512
Application Date: 20260410

Claims (9)

1. An industrial edge data collection gateway system, comprising: The protocol management module is used for acquiring communication data of the industrial equipment, extracting a protocol feature vector, identifying a protocol type through a double-layer mechanism of similarity automatic matching and rule base rollback matching, and dynamically loading a corresponding protocol plug-in; the data acquisition module establishes connection with the industrial equipment through the protocol plug-in, differentially configures a connection pool according to a protocol identification result, multiplexes Chi Nalian the connection pool, distributes differential acquisition frequencies for different industrial equipment according to a preset frequency reference and a step length based on a protocol type, a corresponding equipment type and a data importance level, and acquires original data according to batch read-write data points with a preset batch size; the data processing module is used for carrying out standardization processing on the original data to generate standardized equipment data; the data uploading module receives standardized equipment data, asynchronously transmits the standardized equipment data to the cloud platform through a binary protocol, and automatically reconnects when the connection is interrupted; The state monitoring module is used for collecting gateway running state parameters, analyzing the running state parameter time sequence based on a preset trend analysis strategy to obtain trend predicted values of the parameters in a next time window, quantifying the congestion degree according to the superscalar amplitude when the trend predicted values exceed a preset congestion threshold, switching corresponding channel data to a preset low-load channel based on a preset scheduling strategy corresponding to a protocol type for uploading when the congestion degree exceeds a preset switching threshold, adjusting the differential collection frequency according to the congestion degree gradient, cleaning overtime idle connection in a connection pool, and fusing the running state parameters with standardized equipment data and uploading the fused running state parameters to the cloud platform; The remote management module establishes long connection with a remote management server of the cloud platform through the reverse proxy, forwards a remote request to the local service, receives protocol configuration data issued by the remote management server and forwards the protocol configuration data to the protocol management module.
2. The industrial edge data collection gateway system of claim 1, wherein obtaining communication data of an industrial device, extracting a protocol feature vector, and identifying a protocol type by a double-layer mechanism of similarity automatic matching and rule base rollback matching comprises: Acquiring industrial equipment communication data, extracting a protocol characteristic field, and constructing a communication protocol characteristic vector, wherein the protocol characteristic field comprises message format characteristics, register address characteristics and communication time sequence characteristics; Performing similarity calculation on the communication protocol feature vector and each standard protocol feature in a preset protocol fingerprint feature library to obtain a plurality of similarity values; When any similarity value is larger than or equal to a preset first matching threshold value, judging that the automatic matching is successful, and taking the protocol type determined by the standard protocol feature corresponding to the similarity value as a matching result; If the automatic matching is successful, dynamically loading a corresponding protocol plug-in from a protocol plug-in library based on a matching result; If the automatic matching fails, a protocol rollback matching algorithm based on a rule base is started, the matching degree calculation is carried out on the communication protocol feature vector and each protocol rule in a preset rule base, and the rollback matching is judged to be successful when any matching degree value is larger than or equal to a preset second matching threshold value, and the protocol type determined by the protocol rule corresponding to the matching degree value is used as a matching result; If the rollback matching is successful, dynamically loading a corresponding protocol plug-in from a protocol plug-in library based on a matching result, and adding the protocol feature corresponding to the matching result as a newly added standard protocol feature into a protocol fingerprint feature library; if the rollback matching fails, a protocol exception log is generated, the communication protocol feature vector is used as an unknown protocol feature to be uploaded to a remote management platform, and a preset protocol update package issued by the remote management platform is received, so that a protocol fingerprint feature library is updated according to new protocol features in the update package.
3. The industrial edge data collection gateway system of claim 2, wherein differentially configuring the connection pool and multiplexing the connection in the pool according to the protocol identification result comprises: according to the matching result of protocol identification, different connection pool configurations are distributed for different industrial equipment; when the protocol type is successfully determined through automatic matching, adopting a preset standard connection configuration to multiplex the connection in the connection pool; when the protocol type is successfully determined through rollback matching, adopting a preset conservative connection configuration to multiplex the connection in the connection pool; and monitoring the connection response time and the protocol plug-in response time of equipment adopting the conservative connection configuration in real time, triggering a protocol adaptation updating mechanism to start when the connection response time exceeds a preset response threshold or the continuous failure times exceeds a preset failure threshold, uploading a communication protocol feature vector corresponding to the equipment to a remote management platform for protocol rule correction, switching the connection configuration of the equipment to the standard connection configuration, multiplexing the connection in a connection pool for verification acquisition, and confirming the protocol rule correction effect.
4. The industrial edge data collection gateway system of claim 1, wherein assigning differential collection frequencies to different industrial devices with preset frequency references and step sizes based on protocol types and their corresponding device types and data importance levels comprises: Setting a basic acquisition frequency, a highest acquisition frequency and a lowest acquisition frequency for each industrial device based on the protocol type, the corresponding device type and the data importance level, and initially setting the acquisition frequency as the basic acquisition frequency; collecting data points of each industrial device in real time, and calculating the change rate and fluctuation amplitude of the data points; when the frequency of the change rate continuously exceeding the change rate upper limit threshold preset according to the protocol type and the equipment type reaches the preset frequency-up counting threshold, gradually increasing the acquisition frequency according to the preset frequency-up step length until the highest acquisition frequency is reached; when the frequency of the change rate continuously lower than the change rate lower limit threshold preset according to the protocol type and the equipment type reaches the preset frequency-reducing counting threshold and the fluctuation amplitude is lower than the fluctuation threshold preset according to the protocol type and the equipment type, gradually reducing the acquisition frequency according to the preset frequency-reducing step length until the lowest acquisition frequency is reached.
5. The industrial edge data collection gateway system of claim 4, wherein obtaining raw data from batch reading and writing of data points at a predetermined batch size comprises: dynamically adjusting the size of the preset batch according to the change rate and/or the fluctuation amplitude; When the change rate exceeds an upper limit threshold of the change rate preset according to the protocol type and the equipment type, reducing the preset batch size according to the preset batch decrement step length so as to improve the real-time response speed; When the change rate is lower than a change rate lower limit threshold preset according to the protocol type and the equipment type and the fluctuation amplitude is lower than a fluctuation threshold preset according to the protocol type and the equipment type, increasing the preset batch size according to the preset batch increment step length so as to improve the data compression efficiency; the preset batch decrement step length and the preset batch increment step length are determined according to the protocol type, the equipment type and the data importance level, and the higher the data importance level is, the larger the corresponding adjustment step length is.
6. The industrial edge data collection gateway system according to claim 1, wherein the time sequence analysis of the operating state parameters based on the preset trend analysis strategy to obtain the trend prediction value of each parameter in the next time window comprises: Acquiring each running state parameter acquired by a state monitoring module in real time, respectively constructing a sliding time window data sequence for each running state parameter, and determining the length of each sliding time window from preset window length configuration according to the protocol type; for each running state parameter, determining a corresponding exponential smoothing coefficient from preset smoothing coefficient configuration according to the type of equipment, and calculating a sliding time window data sequence of the parameter based on an exponential smoothing algorithm to obtain an initial trend predicted value of the parameter in a next time window; and determining a compensation coefficient from preset compensation coefficient configuration according to the data importance level, and correcting the initial trend predicted value of each running state parameter to obtain the trend predicted value of each running state parameter in the next time window.
7. The industrial edge data collection gateway system according to claim 6, wherein when the congestion level exceeds a preset switching threshold, switching the corresponding channel data to a preset low-load channel upload based on a preset scheduling policy corresponding to the protocol type comprises: extracting a trend predicted value corresponding to the network delay from trend predicted values of each running state parameter in a next time window according to a preset parameter type identifier; determining an alternative channel list from preset channel configuration according to the protocol type, and presetting a basic load threshold and an initial load sensitivity coefficient for each alternative channel; Correcting the initial load sensitivity coefficient by adopting a preset correction coefficient according to the data importance level, wherein the higher the data importance level is, the lower the corrected load sensitivity coefficient is; Calculating a weighted expected load value of each alternative channel in a next time window based on the trend predicted value of the network delay, the current load state of each alternative channel and the corrected load sensitivity coefficient; Comparing the weighted expected load value with a basic load threshold value of a corresponding alternative channel, and screening candidate channels with weighted expected load values lower than the basic load threshold value; and selecting a channel with the lowest load sensitivity coefficient after correction from the candidate channels as a target uploading channel, and switching the data to the target uploading channel.
8. The industrial edge data collection gateway system of claim 4, wherein adjusting the differentiated collection frequency and clearing timeout idle connections in the connection pool according to the congestion level gradient comprises: Acquiring the congestion degree determined by the state monitoring module, and dividing the congestion degree into a plurality of congestion levels according to a preset congestion degree grading rule; Determining a corresponding step correction coefficient from a preset step correction mapping relation according to the congestion level and the data importance level, wherein the step correction coefficient is larger when the congestion level is higher and the data importance level is lower; correcting the preset frequency-reducing step by using a step correction coefficient to obtain a corrected frequency-reducing step; Based on the correction frequency-reducing step length, gradually reducing the differentiated acquisition frequency of the equipment with the data importance level lower than the preset importance threshold value to the corresponding lowest acquisition frequency direction according to the correction frequency-reducing step length; setting corresponding idle connection timeout time for each device according to the congestion level and the data importance level, wherein the higher the congestion level is and the lower the data importance level is, the shorter the idle connection timeout time is; and cleaning the idle connection in the connection pool according to the idle connection timeout time corresponding to each device, wherein the idle connection is cleaned in sequence from low to high according to the data importance level during cleaning until no idle connection can be cleaned.
9. A method for implementing an industrial edge data acquisition gateway system, which is applied to an industrial edge data acquisition gateway system as claimed in any one of claims 1 to 8, and comprises the following steps: acquiring communication data of industrial equipment, determining a protocol type through protocol identification and dynamically loading a corresponding protocol plug-in; Establishing communication connection with industrial equipment through the loaded protocol plug-in, multiplexing connection in a preset capacity connection pool, distributing differentiated acquisition frequencies for different industrial equipment according to a preset frequency reference and a step length based on the protocol type, the corresponding equipment type and the data importance level, and acquiring a plurality of data points in a batch by adopting a preset batch size to acquire original data; carrying out standardization processing on the original data to generate standardized equipment data; receiving standardized equipment data, asynchronously transmitting the standardized equipment data to a cloud platform through a binary protocol containing a heartbeat mechanism with a preset heartbeat period, and automatically reconnecting when the connection is interrupted; Collecting gateway running state parameters, analyzing the running state parameter time sequence based on a preset trend analysis strategy to obtain trend predicted values of the parameters in a next time window, quantitatively determining the congestion degree according to the exceeding standard amplitude of the trend predicted values relative to the congestion threshold when the trend predicted values exceed the preset congestion threshold, switching corresponding channel data to a preset low-load channel for uploading based on a preset scheduling strategy corresponding to a protocol type when the congestion degree exceeds a preset switching threshold, adjusting differential acquisition frequency according to the congestion degree gradient, cleaning overtime idle connection in a connection pool, transmitting the running state parameters to a data uploading step to be fused with standardized equipment data, and uploading to a cloud platform; The method comprises the steps of establishing long connection with a remote management server in a cloud platform through a reverse HTTP proxy, receiving a remote HTTP request, forwarding the remote HTTP request to a local service of a preset port, receiving protocol configuration data issued by the remote management server, and forwarding the protocol configuration data to a protocol identification step, so that gateway remote security access is realized.

Description

Industrial edge data acquisition gateway system and implementation method Technical Field The invention relates to the technical field of industrial Internet of things, in particular to an industrial edge data acquisition gateway system and an implementation method. Background Along with the deep fusion of the industrial Internet and intelligent manufacturing, an industrial production system is evolving towards digitization, networking and intellectualization. The industrial edge data acquisition gateway is used as a core hub for connecting a physical production site and the digital cloud platform, and the real-time performance and the processing reliability of data acquisition directly determine the efficiency of upper intelligent application. The gateway has high-efficiency data acquisition, processing and transmission capacity, and is a key link for opening industrial data barriers, releasing production data value and guaranteeing collaborative optimization of a system. The data acquisition gateway widely applied in the current industrial field mostly adopts a relatively solidified technical architecture in function realization. In the aspect of protocol access, equipment docking is realized generally based on a preset static protocol library, in the aspect of data acquisition, parameters such as acquisition frequency, batch size and the like are fixedly configured and are difficult to dynamically adjust according to on-site working condition changes, in the aspect of data processing and transmission, a fixed period reporting mechanism is mostly adopted, an alarm strategy is simpler, active coping capability is lacking for network fluctuation, in the aspect of network and connection management, simple on-off monitoring or load judgment is mostly carried out based on the current network state, a prospective scheduling mechanism is lacking, in the aspect of remote operation and maintenance, remote access and configuration of equipment are realized generally by means of a virtual special network or port mapping technology, and the problems of complex configuration, higher safety risk and the like exist. However, the above-described relatively cured technical architecture faces many challenges in practical applications. Because the protocol access depends on a static library and parameters such as acquisition, transmission and the like are fixedly configured, when the unknown protocol, working condition change or network fluctuation is faced, the existing scheme generally only depends on manual intervention or simple passive response mechanisms such as on-off monitoring, fixed retry and the like, and lacks the capability of dynamic expansion of the protocol, self-adaptive adjustment of parameters and network look-ahead scheduling. The system has limitation in the aspects of flexibility, instantaneity and reliability, and the problems of difficult access, resource waste, data loss and the like are easy to occur, so that the high standard requirements of industrial production on data acquisition instantaneity, system operation reliability and function evolution are difficult to fully meet. Disclosure of Invention In order to realize dynamic expansion and efficient collection of protocols, a self-adaptive scheduling mechanism based on trend prediction effectively reduces network load, ensures real-time reliable transmission of key data, and remarkably improves gateway stability and remote operation and maintenance safety, the application provides an industrial edge data collection gateway system and an implementation method. In a first aspect, the present application provides an industrial edge data acquisition gateway system, which adopts the following technical scheme: An industrial edge data collection gateway system, comprising: The protocol management module is used for acquiring communication data of the industrial equipment, extracting a protocol feature vector, identifying a protocol type through a double-layer mechanism of similarity automatic matching and rule base rollback matching, and dynamically loading a corresponding protocol plug-in; the data acquisition module establishes connection with the industrial equipment through the protocol plug-in, differentially configures a connection pool according to a protocol identification result, multiplexes Chi Nalian the connection pool, distributes differential acquisition frequencies for different industrial equipment according to a preset frequency reference and a step length based on a protocol type, a corresponding equipment type and a data importance level, and acquires original data according to batch read-write data points with a preset batch size; the data processing module is used for carrying out standardization processing on the original data to generate standardized equipment data; the data uploading module receives standardized equipment data, asynchronously transmits the standardized equipment data to the cloud platform through a binary proto