CN-121984929-A - Intelligent parallel data packet system and method integrating information model and dynamic adjustment

CN121984929ACN 121984929 ACN121984929 ACN 121984929ACN-121984929-A

Abstract

The invention relates to the technical field of industrial Internet of things and data processing, and discloses an intelligent parallel data packet system and method integrating an information model and dynamic adjustment; the parallel packet strategy based on the information model is used for classifying and processing data, the bottleneck of serial processing is thoroughly broken, the throughput of data packaging is greatly improved, the optimization of network resource utilization is realized by sensing the network state in real time and intelligently adjusting the packet size and structure, the efficient and reliable transmission can be kept under various network conditions, the data formats are unified from the source through the standardized information model and interfaces, the data packets generated by different systems can be seamlessly analyzed and understood, the data island is effectively broken, the dynamic adjustment mechanism can intelligently select and omit non-key fields according to the network condition and the data importance, the redundancy of data transmission is obviously reduced, and the bandwidth and the storage cost are saved.

Inventors

WANG FEIJIAN
YAO YUJUAN
NIU BINGRU

Assignees

和利时卡优倍科技有限公司

Dates

Publication Date: 20260505
Application Date: 20251216

Claims (10)

1. An intelligent parallel data packet system integrating an information model and dynamic adjustment, comprising: The information model library is used for storing and managing predefined data information models and providing a standardized access interface for each model; the parallel packing engine is connected with the information model library and used for distributing data to different parallel processing pipelines for packing according to the information model; the network state monitor is used for collecting network performance parameters in real time; and the dynamic adjustment decision device is connected with the network state monitor and the parallel packet engine and is used for generating an adjustment instruction according to the network performance parameter and issuing the adjustment instruction to the parallel packet engine so as to dynamically adjust the assembly process of the data packet.
2. The intelligent parallel data packet system for integrating an information model with dynamic adjustments as recited in claim 1, wherein the data structure of the information model is mandatory to contain a data source type, a data attribute set, and an event type field.
3. The intelligent parallel data packetization system for both information model and dynamic adjustment of claim 2 wherein the parallel packetization engine is configured to distribute data belonging to the same information model to the same processing pipeline.
4. The intelligent parallel data packet system for integrating an information model and dynamic adjustment according to claim 1, wherein a decision algorithm is built in the dynamic adjustment decision device, and the algorithm outputs the upper limit of the size of the data packet and a subset of data attributes to be contained in the data packet according to the network performance parameters.
5. The intelligent parallel data packet system for integrating an information model with dynamic adjustment of claim 4, wherein the decision algorithm is a machine learning model or a rule engine based on predefined rules.
6. The intelligent parallel data packet system for integrating an information model with dynamic adjustment as recited in claim 5, wherein the input features of the machine learning model include at least one of a current available bandwidth, a transmission delay, and a data priority.
7. The intelligent parallel data package system for integrating an information model and dynamic adjustment as set forth in claim 1, wherein said dynamic adjustment decision maker communicates with said parallel package engine via a publish-subscribe scheme.
8. A method of intelligent parallel data packetization based on the system of any of claims 1-7, comprising the steps of: s1, routing received data to a corresponding parallel processing pipeline according to a predefined information model; S2, monitoring network performance parameters in real time; S3, dynamically generating an instruction for adjusting the size and the structure of the data packet based on the network performance parameters; S4, in the parallel processing pipeline, assembling the data according to the instruction to form a data packet.
9. The intelligent parallel data packet method according to claim 8, wherein the step S3 of dynamically generating the instructions for adjusting the size and structure of the data packet is performed by a machine learning model that infers the optimal data packet size and structure configuration based on the input network performance parameters.
10. The intelligent parallel data grouping method according to claim 8, wherein step S4 omits non-critical data attributes according to the instruction during the data package assembly process to reduce the data package volume.

Description

Intelligent parallel data packet system and method integrating information model and dynamic adjustment Technical Field The invention relates to the technical field of industrial Internet of things and data processing, in particular to an intelligent parallel data packet system and method integrating an information model and dynamic adjustment. Background Along with popularization of industrial Internet of things, industrial sites generate massive, multi-source and heterogeneous time sequence data, the data have great differences in data source, sampling frequency, data structure and real-time requirements, and the existing data packet and transmission scheme have the following defects: The efficiency is low, namely, a single and serial packet-forming process is adopted, and high concurrent data streams cannot be dealt with, so that a processing bottleneck is formed; The size and the structure of the data packet are fixed, and the data packet cannot be adaptively adjusted according to the dynamically-changed network state (such as bandwidth and delay), so that the network resource utilization efficiency is low, the transmission delay is high and the packet loss is serious under the severe network condition; The interoperability is poor, because of lacking unified data definition and interface standard, the data packet formats generated by different systems are different, so that the data sharing and integration among the systems are difficult, and a data island is formed; The redundancy is high, the data attribute to be transmitted cannot be intelligently selected according to the context, and the total data is transmitted frequently, so that the waste of network bandwidth and storage resources is caused. Disclosure of Invention The invention aims to provide an intelligent parallel data packet system and method for fusing an information model and dynamic adjustment, so as to solve the problems in the background technology. In order to achieve the above purpose, the invention provides a technical scheme that an intelligent parallel data packet system integrating an information model and dynamic adjustment comprises: The information model library is used for storing and managing predefined data information models and providing a standardized access interface for each model; the parallel packing engine is connected with the information model library and used for distributing data to different parallel processing pipelines for packing according to the information model; the network state monitor is used for collecting network performance parameters in real time; and the dynamic adjustment decision device is connected with the network state monitor and the parallel packet engine and is used for generating an adjustment instruction according to the network performance parameter and issuing the adjustment instruction to the parallel packet engine so as to dynamically adjust the assembly process of the data packet. Preferably, the data structure of the information model is forced to contain data source type, data attribute set and event type fields. Preferably, the parallel packing engine is configured to distribute data belonging to the same information model to the same processing pipeline. Preferably, the dynamic adjustment decision maker is internally provided with a decision algorithm, and the algorithm outputs the upper limit of the size of the data packet and the subset of the data attributes to be contained in the data packet according to the network performance parameters. Preferably, the decision algorithm is a machine learning model or a rules engine based on predefined rules. Preferably, the input features of the machine learning model include at least one of a currently available bandwidth, a transmission delay, and a data priority. Preferably, the dynamic adjustment decision maker communicates with the parallel group package engine through a publish-subscribe mode. An intelligent parallel data packet method comprises the following steps: s1, routing received data to a corresponding parallel processing pipeline according to a predefined information model; S2, monitoring network performance parameters in real time; S3, dynamically generating an instruction for adjusting the size and the structure of the data packet based on the network performance parameters; S4, in the parallel processing pipeline, assembling the data according to the instruction to form a data packet. Preferably, the step S3 of dynamically generating the instruction for adjusting the size and structure of the data packet is performed by a machine learning model, and the model infers the optimal size and structure configuration of the data packet according to the input network performance parameters. Preferably, in the packet assembling process, the step S4 omits non-critical data attributes according to the instruction, so as to reduce the volume of the packet. Compared with the prior art, the invention has the following beneficial ef