CN-122027752-A - Data synchronous processing method, device, medium and equipment

CN122027752ACN 122027752 ACN122027752 ACN 122027752ACN-122027752-A

Abstract

The application discloses a data synchronous processing method, a device, a medium and equipment, wherein the method comprises the steps of obtaining a visible light data frame sequence and an infrared data frame sequence from a dynamic buffer zone; the method comprises the steps of calibrating a time stamp of an infrared data frame sequence and a time stamp of a visible light data frame sequence to determine a clock offset parameter, carrying out time offset compensation processing on the infrared data frame sequence based on the clock offset parameter to obtain a target infrared data frame sequence, determining a plurality of reference synchronous time points based on the time stamp of the target infrared data frame sequence, determining a dynamic time window corresponding to each reference synchronous time point, selecting a first target data frame from the visible light data frame sequence and a second target data frame from the target infrared data frame sequence based on the dynamic time window corresponding to each reference synchronous time point, and taking the first target data frame and the second target data frame as a group of time-synchronous data frames to carry out data display processing. The application can realize the accurate alignment of the visible light data and the infrared data in time and data.

Inventors

XIA HANXIONG

Assignees

宁波方太厨具有限公司

Dates

Publication Date: 20260512
Application Date: 20260107

Claims (11)

1. A method for synchronously processing data, the method comprising: The method comprises the steps of obtaining a visible light data frame sequence and an infrared data frame sequence from a dynamic buffer zone, wherein the capacity of the dynamic buffer zone is determined by a network data transmission state and a data display processing state; calibrating the time stamp of the infrared data frame sequence and the time stamp of the visible light data frame sequence to determine a clock offset parameter; Performing time offset compensation processing on the infrared data frame sequence based on the clock offset parameter to obtain a target infrared data frame sequence; determining a plurality of reference synchronization time points based on the time stamps of the target infrared data frame sequence; determining a dynamic time window corresponding to each reference synchronization time point in the plurality of reference synchronization time points; And selecting a first target data frame from the visible light data frame sequence and a second target data frame from the target infrared data frame sequence based on the dynamic time window corresponding to each reference synchronization time point, and using the first target data frame and the second target data frame as a group of time-synchronized data frames corresponding to each reference synchronization time point so as to perform data display processing.
2. The method of claim 1, wherein the determining a dynamic time window corresponding to each of the plurality of reference synchronization time points comprises: determining a reference synchronization period based on a first acquisition frequency of the sequence of visible light data frames and a second acquisition frequency of the sequence of infrared data frames; Determining the current network transmission delay based on the receiving and transmitting time stamp of the target infrared data frame corresponding to each reference synchronous time point in the target infrared data frame sequence; and determining a dynamic time window corresponding to each reference synchronization time point based on each reference synchronization time point, the reference synchronization period and the current network transmission delay.
3. The method according to claim 1, wherein the method further comprises: When the visible light data frame sequence does not exist in the dynamic time window corresponding to the current reference synchronous time point, interpolation is carried out by utilizing the first target data frame determined based on the dynamic time window corresponding to the previous reference synchronous time point, so that the first target data frame in the dynamic time window corresponding to the current reference synchronous time point is obtained; The current reference synchronization time point is any one of the plurality of reference synchronization time points.
4. The method according to claim 2, wherein the method further comprises: And discarding the current reference synchronization time point when the data display processing state indicates that the current data display processing time delay exceeds the reference synchronization period, wherein the current reference synchronization time point is any one of the reference synchronization time points.
5. The method of claim 1, wherein calibrating the time stamps of the sequence of infrared data frames and the time stamps of the sequence of visible light data frames to determine the clock offset parameter comprises: Constructing a plurality of time stamp pairs based on the time stamp of each infrared data frame in the infrared data frame sequence and the time stamp of each visible light data frame in the visible light data frame sequence; And determining the clock offset parameter, wherein the clock offset parameter comprises a clock frequency ratio and a time offset, and the clock frequency ratio indicates a ratio of a running frequency between a clock source of a first device for acquiring the visible light data frame sequence and a clock source of a second device for acquiring the infrared data frame sequence under the condition that the square sum of residual errors corresponding to the plurality of time stamp pairs is minimized.
6. The method of claim 5, wherein the method further comprises: Determining a fitting difference value corresponding to each of the plurality of timestamp pairs based on the plurality of timestamp pairs, the clock frequency ratio, and the time offset; and if any time stamp pair exists, the corresponding fitting difference value is larger than a preset threshold value, and the time stamp of the infrared data frame sequence and the time stamp of the visible light data frame sequence are recalibrated.
7. The method according to claim 1, wherein the method further comprises: the method comprises the steps of obtaining a network fluctuation weight coefficient, a speed difference weight coefficient and a basic capacity, wherein the network fluctuation weight coefficient indicates the sensitivity degree of data synchronous processing to network transmission fluctuation, and the speed difference weight coefficient indicates the importance degree of the difference value between the data transmission arrival speed and the data synchronous processing speed; Determining a network bandwidth fluctuation rate and a network average bandwidth in a previous time period, wherein the network bandwidth fluctuation rate indicates the transmission stability of a network bandwidth, and the network average bandwidth indicates the average data volume transmitted by the network in the previous time period; Determining the arrival speed of data transmission and the synchronous processing speed of data in the previous time period; And determining the capacity of the dynamic buffer in the current time period based on the network fluctuation weight coefficient, the speed difference weight coefficient, the basic capacity, the network bandwidth fluctuation rate, the network average bandwidth, the data transmission arrival speed and the data synchronous processing speed.
8. The method of claim 7, wherein the method further comprises: Acquiring the capacity occupation ratio of a first transmission buffer zone of first equipment for acquiring the visible light data frame sequence or the capacity occupation ratio of a second transmission buffer zone of second equipment for acquiring the infrared data frame sequence; Determining a capacity increment when the capacity occupation ratio of the first transmission buffer zone is larger than a first ratio threshold value and the quantity of visible light data to be transmitted in the first transmission buffer zone is in an increasing situation, or when the capacity occupation ratio of the second transmission buffer zone is larger than a second ratio threshold value and the quantity of infrared data to be transmitted in the second transmission buffer zone is in an increasing situation, and updating the capacity of the dynamic buffer zone based on the capacity increment; And determining a capacity decrement when the capacity occupation ratio of the first transmission buffer area is smaller than a third ratio threshold value and the quantity of the visible light data to be transmitted in the first transmission buffer area is in a reduced state, or when the capacity occupation ratio of the second transmission buffer area is smaller than a fourth ratio threshold value and the quantity of the infrared data to be transmitted in the second transmission buffer area is in a reduced state, and updating the capacity of the dynamic buffer area based on the capacity decrement.
9. A data synchronization processing apparatus, the apparatus comprising: The system comprises an acquisition module, a dynamic buffer zone, a data display processing module and a data display processing module, wherein the acquisition module is used for acquiring a visible light data frame sequence and an infrared data frame sequence from the dynamic buffer zone, and the capacity of the dynamic buffer zone is determined by a network data transmission state and a data display processing state; the calibration module is used for calibrating the time stamp of the infrared data frame sequence and the time stamp of the visible light data frame sequence and determining clock offset parameters; the time offset compensation module is used for carrying out time offset compensation processing on the infrared data frame sequence based on the clock offset parameter to obtain a target infrared data frame sequence; A reference synchronization time point determining module, configured to determine a plurality of reference synchronization time points based on time stamps of the target infrared data frame sequence; The dynamic time window determining module is used for determining a dynamic time window corresponding to each reference synchronous time point in the plurality of reference synchronous time points; And the data frame alignment module is used for selecting a first target data frame from the visible light data frame sequence and a second target data frame from the target infrared data frame sequence based on the dynamic time window corresponding to each reference synchronization time point, and the first target data frame and the second target data frame are used as a group of time-synchronized data frames corresponding to each reference synchronization time point so as to perform data display processing.
10. A computer-readable storage medium, wherein at least one instruction or at least one program is stored in the computer-readable storage medium, the at least one instruction or the at least one program being loaded and executed by a processor to implement the data synchronization processing method according to any one of claims 1 to 8.
11. A computer device comprising a processor and a memory, wherein the memory has stored therein at least one instruction or at least one program that is loaded and executed by the processor to implement the data synchronization processing method of any one of claims 1 to 8.

Description

Data synchronous processing method, device, medium and equipment Technical Field The present application relates to the field of data processing technologies, and in particular, to a method, an apparatus, a medium, and a device for data synchronization processing. Background In order to better show the working state of the electric appliance, the infrared sensor and the visible light camera can be integrated in the electric appliance, infrared data and visible light data are collected in real time in the working process, and the infrared data and the visible light data are converted into images for synchronous display. Because time delay is generated in all links of data acquisition, transmission, processing and the like, the data fusion or separate synchronous display of multiple sensors can be greatly influenced. In the related art, synchronous acquisition of multiple sensor sides is realized only by means of hardware pulses, and multichannel data is simply aligned by time stamps, so that the phenomenon of data dislocation is still outstanding. Disclosure of Invention In order to align multi-channel data more accurately, the application provides a data synchronous processing method, a device, a medium and equipment. The technical scheme is as follows: in a first aspect, the present application provides a method for synchronously processing data, the method comprising: The method comprises the steps of obtaining a visible light data frame sequence and an infrared data frame sequence from a dynamic buffer zone, wherein the capacity of the dynamic buffer zone is determined by a network data transmission state and a data display processing state; calibrating the time stamp of the infrared data frame sequence and the time stamp of the visible light data frame sequence to determine a clock offset parameter; Performing time offset compensation processing on the infrared data frame sequence based on the clock offset parameter to obtain a target infrared data frame sequence; determining a plurality of reference synchronization time points based on the time stamps of the target infrared data frame sequence; determining a dynamic time window corresponding to each reference synchronization time point in the plurality of reference synchronization time points; And selecting a first target data frame from the visible light data frame sequence and a second target data frame from the target infrared data frame sequence based on the dynamic time window corresponding to each reference synchronization time point, and using the first target data frame and the second target data frame as a group of time-synchronized data frames corresponding to each reference synchronization time point so as to perform data display processing. Optionally, the determining a dynamic time window corresponding to each reference synchronization time point in the plurality of reference synchronization time points includes: determining a reference synchronization period based on a first acquisition frequency of the sequence of visible light data frames and a second acquisition frequency of the sequence of infrared data frames; Determining the current network transmission delay based on the receiving and transmitting time stamp of the target infrared data frame corresponding to each reference synchronous time point in the target infrared data frame sequence; and determining a dynamic time window corresponding to each reference synchronization time point based on each reference synchronization time point, the reference synchronization period and the current network transmission delay. Optionally, the method further comprises: When the visible light data frame sequence does not exist in the dynamic time window corresponding to the current reference synchronous time point, interpolation is carried out by utilizing the first target data frame determined based on the dynamic time window corresponding to the previous reference synchronous time point, so that the first target data frame in the dynamic time window corresponding to the current reference synchronous time point is obtained; The current reference synchronization time point is any one of the plurality of reference synchronization time points. Optionally, the method further comprises: And discarding the current reference synchronization time point when the data display processing state indicates that the current data display processing time delay exceeds the reference synchronization period, wherein the current reference synchronization time point is any one of the reference synchronization time points. Optionally, the calibrating the time stamp of the infrared data frame sequence and the time stamp of the visible light data frame sequence to determine a clock offset parameter includes: Constructing a plurality of time stamp pairs based on the time stamp of each infrared data frame in the infrared data frame sequence and the time stamp of each visible light data frame in the visible light data fram