CN-122027857-A - RTP video frame assembling method and system
Abstract
The invention discloses an RTP video frame assembling method and system, which are used for identifying the authentication of an accessed terminal, calibrating an RTP packet sending route of an effective terminal, adjusting RTP packet sending operation of the RTP packet sending route according to node attributes of the RTP packet sending route, detecting RTP packets from the RTP packet sending route, judging whether the RTP packets belong to complete image frames, carrying out marking identification and tracing on the RTP packets belonging to the complete image frames, determining other RTP packets associated with the RTP packets, carrying out frame disassembly and queue integration on all RTP packets according to frame relations of all the associated RTP packets to obtain RTP frame queues, and correcting and assembling the RTP frame queues to obtain video data. RTP packets belonging to the same video data are ensured to be correctly and effectively collected, and the assembly and restoration correctness and efficiency are improved.
Inventors
- LI YUTAO
- YU DAN
- WANG DANXING
Assignees
- 慧之安信息技术股份有限公司
Dates
- Publication Date
- 20260512
- Application Date
- 20251225
Claims (8)
- An rtp video frame assembly method comprising: The RTP packet sending operation of the RTP packet sending route is adjusted according to the node attribute of the RTP packet sending route; detecting the RTP packet from the RTP packet sending route, judging whether the RTP packet belongs to a complete image frame, and carrying out mark identification and tracing on the RTP packet belonging to the complete image frame to determine other RTP packets related to the RTP packet; and carrying out frame disassembly and queue integration on all RTP packets according to the frame relation of all the associated RTP packets to obtain an RTP frame queue, and correcting and assembling the RTP frame queue to obtain video data.
- 2. The RTP video frame assembly method according to claim 1 wherein: The RTP packet sending operation of the RTP packet sending route is adjusted according to the node attribute of the RTP packet sending route, and the RTP packet sending operation comprises the following steps: Extracting a real-time transmission success record of the terminal from a work log of the accessed terminal, and determining the transmission success rate of the terminal to video data according to the real-time transmission success record, so as to identify whether the terminal belongs to an effective terminal or not by authentication; Calibrating an RTP packet sending route of an effective terminal according to a node accessed to the network and an active link in the network by the effective terminal, wherein the RTP packet sending route refers to an RTP packet sending route with a shortest link path of the effective terminal; Determining the whole available bandwidth of the RTP packet sending route according to the available bandwidth time domain available attribute of all nodes subordinate to the RTP packet sending route; and adjusting the RTP packet sending flow rate of the RTP packet sending route according to the whole available bandwidth.
- 3. The RTP video frame assembly method according to claim 1 wherein: Detecting the RTP packet from the RTP packet sending route, judging whether the RTP packet belongs to a complete image frame, and carrying out mark identification and tracing on the RTP packet belonging to the complete image frame to determine other RTP packets related to the RTP packet, wherein the method comprises the following steps: Sampling and slicing detection are carried out on the RTP packet according to the flow rate fluctuation of the RTP packet from the RTP packet sending route, so as to obtain the start-stop slicing characteristic of the RTP packet, wherein the start-stop slicing characteristic comprises the index codes of the first slicing and the last slicing in the RTP packet; comparing the index code difference between the first slice and the last slice, and judging whether the RTP packet belongs to a complete image frame; And tracing all RTP packets which belong to the complete image frame and are transmitted completely according to the sequence number information, thereby determining other RTP packets associated with the RTP packets.
- 4. The RTP video frame assembly method according to claim 1 wherein: According to the frame relation of all the associated RTP packets, carrying out frame disassembly and queue integration on all the RTP packets to obtain RTP frame queues, correcting and assembling the RTP frame queues to obtain video data, wherein the method comprises the following steps: Determining the frame sequence relation of all RTP packets according to the sequence number information of each associated RTP packet, and carrying out frame data disassembly and restoration and queue sequencing integration on all RTP packets according to the frame sequence relation to obtain an RTP frame queue; And identifying a frame dropping interval in the RTP frame queue, and carrying out frame supplementing correction and assembly on the RTP frame queue according to the RTP frame contents at the two ends of the frame dropping interval to obtain video data.
- An rtp video frame assembly system comprising: The route calibration module is used for identifying the authentication of the accessed terminal and calibrating the RTP packet sending route of the effective terminal; a sending operation adjusting module, configured to adjust an RTP packet sending operation for the RTP packet sending route according to a node attribute of the RTP packet sending route; The RTP packet judging module is used for detecting the RTP packet from the RTP packet sending route and judging whether the RTP packet belongs to a complete image frame or not; The RTP packet tracing module is used for carrying out mark identification and tracing on RTP packets belonging to the complete image frame and determining other RTP packets related to the RTP packets; The frame queue generating module is used for carrying out frame disassembly and queue integration on all the RTP packets according to the frame relation of all the associated RTP packets to obtain an RTP frame queue; And the assembling module is used for correcting and assembling the RTP frame queue to obtain video data.
- 6. The RTP video frame assembly system of claim 5 wherein: the route calibration module is used for identifying the authentication of the accessed terminal, calibrating the RTP packet sending route of the effective terminal, and comprises the following steps: Extracting a real-time transmission success record of the terminal from a work log of the accessed terminal, and determining the transmission success rate of the terminal to video data according to the real-time transmission success record, so as to identify whether the terminal belongs to an effective terminal or not by authentication; Calibrating an RTP packet sending route of an effective terminal according to a node accessed to the network and an active link in the network by the effective terminal, wherein the RTP packet sending route refers to an RTP packet sending route with a shortest link path of the effective terminal; the sending operation adjusting module is configured to adjust an RTP packet sending operation for the RTP packet sending route according to a node attribute of the RTP packet sending route, and includes: Determining the whole available bandwidth of the RTP packet sending route according to the available bandwidth time domain available attribute of all nodes subordinate to the RTP packet sending route; and adjusting the RTP packet sending flow rate of the RTP packet sending route according to the whole available bandwidth.
- 7. The RTP video frame assembly system of claim 5 wherein: The RTP packet judging module is configured to detect an RTP packet from the RTP packet transmission route, and judge whether the RTP packet belongs to a complete image frame, and includes: Sampling and slicing detection are carried out on the RTP packet according to the flow rate fluctuation of the RTP packet from the RTP packet sending route, so as to obtain the start-stop slicing characteristic of the RTP packet, wherein the start-stop slicing characteristic comprises the index codes of the first slicing and the last slicing in the RTP packet; comparing the index code difference between the first slice and the last slice, and judging whether the RTP packet belongs to a complete image frame; the RTP packet tracing module is configured to perform label identification and tracing on an RTP packet belonging to a complete image frame, determine other RTP packets associated with the RTP packet, and include: And tracing all RTP packets which belong to the complete image frame and are transmitted completely according to the sequence number information, thereby determining other RTP packets associated with the RTP packets.
- 8. The RTP video frame assembly system of claim 5 wherein: The frame queue generating module is configured to perform frame disassembly and queue integration on all RTP packets according to the frame relation of all the associated RTP packets, to obtain an RTP frame queue, and includes: Determining the frame sequence relation of all RTP packets according to the sequence number information of each associated RTP packet, and carrying out frame data disassembly and restoration and queue sequencing integration on all RTP packets according to the frame sequence relation to obtain an RTP frame queue; The assembling module is configured to correct and assemble the RTP frame queue to obtain video data, and includes: And identifying a frame dropping interval in the RTP frame queue, and carrying out frame supplementing correction and assembly on the RTP frame queue according to the RTP frame contents at the two ends of the frame dropping interval to obtain video data.
Description
RTP video frame assembling method and system Technical Field The invention relates to the technical field of video data processing, in particular to an RTP video frame assembling method and an RTP video frame assembling system. Background The real-time transport protocol (RTP, real-time transport protocol) is widely used in network data transmission scenarios. The video data is used as large-scale data, and is decomposed into a plurality of RTP packets in the network transmission process, so that the RTP packets are sequentially transmitted to the destination terminal, and all the RTP packets are assembled locally at the destination terminal to obtain the video data. The current assembly of the RTP packets is realized based on sequential splicing of sequence numbers carried by the RTP packets, and video data can be quickly restored in the mode under normal conditions, but in actual operation, the sequence numbers of the RTP packets can be tampered and the actual positions of the RTP packets can not be correctly reflected, so that all RTP packets belonging to the same video data can not be accurately calibrated, frame loss and other conditions are easy to occur, and the assembly and restoration accuracy and efficiency of the video data are reduced. Disclosure of Invention Considering that the existing assembly and restoration of the RTP packets into video data are realized by taking the serial numbers of the RTP packets as references, the mode possibly ignores the relevance among different RTP packets, cannot calibrate all RTP packets belonging to the same video data, causes frame loss during assembly, and reduces the accuracy and efficiency of assembly and restoration. The present invention has been made in view of the above problems, and it is an object of the present invention to provide an RTP video frame assembly method that overcomes or at least partially solves the above problems, comprising: The RTP packet sending operation of the RTP packet sending route is adjusted according to the node attribute of the RTP packet sending route; detecting the RTP packet from the RTP packet sending route, judging whether the RTP packet belongs to a complete image frame, and carrying out mark identification and tracing on the RTP packet belonging to the complete image frame to determine other RTP packets related to the RTP packet; and carrying out frame disassembly and queue integration on all RTP packets according to the frame relation of all the associated RTP packets to obtain an RTP frame queue, and correcting and assembling the RTP frame queue to obtain video data. Optionally, identifying the authentication of the accessed terminal, calibrating the RTP packet sending route of the effective terminal, and adjusting the RTP packet sending operation of the RTP packet sending route according to the node attribute of the RTP packet sending route, comprising the following steps: Extracting a real-time transmission success record of the terminal from a work log of the accessed terminal, and determining the transmission success rate of the terminal to video data according to the real-time transmission success record, so as to identify whether the terminal belongs to an effective terminal or not by authentication; Calibrating an RTP packet sending route of an effective terminal according to a node accessed to the network and an active link in the network by the effective terminal, wherein the RTP packet sending route refers to an RTP packet sending route with a shortest link path of the effective terminal; Determining the whole available bandwidth of the RTP packet sending route according to the available bandwidth time domain available attribute of all nodes subordinate to the RTP packet sending route; and adjusting the RTP packet sending flow rate of the RTP packet sending route according to the whole available bandwidth. Optionally, detecting the RTP packet from the RTP packet sending route to judge whether the RTP packet belongs to a complete image frame, and identifying and tracing the RTP packet belonging to the complete image frame to determine other RTP packets associated with the RTP packet, including: Sampling and slicing detection are carried out on the RTP packet according to the flow rate fluctuation of the RTP packet from the RTP packet sending route, so as to obtain the start-stop slicing characteristic of the RTP packet, wherein the start-stop slicing characteristic comprises the index codes of the first slicing and the last slicing in the RTP packet; comparing the index code difference between the first slice and the last slice, and judging whether the RTP packet belongs to a complete image frame; And tracing all RTP packets which belong to the complete image frame and are transmitted completely according to the sequence number information, thereby determining other RTP packets associated with the RTP packets. Optionally, according to the frame relation of all the associated RTP packets, carrying out fram