CN-121985163-A - Distributed video synchronous display control method and computer readable storage medium

CN121985163ACN 121985163 ACN121985163 ACN 121985163ACN-121985163-A

Abstract

The invention discloses a distributed video synchronous display control method and a computer readable storage medium, wherein the method comprises the steps that a driving layer of each slave adds a picture to be displayed into a frame buffer queue, and reports a display time stamp of the picture to be displayed to a host, wherein the display time stamp of the picture to be displayed is determined according to a video stream ID corresponding to the picture to be displayed and a display time stamp of a video frame, when the host detects that each slave reports the same display time stamp, the driving layer of each slave determines the display time of the picture to be displayed corresponding to the same display time stamp according to the same display time stamp, and broadcasts the display time to each slave, and the driving layer of each slave obtains the picture to be displayed corresponding to the same display time stamp from the frame buffer queue according to the display time and sends the picture to a display for display. The invention can realize the synchronous playing and displaying of the 0 frame difference of the distributed playing terminal.

Inventors

FENG HAO
XU YONG
SU CAIDE
XU JIYUN
ZHENG YUAN
LU LIANJIN

Assignees

福建星网视易信息系统有限公司

Dates

Publication Date: 20260505
Application Date: 20251216

Claims (11)

1. A distributed video synchronous display control method, comprising: The method comprises the steps that a driving layer of each slave adds a picture to be displayed into a frame buffer queue, and reports a display time stamp of the picture to be displayed to a master, wherein the display time stamp of the picture to be displayed is determined according to a video stream ID (identity) corresponding to the picture to be displayed and a display time stamp of a video frame; When the host detects that each slave machine reports the same display time stamp, the display time of the picture to be displayed corresponding to the same display time stamp is determined according to the same display time stamp, the display time is broadcasted to each slave machine, and the driving layer of each slave machine obtains the picture to be displayed corresponding to the same display time stamp from a frame buffer queue according to the display time and sends the picture to be displayed to a display for displaying.
2. The method according to claim 1, wherein the driving layer of each slave adds a frame to be displayed to a frame buffer queue, and before reporting a display time stamp of the frame to be displayed to a host, the method further comprises: The application layer of each slave machine respectively renders each video frame in the video to be played frame by frame; generating a corresponding picture to be displayed according to the rendered video frame, and setting a display time stamp of the corresponding picture to be displayed according to the display time stamp of the video frame and a video stream ID corresponding to the video frame; The picture to be displayed is sent to an operating system layer; And after receiving the picture to be displayed, the operating system layer sends the picture to be displayed to the driving layer.
3. The method according to claim 2, wherein the application layer sets the task level of the picture to be displayed as the highest priority, and the operating system layer preferentially sends the picture to be displayed to the driving layer after receiving the picture to be displayed.
4. The method according to claim 2, wherein before the application layer of each slave renders each video frame in the video to be played, each frame by frame, the method further comprises: Setting a unique identifier for a video to be played, wherein the unique identifier is a video stream ID; and distributing the video to be played or the video to be played after splitting to each slave machine.
5. The distributed video synchronization display control method according to claim 1, further comprising: If the number of the pictures to be displayed in the frame buffer queue of the slave machine exceeds the preset proportion of the length of the frame buffer queue, determining the pictures to be discarded in the frame buffer queue of the slave machine, and removing the pictures to be discarded from the frame buffer queue of the slave machine; And the host informs other slaves to discard the picture to be discarded according to the display time stamp of the picture to be discarded.
6. The method of any one of claims 1-5, wherein the frame buffer queue is 10-15 frames in length.
7. The method of claim 1, wherein when the master detects that each slave reports a same display timestamp, determining, according to the same display timestamp, a display time of a picture to be displayed corresponding to the same display timestamp, and broadcasting the display time to each slave, the method comprises: if the host detects that all the slaves report the same display time stamp, judging whether the picture to be displayed corresponding to the same display time stamp is the first picture to be displayed or not; If so, the host determines the display time of the picture to be displayed corresponding to the same display time stamp according to the current time and a preset delay threshold, and takes the display time of the first picture to be displayed as the initial display time; If not, determining the display time of the picture to be displayed corresponding to the same display time stamp according to the initial display time and the display time stamp of the picture to be displayed corresponding to the same display time stamp; and broadcasting a display command of the picture to be displayed corresponding to the same display time stamp to each slave by the master, wherein the display command comprises display time.
8. The method of claim 1, wherein the driving layer of each slave obtains the frames to be displayed corresponding to the same display timestamp from a frame buffer queue according to the display time, and sends the frames to a display for display, and further comprising: After the driving layer of each slave receives the display time of the picture to be displayed corresponding to the same display time stamp, judging whether the picture to be displayed corresponding to the same display time stamp can be displayed on time or not; if not, discarding the pictures to be displayed corresponding to the same display time stamp, and notifying other slaves to discard the pictures to be displayed corresponding to the same display time stamp through the host; And if all the slaves can display the pictures to be displayed corresponding to the same display time stamp on time, executing the step that the driving layer of each slave acquires the pictures to be displayed corresponding to the same display time stamp from a frame buffer queue according to the display time and sends the pictures to a display for display.
9. The method of claim 8, wherein the determining whether the frames to be displayed corresponding to the same display time stamp can be displayed on time after the driving layer of each slave machine receives the display time of the frames to be displayed corresponding to the same display time stamp, comprises: When the driving layer of the slave receives the display time of the pictures to be displayed corresponding to the same display time stamp, judging whether the display time of the pictures to be displayed corresponding to the same display time stamp exceeds the sum of the current time and a preset first time threshold value, if so, judging that the slave can display the pictures to be displayed corresponding to the same display time stamp on time, otherwise, judging that the slave cannot display the pictures to be displayed corresponding to the same display time stamp on time.
10. The method of claim 1, wherein after the driving layer of each slave adds the frame to be displayed to the frame buffer queue and reports the display time stamp of the frame to be displayed to the master, the method further comprises: the host caches the display time stamps reported by the slaves to a buffer; If the display time stamp which is not collected in the buffer area exceeds the preset number, determining the display time stamp to be discarded in the display time stamp which is not collected, and informing each slave to discard the picture to be displayed corresponding to the display time stamp to be discarded.
11. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1-10.

Description

Distributed video synchronous display control method and computer readable storage medium Technical Field The present invention relates to the field of video synchronous display technologies, and in particular, to a distributed video synchronous display control method and a computer readable storage medium. Background At present, the mainstream software/hardware video coding and decoding technology is limited, only 8K resolution video file coding and decoding and displaying are supported, and 16K and above resolution video file coding and decoding and displaying cannot be realized. And for the display requirement scene with the resolution ratio of more than 16K, the synchronous playing and splicing display of the distributed terminal is generally adopted. On the distributed display effect, each terminal picture can be spliced and displayed into a complete image with 16K or more at any time, and the video playing terminal displays 0 frame difference without dislocation. Two conditions are required for realizing the technical index: 1. The frequency and phase of the refresh of each end display must be identical, i.e. the line field signals are synchronized. The requirement can realize clock synchronization through a PTP protocol (IEEE 1588 protocol), the clock error of each terminal is within 1 microsecond, and then the precision microsecond synchronous refreshing of each terminal is realized through dynamically adjusting a phase-locked loop. 2. And controlling the video clips on each distributed video playing terminal to display the same frame of image clips at the same time. In the implementation manner, the display time is generally controlled in the application program according to the comparison between the display time PTS of the decoded video frame and the synchronized system clock, and the display picture is also required to be processed through an application layer, a system layer and a driving layer after the synchronization in the application program, so that the video frame can be possibly unsynchronized in the processing process of each link. Therefore, the scheme cannot ensure that the video frames of all terminals are displayed with a full 0-frame difference at any time. For example, decoding video slices of a certain terminal is complex, so that the overall load of the system is too high, the frame rate is reduced, and a display picture synchronized with other terminals cannot be output. Therefore, how to realize the synchronous play, splicing and display of the frame differences of the plurality of distributed play terminals 0 becomes a problem to be solved. The invention discloses a PTS-based distributed spliced large-screen video stream cluster synchronous display system, which comprises a multicast receiving module, a TS stream unpacking module, a video decoding module, a synchronous control module and a display module, wherein the multicast receiving module, the TS stream unpacking module and the video decoding module are independently operated in a main node machine and each sub node machine of the system, the multicast receiving module is used for receiving multicast data, the TS stream unpacking module unpacks video streams from composite signal streams and splices the video streams into one frame of video data to be input into the video decoding module, the video decoding module decodes the one frame of video data spliced by the video streams to obtain the time stamp of the video streams, the synchronous control module is used for controlling the sub node machines to synchronously operate with the main node machine, and the display module converts the format of the time stamp of the decoded video streams and sends the time stamp to a display screen to be displayed. However, multicast is implemented based on UDP, which has a packet loss risk, and it cannot be strictly guaranteed that all terminals receive the synchronization message. Disclosure of Invention The invention aims to solve the technical problem of providing a distributed video synchronous display control method and a computer readable storage medium, which can realize the synchronous play and display of the 0 frame difference of a distributed play terminal. In order to solve the technical problems, the technical scheme adopted by the invention is that the distributed video synchronous display control method comprises the following steps: the method comprises the steps that a driving layer of each slave adds a picture to be displayed into a frame buffer queue, and reports a display time stamp of the picture to be displayed to a master, wherein the display time stamp of the picture to be displayed is determined according to a video stream ID and a video frame display time stamp corresponding to the picture to be displayed; When the host detects that each slave machine reports the same display time stamp, determining the display time of a picture to be displayed corresponding to the same display time stamp according to the sam