US-12621510-B2 - Platform system and method for transmitting video in real time with ultra-low latency

US12621510B2US 12621510 B2US12621510 B2US 12621510B2US-12621510-B2

Abstract

Provided is a platform system for transmitting a video in real time with ultra-low latency, the platform system including: a caster unit configured to encode and transmit a video signal provided from one or a plurality of video sources through a network communication network; a platform server configured to provide the video signal transmitted from the caster unit in a streaming manner; and a user terminal configured to be provided with the video signal from the platform server in a streaming manner. The platform system and method for transmitting a video in real time with ultra-low latency according to the present disclosure has the advantage that it is possible to provide an ultra-low latency service anytime anywhere as long as the internet is connected by enabling real-time transmission of an end-to-end video signal.

Inventors

Sang Hoon Lee
Hack Kyung KIM
Soo Hyun Park

Assignees

QUOPIN CO., LTD.

Dates

Publication Date: 20260505
Application Date: 20231127
Priority Date: 20210528

Claims (15)

1 . A platform system for transmitting a video in real time with ultra-low latency, the platform system comprising: a video source configured to receive a video signal; an encoder configured to compress the video signal provided from the video source; and a caster configured to stream the video signal encoded by the encoder through a communication network to a platform server or a user terminal or configured to transmit the encoded video signal to a storage server; the platform server configured to provide the encoded video signal transmitted from the caster in a streaming manner; and the user terminal configured to be provided with the encoded video signal from the platform server in a streaming manner, wherein the user terminal decodes the encoded video signal to provide a decoded video signal; wherein the encoder is linked with the user terminal, and adjusts encoding parameter values with reference to feedback information about a reception state of the decoded video signal received from the user terminal in real time and encodes a next video signal from the video source, wherein the feedback information includes at least network communication network state information, an available bandwidth of data, a data loss rate, a video quality, and whether there is disconnection, and wherein the parameter values include a compression quantum value, a bitrate, a size of a sub-frame to be encoded, a frame per second (fps), multicast, and a value of a group of pictures (GoP).
2 . The platform system of claim 1 , wherein even though the video signal that is input from the video source is not a full frame, but a partial frame (sub-frame) of sub-slice type, the encoder encodes and transmits the video signal to the caster without waiting the other frames.
3 . The platform system of claim 1 , wherein the encoder is provided for each video source to independently perform an encoding function.
4 . The platform system of claim 1 , wherein in order that many users can see the video signal of a same encoder, the platform system copies the encoded video signal from the caster or the platform server and transmits the encoded video signal to many user terminals.
5 . The platform system of claim 1 , wherein the caster transmits the encoded video signal encoded by the encoder in a Peer-to-Peer (P2P) manner when directly transmitting the encoded video signal to the user terminal through the communication network in accordance with a service policy about a user account, transmits the encoded video signal in a relay stream manner when transmitting the encoded video signal to the platform server, and transmits the encoded video signal while selecting any one of the two manners as a path.
6 . The platform system of claim 5 , wherein when selecting the transmission paths, the platform system primarily attempts the P2P transmission manner for a stream request from the user terminal accessing the video source and secondarily performs relay stream transmission through the platform server when P2P transmission is not smooth.
7 . The platform system of claim 1 , wherein the caster performs a charging function for a user account in linkage with the user terminal and receives information for charging a user from the platform server.
8 . The platform system of claim 7 , wherein an operating system for charging the user includes a manager account, an operator account, and a user account, a manager has a right to be able to manage the entire platform system and register, delete, and release an operator, the caster, the encoder, and the user on and from the platform system, the operation has a right to register the caster, the encoder, and the user account and connect the user account to the encoder, and the user can see only the video source of the encoder connected by the operator.
9 . The platform system of claim 1 , wherein the platform server functions as a streaming device connecting transmission and reception of the video signal between the caster and the user terminal, performs a function of managing and accessing the user account, and performs a multimedia transcoding function.
10 . The platform system of claim 1 , wherein the platform server ( 200 ) serves to relay-stream the encoded video signal transmitted from the caster to the user terminal or informs the encoder or the caster of a network address (IP address) of the user terminal so that the encoded video signal is directly transmitted to the user terminal even not via itself.
11 . The platform system of claim 1 , wherein the platform server includes: an admin server configured to manage the caster, an operator account, the encoder, and a user account, receive a setting report about the caster and encoder and the accounts from a Caster Login Server (CLS), store the setting report in a database, and retrieve and transmit the stored setting information from the database to the CLS; the CLS configured to receive a report on information about video signal setting and state from the caster, report the information to the admin server, request and receive setting information about authentication information for the user terminal from a hole-punching relay server, and transmit the setting information to the caster; the hole-punching relay server configured to transmit the video signal transmitted from the caster to the user terminal, and for this purpose, request and check viewer authentication information from the database; and the database configured to store and output data transmitted from the admin server and request and check the viewer authentication information from the hole-punching relay server.
12 . A method for transmitting a video in real time with ultra-low latency, the method comprising: receiving a video signal input from one or a plurality of video sources; sensing and encoding the input video signal by means of an encoder; transmitting the encoded video signal to a caster; selecting a transmission path for the encoded video signal; and transmitting the encoded video signal to a user terminal through the selected transmission path, wherein the transmitting of the encoded video signal to the caster includes adjusting encoding parameter values with reference to feedback information about a reception state of a video signal received from the user terminal in real time and then encoding and transmitting a next video signal by means of the encoder linked with the user terminal; and the selecting of a transmission path for the encoded video signal includes transmitting the video signal in a Peer-to-Peer (P2P) manner when directly transmitting the video signal to the user terminal through a network communication network in accordance with a service policy about a user account, transmitting the video signal in a video signal stream relay manner when transmitting the video signal to a platform server, and transmitting the video signal while selecting any one of the two manners as a path, wherein the feedback information includes at least network communication network state information, an available bandwidth of data, a data loss rate, a video quality, and whether there is disconnection, and wherein the parameter values include a compression quantum value, a bitrate, a size of a sub-frame to be encoded, a frame per second (fps), multicast, and a value of a group of pictures (GoP).
13 . The method of claim 12 , wherein the transmitting of the encoded video signal to the caster further includes encoding and transmitting the video signal to the caster without waiting the other frames even though the video signal provided from the video source is not a full frame, but a partial frame (sub-frame) of sub-slice type.
14 . The method of claim 12 , further comprising charging a user account or an operator account for a video service by means of the caster in linkage with the platform server.
15 . The method of claim 12 , further comprising storing the video signal encoded by the encoder in a storage server or the platform server by the caster.

Description

TECHNICAL FIELD The present disclosure relates to a platform system and method for transmitting an end-to-end video in real time under the environment of a wired/wireless internet network. In more detail, the present disclosure relates to a platform system and method for transmitting a video, that platform system and method being able to provide an ultra-low latency service anytime anywhere as long as the internet is connected by transmitting a video in real time through mobile or wired internet network communication. BACKGROUND ART With the full-fledged advent of the era of 5th generation (5G) mobile communication service that is the centerpiece of 4th industrial revolution, the 5G mobile communication is being applied to almost all fields including Virtual Reality (VR), Autonomous driving (AD), and Internet of Things (IoT). 5G that enables 4th industrial revolution is a mobile communication technology, which uses UHF of 28 GHz and shows a maximum download speed of up to 20 Gbs, has ‘ultra-high speed’, ‘hyper-connectivity’, and ‘ultra-low latency’ as principal characteristics. ‘Hyper-connectivity’ means that as the information communication technology makes a deep inroad into everyday life, all things are closely connected with human life like a spider's web and ‘ultra-low latency’ means that the end-to-end video transmission time is a level under several tens of microseconds in machine type communication. However, whether ‘ultra-low latency’ that is one of the principal characteristics of 5G mobile communication is implemented depends on the network configuration for maintaining the end-to-end video transmission time of machine type communication almost at real time (RT). However, video transmission platforms (or systems) of the related art serve only to simply relay end-to-end video transmission through buffering, so they have a problem that delay frequency occurs and accordingly videos are not transmitted/received in real time. DISCLOSURE Technical Problem Accordingly, the present disclosure has been made in an effort to solve the problems of such video transmission platforms (or systems) of the related art and an objective of the present disclosure is to prevent disconnection due to delay and enable videos to be transmitted/received in real time by enabling end-to-end videos to be transmitted with ultra-low latency. However, objectives of the present disclosure are not limited to those described above and other objectives not stated would be clearly understood from the following description by those skilled in the art. Technical Solution A platform system for transmitting a video in real time with ultra-low latency according to an embodiment of the present disclosure includes: a caster unit (100) configured to encode and transmits a video signal provided from one or a plurality of video sources (110) through a communication network; a platform server (200) configured to provide the video signal transmitted from the caster unit (100) in a streaming manner; and a user terminal (300) configured to be provided with the video signal from the platform server (200) in a streaming manner, The caster unit includes: one or a plurality of video sources (110) such as a camera, a computer, a set-top box, a PC, etc.; an encoder (120) configured to encode the video signal provided from the video source (110); and a caster (130) configured to transmit the video signal encoded by the encoder (120) to the platform server (200) through a network communication network or transmit the video signal directly to the user terminal (300). In this case, the even though the video signal is input as not a full frame, but a partial frame (sub-frame) of sub-slice type, the encoder (120) may immediately encode and transmit the video signal to the caster (130). Further, the encoder (120) is equipped with a high-speed encoder having real-time encoding performance, is linked with the user terminal (300), and is enabled to encode and transmit a next video signal with reference to feedback information about a reception state of a video signal received from the user terminal in real time, thereby being able to reduce end-to-end delay. In this configuration, the feedback information may include at least any one of network communication network state information, an available bandwidth of data, a data loss rate, a video quality, and whether there is disconnection. Further, the encoder (120) may be provided for each video source (110) to independently perform an encoding function. Meanwhile, the platform server (200) may function as a streaming device relaying a video signal between the encoder (120) and the user terminal (300) and connecting transmission and reception of between the caster (130) and the user terminal (300), may perform a function of managing an encoder (120) accessed through the caster (130), and may perform a multimedia transcoding function too. The platform server 200 calculates a charge on a user account (30) in linkage w