Search

US-12621538-B2 - Content transmission system and method

US12621538B2US 12621538 B2US12621538 B2US 12621538B2US-12621538-B2

Abstract

A content encoding system for generating content to be output to a client device, the system comprising a content obtaining unit operable to obtain video content for display at the client device, an asset determining unit operable to determine one or more assets to be associated with the display of the video content at the client device, an asset package identifying unit operable to identify one or more asset packages comprising respective ones of the determined assets, and determining one or more asset package identifiers associated with those packages, and an encoding unit operable to generate an encoded stream comprising the video content and the one or more asset package identifiers.

Inventors

  • Andrew William Walker
  • Richard DOWNEY

Assignees

  • SONY INTERACTIVE ENTERTAINMENT INC.

Dates

Publication Date
20260505
Application Date
20220912
Priority Date
20210915

Claims (10)

  1. 1 . A content encoding system for generating content to be output to a client device, the system comprising: a content obtaining unit operable to obtain video content for display at the client device; an asset determining unit operable to determine a first set of assets to be associated with the display of the video content at the client device; an asset package identifying unit operable to identify a first asset package comprising the first set of assets, and determining a first set of asset package identifiers associated with the first asset package; and an encoding unit operable to generate a first encoded stream comprising the video content and the first set of asset package identifiers, wherein, when new assets are generated for the video content, the asset determining unit is further operable to determine a second set of assets to be associated with the display of the video content at the client device, the second set of assets including the new assets, the asset package identifying unit is further operable to identify a second asset package comprising the second set of assets and determining a second set of asset package identifiers associated with the second asset packages, and the encoding unit is further operable to generate a second encoded stream comprising the video content and the second set of asset package identifiers.
  2. 2 . The system of claim 1 , comprising an asset package generating unit that is operable to generate at least one of the first and second packages.
  3. 3 . The system of claim 1 , wherein the assets comprise at least one of images, videos, fonts, content filters, voice, and audio segments.
  4. 4 . The system of claim 1 , wherein the encoding unit is operable to encode information regarding the reproduction of the first and second assets at the client device.
  5. 5 . The system of claim 4 , wherein the information comprises at least one of an asset identifier, transform information, position, pan, and duration.
  6. 6 . The system of claim 1 , wherein the video content comprises at least one of gameplay video and video of a player of a video game.
  7. 7 . The system of claim 1 , wherein the asset package identifiers comprise information to enable the client device to obtain a corresponding asset package.
  8. 8 . The system of claim 1 , wherein the encoding unit is operable to encode the first and second asset packages in the encoded stream.
  9. 9 . The system of claim 8 , wherein the encoding unit is configured to arrange the first and second asset packages so as to occur earlier in the stream than the video content.
  10. 10 . A content encoding method for generating content to be output to a client device, the method comprising: obtaining video content for display at the client device; determining a first set of assets to be associated with the display of the video content at the client device; identifying a first asset package comprising the first set of assets, determining a first set of asset package identifiers associated with the first asset package; and generating a first encoded stream comprising the video content and the first set of asset package identifiers, wherein, when new assets are generated for the video content, the method further comprising determining a second set of assets to be associated with the display of the video content at the client device, the second set of assets including the new assets identifying a second asset package comprising the second set of assets, determining a second set of asset package identifiers associated with the second asset packages, and generating a second encoded stream comprising the video content and the second set of asset package identifiers.

Description

BACKGROUND OF THE INVENTION Field of the Invention This disclosure relates to a content transmission system and method. Description of the Prior Art The “background” description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present invention. With increasing accessibility of high-speed and (at least substantially) unlimited internet access for users, there has been an increase both the supply of and demand for internet-based entertainment content. One example of such content is that of streamed gameplay of a user, or a number of users, such as in a casual or esports environment. Such content may comprise a number of different content elements relating to the gameplay (including video and audio assets), a view of the user (or another person, such as a commentator) and associated audio, and one or more additional elements such as branding and chat functions. With this large number of content elements, and a demand for high-quality content (such as high-resolution and/or high frame rate imagery), the provision of such content can lead to large bandwidth requirements that are not able to be supported by a significant number of users during transmission of the content to those users. In view of this, it is considered desirable for the size of the transmitted content to be reduced in size where possible. One solution to this problem that has been implemented in previous arrangements is that of applying a compression algorithm to the audio and/or video that is transmitted. This can enable generated content to be reduced in size sufficiently to enable streaming to users without requiring excessive bandwidth. In some cases, multiple streams may be generated to correspond to different bit rates to enable different stream qualities to be obtained by a user in dependence upon their internet capabilities. Similarly, video encoding formats that enable layers to be selectively obtained have been used such that an adaptive streaming method may be provided. However, such compression can lead to the introduction of artefacts or other undesirable display properties; these can stem from lossy compression, or simply over compression. It is in the context of the above discussion that the present disclosure arises. SUMMARY OF THE INVENTION This disclosure is defined by claim 1. Further respective aspects and features of the disclosure are defined in the appended claims. It is to be understood that both the foregoing general description of the invention and the following detailed description are exemplary, but are not restrictive, of the invention. BRIEF DESCRIPTION OF THE DRAWINGS A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein: FIG. 1 schematically illustrates a content distribution system; FIG. 2 schematically illustrates an image from distributed content; FIG. 3 schematically illustrates a content encoding method; FIG. 4 schematically illustrates an image rendering and display method; FIG. 5 schematically illustrates a number of exemplary data formats; FIG. 6 schematically illustrates a content encoding system; FIG. 7 schematically illustrates a content decoding system; FIG. 8 schematically illustrates a content encoding method; and FIG. 9 schematically illustrates a content decoding method. DESCRIPTION OF THE EMBODIMENTS Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views, embodiments of the present disclosure are described. FIG. 1 schematically illustrates a content distribution system which is operable to distribute content generated by the user of a first device to a user of a second device via a network connection. The source device 100 is a device used by a user to generate content for distribution to one or more client devices, such as the display device 120 (of which only one is shown in the Figure, but of course multiple client devices may be configured to receive the content). In some cases the content generation takes place at the source device 100, while in other embodiments at least some of the content generation takes place at a server 110 with the user being able to control that generation via inputs at the source device 100. The devices 100 and 120 may be any combination of games consoles, computers, mobile devices, or any other type of processing device. These devices may be equipped with any suitable input devices or interfaces; examples include touch screens and games controllers. The devices