CN-121986481-A - Encoding/transmitting Y-channel only data in computer game video

Abstract

Techniques are described for delivering video, such as computer game video, over a network with minimal delay by converting (300) the video into Y-U-V video and then sending (302) only luminance data (Y channel) to the end user. Color tables and/or machine learning may be used to reconstruct (402) the colors on the receiver side.

Inventors

• M. Srivastava
• E.H.Chen
• M. Sarah
• MIZUKI HIDEYUKI

Assignees

• 索尼互动娱乐股份有限公司

Dates

Publication Date

20260505

Application Date

20240924

Priority Date

20231005

Claims (20)

1. 1. An apparatus, comprising: At least one of the processor components is configured to, the at least one processor component is configured to: encoding at least one video in YUV format; the Y-channel only information from the YUV format is sent over at least one computer network to at least one receiver to minimize latency.
2. 2. The apparatus of claim 1, wherein the video comprises a computer game video.
3. 3. The device of claim 1, wherein the processor component is configured to send at least one hint for color reconstruction with the Y-channel information.
4. 4. A device according to claim 3, wherein the cues comprise at least one RGB frame.
5. 5. The apparatus of claim 3, wherein the cue comprises at least one indication of a shadow in the video.
6. 6. The apparatus of claim 3, wherein the cue comprises at least one indication of depth in the video.
7. 7. The apparatus of claim 3, wherein the cue comprises at least one indication of a reflection in the video.
8. 8. A device according to claim 3, wherein the cues comprise at least one indication of the type of object surface in the video.
9. 9. The apparatus of claim 3, wherein the cue comprises at least one indication of object height in the video.
10. 10. The apparatus of claim 3, wherein the cue comprises at least one indication of a scene type in the video.
11. 11. The device of claim 3, wherein the processor component is configured to send the prompt in response to a scene change in the video.
12. 12. An apparatus, comprising: at least one computer medium that is not a transitory signal and that includes instructions executable by at least one processor component to: Receiving Y-channel data of at least one video from at least one transmitter instead of U-channel data or V-channel data of the video; Reconstructing the color of the video, and The video is presented in color on at least one display.
13. 13. The apparatus of claim 12, wherein the video comprises at least one computer game video.
14. 14. The apparatus of claim 12, wherein the instructions are executable to: the color of the video is reconstructed based at least in part on at least one cue received with the video.
15. 15. The apparatus of claim 14, wherein the hint comprises at least one RGB frame.
16. 16. The device of claim 14, wherein the prompt includes at least one of: An indication of shadows in the video; an indication of depth in the video; An indication of reflection in the video; An indication of an object surface type in the video; an indication of object height in the video.
17. 17. The apparatus of claim 14, wherein the cue comprises at least one indication of a scene type in the video.
18. 18. The apparatus of claim 12, wherein the instructions are executable to: inputting the Y-channel data into at least one machine learning ML model, and The color of the video is reconstructed based at least in part on output from the ML model.
19. 19. A method, comprising: transmitting Y-channel data of video encoded in YUV format to at least one receiver, but not transmitting U-channel data or V-channel data of the video to the receiver; Colorizing the Y-channel data at the receiver, and The video is presented in color.
20. 20. The method of claim 19, wherein the video comprises a computer game video.

Description

Encoding/transmitting Y-channel only data in computer game video Technical Field The present application relates to a technically innovative unconventional solution that must be rooted in computer technology and that yields specific technical improvements, and more particularly to encoding/transmitting only Y-channel data in computer game video. Background Video, such as computer analog video, computer game video, etc., may be streamed over a network to an end user terminal. Disclosure of Invention As understood herein, network conditions and/or network regulations that limit bandwidth for energy conservation by regulatory authorities may limit the network channels available for transmitting video (such as computer game video). As further understood herein, delay is a major problem in such situations, particularly for computer game players, because game players prefer to react nearly instantaneously to their inputs, such as when shooting a game weapon. Thus, video quality may be less alarming than delivering video with little or no delay. Accordingly, an apparatus includes at least one processor component configured to encode at least one video in a YUV format and transmit Y-channel-only information from the UV format over at least one computer network to at least one receiver to minimize latency. The video may be, for example, a computer game video. In some examples, the processor component may be configured to send at least one hint indicating a color along with the Y-channel information. For example, the cues may be one or more of at least one RGB frame, an indication of a shadow in the video, an indication of a depth in the video, an indication of a reflection in the video, an indication of a surface type of an object in the video, an indication of a height of an object in the video, an indication of a scene type in the video. If desired, the processor component may be configured to send the prompt in response to a scene change in the video. In another aspect, an apparatus includes at least one computer medium that is not a transient signal and that further includes instructions executable by at least one processor component to receive Y-channel data of at least one video from at least one transmitter instead of U-channel data or V-channel data of the video. The instructions are executable to reconstruct a color of the video and present the video in the color on at least one display. In another aspect, a method includes transmitting Y-channel data of video encoded in YUV format to at least one receiver, but not transmitting U-channel data or V-channel data of the video to the receiver. The method also includes colorizing the Y-channel data at the receiver and rendering the video with color. Details of the present disclosure, both as to its structure and operation, can best be understood in reference to the accompanying drawings, in which like reference numerals refer to like parts, and in which: Drawings FIG. 1 is a block diagram of an exemplary system including examples consistent with the principles of the invention; FIG. 2 illustrates an example encoder-decoder system; FIG. 3 illustrates example transmitter logic in an example flow chart format; FIG. 4 illustrates example receiver logic in an example flow chart format; FIG. 5 illustrates additional example transmitter logic in an example flow chart format; FIG. 6 illustrates yet another example transmitter logic in an example flow chart format; FIG. 7 illustrates additional example receiver logic in an example flow chart format; FIG. 8 illustrates yet further example receiver logic in an example flow chart format, and FIG. 9 illustrates example Machine Learning (ML) model training logic in an example flow chart format. Detailed Description The present disclosure relates generally to computer ecosystems that include aspects of a network of Consumer Electronic (CE) devices, such as, but not limited to, a computer gaming network. The systems herein may include a server component and a client component that may be connected by a network such that data may be exchanged between the client component and the server component. The client component may include one or more computing devices including a game console (such as Sony PlayStation or a game console made by Microsoft (Microsoft) or Nintendo (Nintendo) or other manufacturer), an extended reality (XR) headset (such as a Virtual Reality (VR) headset, an Augmented Reality (AR) headset), a portable television (e.g., a smart TV, an internet enabled TV), a portable computer (such as a laptop computer and tablet computer), and other mobile devices (including smartphones and additional examples discussed below). These client devices may operate in a variety of operating environments. For example, some client computers may employ, for example, a Linux operating system, an operating system from microsoft, or a Unix operating system, or an operating system produced by Apple, inc (Apple) or Google (Google) or berke