CN-122003280-A - Reducing latency in networked games by reducing I-frame size

Abstract

Techniques are described for reducing latency in networked games by reducing (304) the I-frame size (which also results in automatically increasing the P-frame size) to reduce the total amount of video being transmitted (308). The reduced size of the I-frame is compensated for by increasing (306) the size of the other frames using a Low Pass Filter (LPF) (402), such as a gaussian filter that reduces the sharpness that the decoder can attempt to recover, or by using a lower resolution (502). The I frame may be reduced (602) by rotating the I frame or flipping/mirroring the I frame to produce a smaller encoded frame, sending a flag to signal orientation.

Inventors

• R. KRISHNAN
• E.H.Chen
• J.WANG
• D. Alia
• H-J.Li

Assignees

• 索尼互动娱乐股份有限公司

Dates

Publication Date

20260508

Application Date

20240910

Priority Date

20230929

Claims (20)

1. 1. An apparatus, comprising: At least one processor component configured to: identifying at least one condition of at least one network; Reducing the size of at least one I-frame of the video in response to the condition, and The I frame and at least one non-I frame are sent to a transmitter for transmission over the network.
2. 2. The apparatus of claim 1, wherein the video comprises a computer game video.
3. 3. The apparatus of claim 1, wherein the condition comprises a time delay.
4. 4. The apparatus of claim 1, wherein the condition comprises a bandwidth.
5. 5. The apparatus of claim 1, wherein the processor component is configured to reduce the size of the I frame at least in part by processing the I frame through a filter.
6. 6. The apparatus of claim 1, wherein the processor component is configured to reduce the size of the I frame at least in part by reducing a resolution of the I frame.
7. 7. The apparatus of claim 1, wherein the processor component is configured to reduce the size of the I frame at least in part by changing an orientation of the I frame.
8. 8. The apparatus of claim 7, wherein the processor component is configured to signal an orientation of the I-frame.
9. 9. The apparatus of claim 1, wherein the I frame is a first I frame and the processor component is configured to reduce a size of the first I frame in response to the condition and in response to the first I frame having a first importance and not to reduce a size of a second I frame in response to the condition and in response to the second I frame having a second importance.
10. 10. An apparatus, comprising: At least one computer medium that is not a transitory signal and that includes instructions executable by at least one processor component to: reducing a first portion of the video prior to encoding using at least a first filtering parameter; reducing a second portion of the video prior to encoding using at least a second filtering parameter not used to reduce the first portion, and The portion is transmitted over a network to at least one receiver.
11. 11. The apparatus of claim 10, wherein the instructions are executable to: the portion and signaling indicating the first filtering parameter and the second filtering parameter are sent over the network.
12. 12. The apparatus of claim 10, wherein the first portion and the second portion are key frames of the video.
13. 13. The apparatus of claim 10, wherein the first portion and the second portion are portions of one keyframe of the video.
14. 14. The apparatus of claim 10, wherein the first and second filter parameters comprise respective first and second filter types.
15. 15. The apparatus of claim 10, wherein the first and second filter parameters comprise respective first and second filter strengths.
16. 16. The apparatus of claim 10, wherein the video comprises at least one computer game.
17. 17. A method, comprising: Receiving at least a portion of at least a first keyframe of at least one video over a network; Receiving signaling over the network indicating a reconstruction applied to the portion of the key frame, and The portion of the key frame is reconstructed based on the signaling prior to rendering the portion of the key frame on a video display.
18. 18. The method of claim 17, wherein the reconstructing comprises magnifying the portion of the key frame.
19. 19. The method of claim 17, wherein the reconstructing comprises processing the portion of the keyframe using at least one sharpening filter.
20. 20. The method of claim 17, wherein the reconstructing comprises redirecting the portion of the key frame.

Description

Reducing latency in networked games by reducing I-frame size Technical Field The present application relates to a technically creative, non-conventional solution that has to be rooted in computer technology and that yields specific technical improvements, and more particularly to reducing delay in networked games by reducing the I-frame size. Background Video of computer analog video, such as computer game video, may be streamed over a network to an end user terminal. Disclosure of Invention As understood herein, network regulations imposed regarding network conditions and/or regulations for bandwidth limitations for energy savings may limit network channels that may be used to transmit video, such as computer game video. As further understood herein, delay is a major issue in such conditions, particularly in the case of computer game players, because game players prefer a near instantaneous response to their input, such as when shooting a game weapon. Thus, video quality may be less important than transmitting video with little or no delay. In a first aspect, an apparatus includes at least one processor component configured to identify at least one condition of at least one network. The processor component is configured to reduce the size of at least one I frame of the video and optionally increase the size of at least one non-I frame of the video in response to the condition, and then send the I frame and the non-I frame to the transmitter for transmission over the network. The video may include computer game video. In an example, the condition may include delay and/or bandwidth. In some embodiments, the processor component may be configured to reduce the size of the I frame at least in part by processing the I frame through a filter. Additionally or alternatively, the processor component may be configured to reduce the size of the I-frame at least in part by reducing the resolution of the I-frame. Again, additionally or alternatively, the processor component may be configured to reduce the size of the I-frame at least in part by changing the orientation of the I-frame, and if desired, may signal the orientation of the I-frame. In a non-limiting embodiment, the I-frame may be a first I-frame and the processor component may be configured to reduce the size of the first I-frame in response to a network condition and in response to the first I-frame having a first importance and not reduce the size of the second I-frame in response to the network condition and in response to the second I-frame having a second importance. In another aspect, an apparatus includes at least one computer medium that is not an instantaneous signal and that in turn includes instructions executable by at least one processor component to reduce a first portion of video prior to encoding using at least a first filtering parameter. The instructions are executable to reduce a second portion of the video prior to encoding using at least a second filtering parameter that is not used to reduce the first portion, and send the portions to at least one receiver over a network. In this aspect, in an example, the instructions may be executable to transmit the portion via a network and signaling indicating the first filtering parameter and the second filtering parameter. The first and second portions of video may be key frames of video, such as I frames or Instantaneous Decoding Refresh (IDR) frames. Or the first and second portions may be portions of one key frame of the video. In an example embodiment, the first and second filter parameters may include respective first and second filter types, and/or respective first and second filter strengths. In another aspect, a method includes receiving at least a portion of at least a first keyframe of at least one video over a network. The method also includes receiving, over the network, signaling indicating a reconstruction applied to the portion of the key frame. The method includes reconstructing the portion of the key frame based on the signaling prior to rendering the portion of the key frame on the video display. In some examples, reconstructing includes magnifying the portion of the key frame, and/or processing the portion of the key frame using at least one sharpening filter, and/or redirecting the portion of the key frame. Details of the present disclosure, both as to its structure and operation, can best be understood in reference to the accompanying drawings, in which like reference numerals refer to like parts, and in which: Drawings FIG. 1 is a block diagram of an example system including examples consistent with the present principles; FIG. 2 illustrates an example encoder-decoder system; FIG. 3 illustrates example encoding logic in an example flow chart format; FIG. 4 illustrates, in an example flow diagram, an example filtering technique for reducing key frame size; FIG. 5 illustrates, in an example flow chart format, an example reduced resolution technique for reducing key frame size;