Search

JP-7856624-B2 - System and method for RGB video coding enhancement

JP7856624B2JP 7856624 B2JP7856624 B2JP 7856624B2JP-7856624-B2

Inventors

  • シウ シアオユー
  • ホー ユーウェン
  • ツァイ チャ－ミン
  • イエン イエ

Assignees

  • インターデイジタル ヴィーシー ホールディングス インコーポレイテッド

Dates

Publication Date
20260511
Application Date
20231222
Priority Date
20140314

Claims (13)

  1. A method of video encoding content, The steps include obtaining the residuals of coding blocks among multiple coding blocks of different sizes in an image sequence, A step of determining whether to apply a color space conversion to the residual of the coding block based on a rate distortion cost comparison, Based on the decision that the color space conversion is applied to the coding block, the steps include: applying the color space conversion to the coding block; The step of including in the bitstream an encoding unit adaptive color space conversion indication configured to indicate whether a color space conversion is applied to the encoding block among the plurality of encoding blocks , A step of determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks, wherein the step of including a coding unit adaptive color space conversion indication for the coding block among the plurality of coding blocks in the bitstream is based on determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks. How to prepare even more .
  2. The method of claim 1, comprising the step of determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks, wherein the step of determining whether there is at least one non-zero coefficient among the lumar residual coefficients.
  3. The method of claim 1, wherein the step of determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks is to determine whether there is at least one non-zero coefficient among the chroma residual coefficients.
  4. A step of deciding to enable adaptive color space conversion for the sequence of images, The method of claim 1, further comprising the step of including an adaptive color space conversion enablement indication in a sequence parameter set associated with the sequence of images, indicating that an adaptive color space conversion is permitted to be used for the sequence of images.
  5. The method of claim 1, further comprising the step of determining whether to enable adaptive color space conversion for the sequence of images, wherein the step of determining whether to apply the color space conversion to the residuals of the coding blocks is based on the step of determining whether to enable adaptive color space conversion for the sequence of images.
  6. A step of calculating the rate distortion cost associated with performing residual coding in the GBR color space, The method of claim 1, further comprising the step of calculating the rate distortion cost associated with performing residual coding in the YCgCo color space, wherein the decision to apply the color space conversion to the coding block among the plurality of coding blocks is based on a rate distortion cost associated with performing residual coding in the YCgCo color space that is lower than the rate distortion cost associated with performing residual coding in the GBR color space.
  7. In an image sequence, the residuals of the coded blocks are obtained from multiple coded blocks of different sizes. Based on the rate distortion cost comparison, it is determined whether to apply a color space conversion to the residual of the coding block. Based on the decision that the color space conversion is applied to the coding block, the color space conversion is applied to the coding block. A processor is configured to include in the bitstream an encoding unit adaptive color space conversion indication that indicates whether a color space conversion is applied to one of the plurality of encoding blocks , The aforementioned processor, The system is further configured to determine whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks, and including coding unit adaptive color space conversion indications for the coding block among the plurality of coding blocks in the bitstream is based on determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the coding block among the plurality of coding blocks. Video encoding device.
  8. The video encoding apparatus of claim 7, wherein determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the encoding block among the plurality of encoding blocks is equivalent to determining whether there is at least one non-zero coefficient among the lumar residual coefficients.
  9. The video encoding apparatus of claim 7, wherein determining whether there is at least one non-zero residual coefficient among the residual coefficients associated with the encoding block among the plurality of encoding blocks is equivalent to determining whether there is at least one non-zero coefficient among the chroma residual coefficients.
  10. The aforementioned processor, It was decided to enable adaptive color space conversion for the aforementioned sequence of images, The video encoding apparatus of claim 7, further configured to include an adaptive color space conversion enablement indication in the sequence parameter set associated with the sequence of images, indicating that adaptive color space conversion is permitted to be used for the sequence of images.
  11. The aforementioned processor, The video encoding apparatus of claim 7, further configured to determine whether to enable adaptive color space conversion for the sequence of images, wherein determining whether to apply color space conversion to the residuals of the encoding block is based on determining whether to enable adaptive color space conversion for the sequence of images.
  12. The aforementioned processor, We calculate the rate distortion cost associated with performing residual coding in the GBR color space. The video encoding apparatus of claim 7, further configured such that the rate distortion cost associated with performing residual coding in the YCgCo color space is calculated and the determination that the color space conversion is applied to the coding block among the plurality of coding blocks is based on a rate distortion cost associated with performing residual coding in the YCgCo color space that is lower than the rate distortion cost associated with performing residual coding in the GBR color space.
  13. A computer-readable medium that includes instructions causing a processor to perform any of the methods of claims 1 to 6 .

Description

This invention relates to a system and method for RGB video coding enhancement. This application claims priority under U.S. Provisional Patent Application No. 61/953185, filed March 14, 2014, U.S. Provisional Patent Application No. 61/994071, filed May 15, 2014, and U.S. Provisional Patent Application No. 62/040317, filed August 21, 2014, each entitled “RGB VIDEO CODING ENHANCEMENT,” and each of these is incorporated herein by reference in whole. Screen content sharing applications have become more popular due to improvements in device and network capabilities. Popular examples of screen content sharing applications include remote desktop applications, video conferencing applications, and mobile media presentation applications. Screen content can include numerous video and/or image elements with one or more primary colors and/or sharp edges. Such image and video elements may contain relatively sharp curves and/or text within them. This is a block diagram illustrating an exemplary screen content sharing system according to an embodiment.This block shows an exemplary video encoding system according to an embodiment.An exemplary video decoding system according to an embodiment is shown in the block diagram.This figure shows an exemplary prediction unit mode according to an embodiment.This figure shows an exemplary color image according to the embodiment.This figure shows an exemplary method for carrying out the disclosed embodiments of the present invention.This figure shows another exemplary method for carrying out the disclosed embodiments of the present invention.This block shows an exemplary video encoding system according to an embodiment.An exemplary video decoding system according to an embodiment is shown in the block diagram.This is a block diagram illustrating an exemplary subdivision of a prediction unit into a conversion unit according to an embodiment.This is a system diagram of an exemplary communication system that can implement the present invention.Figure 11A is a system diagram of an exemplary wireless transceiver unit (WTRU) that can be used in the communication system shown.Figure 11A is a system diagram of an exemplary wireless access network and an exemplary core network that can be used within the communication system shown.Figure 11A is a system diagram of another exemplary radio access network and an exemplary core network that can be used within the communication system shown.Figure 11A is a system diagram of another exemplary radio access network and an exemplary core network that can be used within the communication system shown. The following provides detailed explanations with reference to various diagrams illustrating the relevant examples. While this explanation provides detailed examples of possible implementations, please note that the details are intended solely illustrative and are not intended to limit the scope of this application. Screen content compression methods are becoming increasingly important as more people share device content for use, for example, in media presentation and remote desktop applications. The display capabilities of mobile devices have increased to high-definition or ultra-high-definition resolutions in some embodiments. Video coding tools, such as block coding modes and conversions, may not be optimized for higher-definition screen content coding. Such tools can increase the bandwidth available for transmitting screen content in content sharing applications. Figure 1 shows a block diagram of an exemplary screen content sharing system 191. The system 191 may include a receiver 192, a decoder 194, and a display 198 (sometimes called a “renderer”). The receiver 192 can provide an input bitstream 193 to the decoder 194, which can decode the bitstream to produce a decoded picture 195, which can then be provided to one or more display picture buffers 196. The display picture buffers 196 can then provide the decoded picture 197 to the display 198 for presentation on the device’s display. Figure 2 shows a block diagram of a block-based single-layer video encoder 200, which can be implemented, for example, to provide a bitstream to the receiver 192 of the system 191 in Figure 1. As shown in Figure 2, the encoder 200 predicts the input video signal 201 using techniques such as spatial prediction (sometimes called “intra prediction”) and temporal prediction (sometimes called “inter prediction”), in an effort to improve compression efficiency. The encoder 200 may include other encoder control logic 240 that can determine mode determination and/or the form of prediction. Such determination may be at least partially based on criteria such as rate-based criteria, distortion-based criteria, and/or a combination thereof. The encoder 200 may provide one or more prediction blocks 206 to an element 204, which may generate a prediction residual 205 (which may be a difference signal between the input signal and the prediction signal) and provide it to a conversion eleme