Search

EP-4740457-A1 - CROSS COMPONENT RESIDUAL PREDICTION

EP4740457A1EP 4740457 A1EP4740457 A1EP 4740457A1EP-4740457-A1

Abstract

Systems, devices, and methods are described herein for cross component residual prediction. An example method may include estimating a relationship between residual of a first chrominance component of a block and residual of a second chrominance component of the block based on a prediction of the first chrominance component and a prediction of the second chrominance component. The method may include predicting the residual of the first chrominance component based on the estimated relationship and the residual of the second chrominance component. The method may include decoding the block based on the predicted residual of the first chrominance component.

Inventors

  • GALPIN, FRANCK
  • BORDES, PHILIPPE
  • NASER, Karam
  • LO BIANCO, Federico

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260513
Application Date
20240701

Claims (20)

  1. CLAIMS What is Claimed: 1. A device for video decoding, the device comprising: a processor configured to: estimate a relationship between residual of a first chrominance component of a block and residual of a second chrominance component of the block based on a prediction of the first chrominance component and a prediction of the second chrominance component; predict the residual of the first chrominance component based on the estimated relationship and the residual of the second chrominance component; and decode the block based on the predicted residual of the first chrominance component.
  2. 2. The device of claim 1, wherein the block is a first block, the estimated relationship is a first estimated relationship, and the processor is further configured to: estimate a second relationship between residual of the first chrominance component of a second block and residual of a luminance component of the second block based on a prediction of the first chrominance component of the second block and a prediction of the luminance component of the second block; and predict the residual of the first chrominance component of the second block based on the second estimated relationship and the residual of the luminance component of the second block; and decode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block.
  3. 3. The device of claim 2, wherein the processor is further configured to predict residual of the second chrominance component of the second block based the residual of the first chrominance component of the second block and the residual of the luminance component of the second block, wherein the processor being configured to decode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to decode the second block based on the predicted residual of the first chrominance component of the second block and the predicted residual of the second chrominance component of the second block.
  4. 4. The device of claim 2, wherein the processor is further configured to compute residual of the predicted residual of the first chrominance component of the second block based on a difference between an original sample of the first chrominance component of the second block and a sum of the prediction of the first chrominance component of the second block and the predicted residual of the first chrominance component of the second block, wherein the processor being configured to decode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to decode the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component of the second block.
  5. 5. The device of any one of claims 1-4, wherein the processor is further configured to compute residual of the predicted residual of the first chrominance component based on a difference between an original sample of the first chrominance component and a sum of the prediction of the first chrominance component and the predicted residual of the first chrominance component, wherein the processor being configured to decode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to decode the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component.
  6. 6. The device of any one of claims 1-5, wherein the first chrominance component comprises a red- difference chrominance component, and wherein the second chrominance component comprises a blue-difference chrominance component.
  7. 7. The device of any one of claims 1-6, wherein the processor is further configured to send a flag to an encoder, wherein the flag indicates the predicted residual of the first chrominance component.
  8. 8. A method for video decoding, the method comprising: estimating a relationship between residual of a first chrominance component of a block and residual of a second chrominance component of the block based on a prediction of the first chrominance component and a prediction of the second chrominance component; predicting the residual of the first chrominance component based on the estimated relationship and the residual of the second chrominance component; and decoding the block based on the predicted residual of the first chrominance component.
  9. 9. The method of claim 8, wherein the block is a first block, the estimated relationship is a first estimated relationship, and the method further comprises: estimating a second relationship between residual of the first chrominance component of a second block and residual of a luminance component of the second block based on a prediction of the first chrominance component of the second block and a prediction of the luminance component of the second block; and predicting the residual of the first chrominance component of the second block based on the second estimated relationship and the residual of the luminance component of the second block; and decoding the second block based, at least in part, on the predicted residual of the first chrominance component of the second block.
  10. 10. The method of claim 9, wherein the method further comprises predicting residual of the second chrominance component of the second block based the residual of the first chrominance component of the second block and the residual of the luminance component of the second block, wherein decoding the second block is further based on the predicted residual of the second chrominance component of the second block.
  11. 11. The method of claim 9, wherein the method further comprises computing residual of the predicted residual of the first chrominance component of the second block based on a difference between an original sample of the first chrominance component of the second block and a sum of the prediction of the first chrominance component of the second block and the predicted residual of the first chrominance component of the second block, wherein decoding the second block is further based on the residual of the predicted residual of the first chrominance component of the second block.
  12. 12. The method of any one of claims 8-11, wherein the method further comprises computing residual of the predicted residual of the first chrominance component based on a difference between an original sample of the first chrominance component and a sum of the prediction of the first chrominance component and the predicted residual of the first chrominance component, wherein decoding the block is further based on the residual of the predicted residual of the first chrominance component.
  13. 13. The method of any one of claims 8-12, wherein the first chrominance component comprises a red- difference chrominance component, and wherein the second chrominance component comprises a blue-difference chrominance component.
  14. 14. The method of any one of claims 8-13, wherein the method further comprises sending a flag to an encoder, wherein the flag indicates the predicted residual of the first chrominance component.
  15. 15. A device for video encoding, the device comprising: a processor configured to: estimate a relationship between residual of a first chrominance component and residual of a second chrominance component based on a prediction of the first chrominance component and a prediction of the second chrominance component; predict the residual of the first chrominance component based on the estimated relationship and the residual of the second chrominance component; and encode a block based on the predicted residual of the first chrominance component.
  16. 16. The device of claim 15, wherein the block is a first block, the estimated relationship is a first estimated relationship, and the processor is further configured to: estimate a second relationship between residual of the first chrominance component of a second block and residual of a luminance component of the second block based on a prediction of the first chrominance component of the second block and a prediction of the luminance component of the second block; and predict the residual of the first chrominance component of the second block based on the second estimated relationship and the residual of the luminance component of the second block; and encode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block.
  17. 17. The device of claim 16, wherein the processor is further configured to predict residual of the second chrominance component of the second block based the residual of the first chrominance component of the second block and the residual of the luminance component of the second block, wherein the processor being configured to encode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to encode the second block based on the predicted residual of the first chrominance component of the second block and the predicted residual of the second chrominance component of the second block.
  18. 18. The device of claim 16, wherein the processor is further configured to compute residual of the predicted residual of the first chrominance component of the second block based on a difference between an original sample of the first chrominance component of the second block and a sum of the prediction of the first chrominance component of the second block and the predicted residual of the first chrominance component of the second block, wherein the processor being configured to encode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to encode the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component of the second block.
  19. 19. The device of any one of claims 15-18, wherein the processor is further configured to compute residual of the predicted residual of the first chrominance component based on a difference between an original sample of the first chrominance component and a sum of the prediction of the first chrominance component and the predicted residual of the first chrominance component, wherein the processor being configured to encode the second block based, at least in part, on the predicted residual of the first chrominance component of the second block comprises the processor being configured to encode the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component.
  20. 20. The device of any one of claims 15-19, wherein the first chrominance component comprises a red- difference chrominance component, and wherein the second chrominance component comprises a blue-difference chrominance component.

Description

CROSS COMPONENT RESIDUAL PREDICTION CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims the benefit of European Provisional Patent Application No. EP23306151.4, filed July 7, 2023, the contents of which are hereby incorporated by reference herein. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. SUMMARY [0003] Systems, devices, and methods are described herein for cross component residual prediction. An example device (e.g., for video decoding (or video encoding)) may estimate a relationship between residual of a first chrominance component of a block and residual of a second chrominance component of the block based on a prediction of the first chrominance component and a prediction of the second chrominance component. The device may predict the residual of the first chrominance component based on the estimated relationship and the residual of the second chrominance component. The device may decode (or encode) the block based on the predicted residual of the first chrominance component. [0004] The block may be a first block. The estimated relationship may be a first estimated relationship. The device may estimate a second relationship between residual of the first chrominance component of a second block and residual of a luminance component of the second block based on a prediction of the first chrominance component of the second block and a prediction of the luminance component of the second block. The device may predict the residual of the first chrominance component of the second block based on the second estimated relationship and the residual of the luminance component of the second block. The device may decode (or encode) the second block based, at least in part, on the predicted residual of the first chrominance component of the second block. [0005] The device may predict residual of the second chrominance component of the second block based the residual of the first chrominance component of the second block and the residual of the luminance component of the second block. The device may decode (or encode) the second block based on the predicted residual of the first chrominance component of the second block and the predicted residual of the second chrominance component of the second block. [0006] The device may compute residual of the predicted residual of the first chrominance component of the second block based on a difference between an original sample of the first chrominance component of the second block and a sum of the prediction of the first chrominance component of the second block and the predicted residual of the first chrominance component of the second block. The device may decode (or encode) the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component of the second block. [0007] The device may compute residual of the predicted residual of the first chrominance component based on a difference between an original sample of the first chrominance component and a sum of the prediction of the first chrominance component and the predicted residual of the first chrominance component. The device may decode (or encode) the second block based on the predicted residual of the first chrominance component of the second block and the residual of the predicted residual of the first chrominance component. [0008] The first chrominance component may be a red-difference chrominance component. The second chrominance component may be a blue-difference chrominance component. The device may send a flag to an encoder (or decoder). The flag may indicate the predicted residual of the first chrominance component. An example method may involve performing one or more of the actions described above. BRIEF DESCRIPTION OF THE DRAWINGS [0009] FIG.1A is a system diagram illustrating an example communications system in which one or more disclosed embodiments may be implemented. [0010] FIG.1B is a system diagram illustrating an example wireless transmit/receive unit (WTRU) that may be used within the communications system illustrated in FIG.1A according to an embodiment. [0011] FIG.1C is a system diagram illustrating an example radio access network (RAN) and an example core network (CN) that may be used within the communications system illustrated in FIG.1A according to an embodiment. [0012] FIG.1D is a system diagram illustrating a further example RAN and a further example CN that may be used within the communications system illustrated in FIG.1A according to an embodiment. [0013] FIG.2 is a diagram showing an example block-based video encoder. [0014] FIG.3 is a diagram showing an example video decoder. [0015] FIG.4 is a diagram showing an example of a system i