EP-4736410-A1 - BI-PREDICTION INTRA BLOCK COPY WITH LOCAL ILLUMINATION COMPENSATION

EP4736410A1EP 4736410 A1EP4736410 A1EP 4736410A1EP-4736410-A1

Abstract

Video coding may be performed using intra block copy (IBC) bi-prediction with bi-predictive local Illumination compensation (LIC). A bi-predictive LIC model may be derived for a CU coded in IBC mode. A bi-predictive LIC mode may be derived/signaled at CU-level, based on whether the CU is in BVP-merge mode or bi-predictive IBC merge mode. A bi-predictive LIC IBC mode may be controlled with high-level control(s). A decoder may determine a current block is coded using IBC mode; obtain first and second LIC parameters based on first and second block vectors associated with the current block; and decode the current block based on the first and second LIC parameters. An encoder may code the current block using IBC mode; obtain first and second LIC parameters based on first and second block vectors associated with the current block; and encode the current block based on the first and second LIC parameters.

Inventors

LE LEANNEC, FABRICE
CHEN, Ya
NASER, Karam
POIRIER, Tangi

Assignees

InterDigital CE Patent Holdings, SAS

Dates

Publication Date: 20260506
Application Date: 20240606

Claims (1)

IDVC_ 2023P00519WO PATENT CLAIMS 1. A video decoding device, the device comprising: a processor configured to: determine that a current block is coded using block-vector-based prediction mode; determine that bi-predictive local illumination compensation (LIC) is enabled for the current block; obtain a first LIC parameter based on a first block vector associated with the current block and a second LIC parameter based on a second block vector associated with the current block; and decode the current block based on the first and second LIC parameters. 2. A video decoding method, the method comprising: determining that a current block is coded using block-vector-based prediction mode; determining that bi-predictive local illumination compensation (LIC) is enabled for the current block; obtaining a first LIC parameter based on a first block vector associated with the current block and a second LIC parameter based on a second block vector associated with the current block; and decoding the current block based on the first and second LIC parameters. 3. The video decoding device of claim 1 or the video decoding method of claim 2, wherein the processor of claim 1 is further configured to perform, or the method of claim 2 further comprises: obtaining a first template of a first reference block based on the first block vector, wherein the first LIC parameter is derived based on a template of the current block and the first template of the first reference block; and obtaining a second template of a second reference block based on the second block vector, wherein the second LIC parameter is derived based on the template of the current block and the second template of the second reference block. 4. The video decoding device of any one of claims 1 and 3 or the video decoding method of any one of claims 2 to 3, wherein the bi-predictive LIC being enabled for the current block is determined based on a bi-predictive LIC indication associated with the current block. IDVC_ 2023P00519WO PATENT 5. The video decoding device of any of claims 1 and 3 to 4 or the video decoding method of any of claims 2 to 4, wherein the template of the current block comprises at least one of a top template or a left template. 6. The video decoding device of any of claims 1 and 3 to 5 or the video decoding method of any of claims 2 to 5, wherein decoding the current block based on the first and second LIC parameter further comprises: obtaining a first prediction block based on the first block vector; refining the first prediction block based on the first LIC parameter; obtaining a second prediction block based on the second block vector; refining the second prediction block based on the second LIC parameter; and predicting the current block based on the first refined prediction block and the second refined prediction block. 7. The video decoding device of any of claims 1 and 3 to 6 or the video decoding method of any of claims 2 to 6, wherein the first LIC parameter comprises at least one of an LIC scaling factor or an LIC offset. 8. A video encoding device, the device comprising: a processor configured to: determine to code a current block using block-vector-based prediction mode; determine to enable bi-predictive local illumination compensation (LIC) for the current block; obtain a first LIC parameter based on a first block vector associated with the current block and a second LIC parameter based on a second block vector associated with the current block; encode the current block based on the first and second LIC parameters 9. A video encoding method, the method comprising: determining to code a current block using block-vector-based prediction mode; determining to enable bi-predictive local illumination compensation (LIC) for the current block; IDVC_ 2023P00519WO PATENT obtaining a first LIC parameter based on a first block vector associated with the current block and a second LIC parameter based on a second block vector associated with the current block; and encoding the current block based on the first and second LIC parameters. 10. The video encoding device of claim 8 or the video encoding method of claim 9, wherein the processor of claim 8 is further configured to perform, or the method of claim 9 further comprises: obtaining a first template of a first reference block based on the first block vector, wherein the first LIC parameter is derived based on a template of the current block and the first template of the first reference block; and obtaining a second template of a second reference block based on the second block vector, wherein the second LIC parameter is derived based on the template of the current block and the second template of the second reference block. 11. The video encoding device of claim 8 or the video encoding method of claim 9, wherein the processor of claim 8 is further configured to perform, or the method of claim 9 further comprises: including, in video data, a bi-predictive LIC indication associated with the current block to indicate that the bi-predictive LIC is enabled for the current block. 12. The video encoding device of any of claims 8 and 10 to 11 or the video encoding method of any of claims 9 to 11, wherein the template of the current block comprises at least one of a top template or a left template. 13. The video encoding device of any of claims 8 and 10 to 12 or the video encoding method of any of claims 9 to 12, wherein encoding the current block based on the first and second LIC parameter further comprises: obtaining a first prediction block based on the first block vector; refining the first prediction block based on the first LIC parameter; obtaining a second prediction block based on the second block vector; refining the second prediction block based on the second LIC parameter; generating a residual of the current block based on the first refined prediction block and the second refined prediction block; and including an indication of the residual in video data. IDVC_ 2023P00519WO PATENT 14. The video encoding device of any of claims 8 and 10 to 13 or the video encoding method of any of claims 9 to 13, wherein the first LIC parameter comprises at least one of an LIC scaling factor or an LIC offset. 15. A computer program product which is stored on a non-transitory computer readable medium and comprises program code instructions for implementing the steps of a method according to at least one of claims 2 to 7 and 9 to 14 when executed by a processor. 16. A computer program comprising program code instructions for implementing the steps of a method according to at least one of claims 2 to 7 and 9 to 14 when executed by a processor. 17. A video data comprising information representative of the encoded output generated according to one of the methods of any of claims 9 to 14.

Description

IDVC_ 2023P00519WO PATENT BI-PREDICTION INTRA BLOCK COPY WITH LOCAL ILLUMINATION COMPENSATION CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims the benefit of European Patent Application 23306079.7, filed June 30, 2023, the disclosure of which is incorporated herein by reference in its entirety. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. SUMMARY [0003] Systems, methods, and instrumentalities are disclosed for performing video coding using intra block copy (IBC) bi-prediction with bi-predictive local Illumination compensation (LIC). A bi-predictive LIC model may be derived for a CU coded in IBC mode, e.g., similar to a method for inter CU. A bi-predictive LIC mode may be derived/signaled at CU-level, for example, according to whether the CU is in block vector prediction (BVP)-merge mode or in bi-predictive IBC merge mode. A bi-predictive LIC IBC mode may be controlled, for example, with high-level control(s). [0004] A video coding device (e.g., decoder) may implement a method for video coding using IBC bi- prediction with bi-predictive LIC. The video coding device may determine that bi-predictive LIC is enabled for a current block. The video coding device may determine that the current block is coded using IBC mode. The video coding device may obtain a first LIC parameter based on a first block vector associated with the current block. The video coding device may obtain a second LIC parameter based on a second block vector associated with the current block. The video coding device may decode the current block based on the first and second LIC parameter. [0005] Bi-predictive LIC enabled for the current block may be determined based on a bi-predictive LIC indication associated with the current block. The video coding device (e.g., decoder) may (e.g., further) obtain a first template of a first reference block based on the first block vector. The first LIC parameter may be derived based on a template of the current block and the first template of the first reference block. The IDVC_ 2023P00519WO PATENT video coding device may (e.g., further) obtain a second template of a second reference block based on the second block vector. The second LIC parameter may be derived based on the template of the current block and the second template of the second reference block. The template of the current block may include the top template, the left template, or both. Decoding the current block based on the first and second LIC parameter may include, for example, obtaining a first prediction block based on the first block vector; refining the first prediction block based on the first LIC parameter; obtaining a second prediction block based on the second block vector; refining the second prediction block based on the second LIC parameter; and predicting the current block based on the first refined prediction block and the second refined prediction block. The first LIC parameter may include an LIC scaling factor and/or an LIC offset. [0006] A video coding device (e.g., encoder) may implement a method for video coding using IBC bi- prediction with bi-predictive LIC. The video coding device may determine to enable bi-predictive LIC for a current block. The video coding device may determine to code the current block using IBC mode. The video coding device may obtain a first LIC parameter based on a first block vector associated with the current block. The video coding device may obtain a second LIC parameter based on a second block vector associated with the current block. The video coding device may encode the current block based on the first and second LIC parameter. [0007] The video coding device (e.g., encoder) may include, in video data, a bi-predictive LIC indication associated with the current block to indicate that bi-predictive LIC is enabled for the current block. The video coding device may (e.g., further) obtain a first template of a first reference block based on the first block vector. The first LIC parameter may be derived based on a template of the current block and the first template of the first reference block. The video coding device may obtain a second template of a second reference block based on the second block vector. The second LIC parameter may be derived based on the template of the current block and the second template of the second reference block. The template of the current block may include the top template and/or the left template. Encoding the current block based on the first and second LIC parameter may include, for example, obtaining a first prediction block based on the first block vector; refining the first prediction block based on the first LIC parameter; obtaining a second prediction block based on the second block vector; refining the second