EP-4736418-A1 - INTRA SUB-PARTITIONS (ISP) COMBINATION WITH INTRA BLOCK COPY (IBC)

Abstract

Systems, methods, and instrumentalities are disclosed for performing video encoding and/or decoding may be used. One or more intra block copy (IBC) block vectors may be determined. The one or more IBC block vectors may be associated with a current coding block. The coding block may include multiple sub-partitions. For a sub-partition, the block vector may be refined based on a template associated with the sub-partition. The refinement may be performed using a refinement window. The current coding block may be encoded and/or decoded based on the refined block vector.

Inventors

• NASER, Karam
• LE LEANNEC, FABRICE
• ROBERT, ANTOINE
• RADOSAVLJEVIC, Milos

Assignees

• InterDigital CE Patent Holdings, SAS

Dates

Publication Date

20260506

Application Date

20240624

Claims (20)

1. 1 . A video decoding device, comprising: a processor configured to: determine an intra block copy (IBC) block vector associated with a current coding block, wherein the current coding block comprises a plurality of sub-partitions; refine IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors; and decode the current coding block based on the plurality of refined block vectors.
2. 2. The video decoding device of claim 1 , wherein to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors, the processor is further configured to: refine the IBC block vector associated with the current coding block based on a first sub-partition from the plurality of sub-partitions to obtain a first refined IBC block vector associated with the first subpartition; and refine the IBC block vector associated with the current coding block based on a second subpartition from the plurality of sub-partitions to obtain a second refined IBC block vector associated with the second sub-partition, wherein the current coding block decoded based on the plurality of refined block vectors is further based on the first refined IBC block vector associated with the first sub-partition and the second refined IBC block vector associated with the second sub-partition.
3. 3. The video decoding device of claim 1 , wherein each sub-partition from the plurality of sub-partitions is a respective transform unit.
4. 4. The video decoding device of claim 1 , wherein the processor is further configured to: perform a first template matching search, wherein the IBC block vector associated with the current coding block is determined based on the performed first template matching search.
5. 5. The video decoding device of claim 1 , wherein the refinement of the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors comprises a determination of a first refined IBC block vector associated with a first sub-partition from the plurality of sub-partitions and a second refined IBC block vector associated with a second sub-partition from the plurality of sub-partitions, and wherein the processor is further configured to: perform a first template matching search based on a template associated with the first sub-partition from the plurality of sub-partitions, wherein the determined first refined IBC block vector is further based on the first template matching search; and perform a second template matching search based on a template associated with the second subpartition from the plurality of sub-partitions, wherein the determined second refined IBC block vector is further based on the second template matching search.
6. 6. The video decoding device of claim 1 , wherein the processor is further configured to: determine to use a filter with IBC prediction associated with the current coding block; and based on the determination to use the filter with IBC prediction associated with the current coding block, perform filtering on at least one of the plurality of sub-partitions, wherein the filtering is performed based on a determination of whether to perform filtering on each respective sub-partition from the plurality of sub-partitions.
7. 7. A video encoding device, comprising: a processor configured to: determine an intra block copy (IBC) block vector associated with a current coding block, wherein the current coding block comprises a plurality of sub-partitions; refine IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors; and encode the current coding block based on the plurality of refined block vectors.
8. 8. The video encoding device of claim 7, wherein to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors, the processor is further configured to: refine the IBC block vector associated with the current coding block based on a first sub-partition from the plurality of sub-partitions to obtain a first refined IBC block vector associated with the first subpartition; and refine the IBC block vector associated with the current coding block based on a second subpartition from the plurality of sub-partitions to obtain a second refined IBC block vector associated with the second sub-partition, wherein the current coding block encoded based on the plurality of refined block vectors is further based on the first refined IBC block vector associated with the first sub-partition and the second refined IBC block vector associated with the second sub-partition.
9. 9. The video encoding device of claim 7, wherein each sub-partition from the plurality of sub-partitions is a respective transform unit.
10. 10. The video encoding device of claim 7, wherein the processor is further configured to: perform a first template matching search, wherein the IBC block vector associated with the current coding block is determined based on the performed first template matching search.
11. 11 . The video encoding device of claim 7, wherein the refinement of the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors comprises a determination of a first refined IBC block vector associated with a first sub-partition from the plurality of sub-partitions and a second refined IBC block vector associated with a second sub-partition from the plurality of sub-partitions, and wherein the processor is further configured to: perform a first template matching search based on a template associated with the first sub-partition from the plurality of sub-partitions, wherein the determined first refined IBC block vector is further based on the first template matching search; and perform a second template matching search based on a template associated with the second subpartition from the plurality of sub-partitions, wherein the determined second refined IBC block vector is further based on the second template matching search.
12. 12. The video encoding device of claim 7, wherein the processor is further configured to: determine to use a filter with IBC prediction associated with the current coding block; and based on the determination to use the filter with IBC prediction associated with the current coding block, perform filtering on at least one of the plurality of sub-partitions, wherein the filtering is performed based on a determination of whether to perform filtering on each respective sub-partition from the plurality of sub-partitions.
13. 13. A video decoding method, the video decoding method comprising: determining an intra block copy (IBC) block vector associated with a current coding block, wherein the current coding block comprises a plurality of sub-partitions; refining IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors; and decoding the current coding block based on the plurality of refined block vectors.
14. 14. The video decoding method of claim 13, wherein to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors, the video decoding method further comprises: refining the IBC block vector associated with the current coding block based on a first sub-partition from the plurality of sub-partitions to obtain a first refined IBC block vector associated with the first subpartition; and refining the IBC block vector associated with the current coding block based on a second subpartition from the plurality of sub-partitions to obtain a second refined IBC block vector associated with the second sub-partition, wherein the current coding block decoded based on the plurality of refined block vectors is further based on the first refined IBC block vector associated with the first sub-partition and the second refined IBC block vector associated with the second sub-partition.
15. 15. The video decoding method of claim 13, wherein each sub-partition from the plurality of subpartitions is a respective transform unit.
16. 16. The video decoding method of claim 13, wherein the video decoding method further comprises: performing a first template matching search, wherein the IBC block vector associated with the current coding block is determined based on the performed first template matching search.
17. 17. The video decoding method of claim 13, wherein the refinement of the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors comprises a determination of a first refined IBC block vector associated with a first sub-partition from the plurality of sub-partitions and a second refined IBC block vector associated with a second subpartition from the plurality of sub-partitions, and wherein the video decoding method further comprises: performing a first template matching search based on a template associated with the first subpartition from the plurality of sub-partitions, wherein the determined first refined IBC block vector is further based on the first template matching search; and performing a second template matching search based on a template associated with the second sub-partition from the plurality of sub-partitions, wherein the determined second refined IBC block vector is further based on the second template matching search.
18. 18. The video decoding method of claim 13, wherein the video decoding method further comprises: determining to use a filter with IBC prediction associated with the current coding block; and based on the determination to use the filter with IBC prediction associated with the current coding block, performing filtering on at least one of the plurality of sub-partitions, wherein the filtering is performed based on a determination of whether to perform filtering on each respective sub-partition from the plurality of sub-partitions.
19. 19. A video encoding method, the video encoding method comprising: determining an intra block copy (IBC) block vector associated with a current coding block, wherein the current coding block comprises a plurality of sub-partitions; refining IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors; and encoding the current coding block based on the plurality of refined block vectors.
20. 20. The video encoding method of claim 19, wherein to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors, the video encoding method further comprises: refining the IBC block vector associated with the current coding block based on a first sub-partition from the plurality of sub-partitions to obtain a first refined IBC block vector associated with the first subpartition; and refining the IBC block vector associated with the current coding block based on a second subpartition from the plurality of sub-partitions to obtain a second refined IBC block vector associated with the second sub-partition, wherein the current coding block encoded based on the plurality of refined block vectors is further based on the first refined IBC block vector associated with the first sub-partition and the second refined IBC block vector associated with the second sub-partition.

Description

INTRA SUB-PARTITIONS (ISP) COMBINATION WITH INTRA BLOCK COPY (IBC) CROSS-REFERENCE TO RELATED APPLICATOINS [0001] The application claims the benefit of European Patent Application Number 23306093.8, filed June 30, 2023, the contents of which are incorporated by reference in their entirety herein. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. SUMMARY [0003] Systems, methods, and instrumentalities are disclosed for performing video encoding may be used. One or more intra block copy (IBC) block vectors may be determined. The one or more IBC block vectors may be associated with a current coding block. The coding block may include multiple subpartitions. For a sub-partition, the block vector may be refined based on a template associated with the sub-partition. The refinement may be performed using a refinement window. The current coding block may be encoded based on the refined block vectors associated with the sub-partitions. [0004] Systems, methods, and instrumentalities are disclosed for performing video decoding may be used. One or more IBC block vectors may be determined. The one or more IBC block vectors may be associated with a current coding block. The coding block may include multiple sub-partitions. For a subpartition, the block vector may be refined based on a template associated with the sub-partition. The refinement may be performed using a refinement window. The current coding block may be decoded based on the refined block vectors associated with the sub-partitions. [0005] Systems, methods, and instrumentalities described herein may involve a decoder. In some examples, the systems, methods, and instrumentalities described herein may involve an encoder. In some examples, the systems, methods, and instrumentalities described herein may involve a signal (e.g., from an encoder and/or received by a decoder). A computer-readable medium may include instructions for causing one or more processors to perform methods described herein. A computer program product may include instructions which, when the program is executed by one or more processors, may cause the one or more processors to carry out the methods described herein. [0006] The device may include a video decoding device. The video decoding device may include a processor. The video decoding device may determine an intra block copy (IBC) block vector associated with a current coding block. For example, the video decoding device may perform a first template matching search. The IBC block vector associated with the current coding block may be determined based on the first template matching search. The current coding block may include a plurality (e.g., one or more) subpartitions. A (e.g., each) sub-partition from the plurality of sub-partitions may be a respective transform unit (TU). The video decoding device may refine IBC block vectors associated with a (e.g., each) sub-partition) of the plurality of sub-partitions to obtain a plurality of refined block vectors. The video decoding device may (e.g., to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors) refine the IBC block vector associated with the current coding block, for example, based on a first sub-partition from the plurality of sub-partitions to obtain a first refined IBC block vector associated with the first sub-partition. The video decoding device may (e.g., to refine the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors) refine the IBC block vector associated with the current coding block based on a second sub-partition from the plurality of sub-partitions to obtain a second refined IBC block vector associated with the second sub-partition. The current coding block decoded based on the plurality of refined block vectors may be further based on the first refined IBC block vector associated with the first sub-partition and the second refined IBC block vector associated with the second sub-partition. The refinement of the IBC block vectors associated with each sub-partition of the plurality of sub-partitions to obtain a plurality of refined block vectors may include a determination of a first refined IBC block vector associated with a first sub-partition from the plurality of sub-partitions and a second refined IBC block vector associated with a second sub-partition from the plurality of sub-partitions. The video decoding device may perform a first template matching search based on a template associated with the first subpartition from the plurality of sub-partitions. The determined first refined IBC block vector may be further based on the first template matching search. The video decodin