Search

US-20260129180-A1 - TMP Search Region Harmonization

US20260129180A1US 20260129180 A1US20260129180 A1US 20260129180A1US-20260129180-A1

Abstract

A video decoder sets all boundaries of a template matching prediction (TMP) search region to align with corresponding boundaries of an intra block copy (IBC) reference region. The video decoder further decodes the current block based on a reference block determined from the TMP search region.

Inventors

  • Damian Ruiz Coll

Assignees

  • OFINNO, LLC

Dates

Publication Date
20260507
Application Date
20251219

Claims (20)

  1. 1 . A method comprising: setting all boundaries of a template matching prediction (TMP) search region to align with corresponding boundaries of an intra block copy (IBC) reference region; and decoding the current block based on a reference block determined from the TMP search region.
  2. 2 . The method of claim 1 , wherein the IBC reference region comprises decoded samples of neighboring CTUs and of a current CTU stored in a memory device.
  3. 3 . The method of claim 1 , wherein the IBC reference region is based on a maximum coding tree unit (CTU) size.
  4. 4 . The method of claim 1 , wherein the setting comprises clipping an upper boundary or a left boundary of the TMP search region to a corresponding boundary of the IBC reference region.
  5. 5 . The method of claim 1 , wherein the TMP search region comprises a plurality of subregions, and wherein the setting comprises constraining one or more boundaries of at least one subregion of the plurality of subregions to a corresponding boundary of the IBC reference region.
  6. 6 . The method of claim 5 , wherein the at least one subregion has a rectangular shape.
  7. 7 . The method of claim 1 , wherein the setting further comprises defining a margin region of invalid locations for block vector (BV) candidates indicating reference blocks for the current block.
  8. 8 . A decoder comprising: one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the decoder to: set all boundaries of a template matching prediction (TMP) search region to align with corresponding boundaries of an intra block copy (IBC) reference region; and decode the current block based on a reference block determined from the TMP search region.
  9. 9 . The decoder of claim 8 , wherein the IBC reference region comprises decoded samples of neighboring CTUs and of a current CTU stored in a memory device.
  10. 10 . The decoder of claim 8 , wherein the IBC reference region is based on a maximum coding tree unit (CTU) size.
  11. 11 . The decoder of claim 8 , wherein the setting comprises clipping an upper boundary or a left boundary of the TMP search region to a corresponding boundary of the IBC reference region.
  12. 12 . The decoder of claim 8 , wherein the TMP search region comprises a plurality of subregions, and wherein the setting comprises constraining one or more boundaries of at least one subregion of the plurality of subregions to a corresponding boundary of the IBC reference region.
  13. 13 . The decoder of claim 12 , wherein the at least one subregion has a rectangular shape.
  14. 14 . The decoder of claim 8 , wherein the setting further comprises defining a margin region of invalid locations for block vector (BV) candidates indicating reference blocks for the current block.
  15. 15 . A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of an apparatus, cause the apparatus to: set all boundaries of a template matching prediction (TMP) search region to align with corresponding boundaries of an intra block copy (IBC) reference region; and decode the current block based on a reference block determined from the TMP search region.
  16. 16 . The non-transitory computer-readable medium of claim 15 , wherein the IBC reference region comprises decoded samples of neighboring CTUs and of a current CTU stored in a memory device.
  17. 17 . The non-transitory computer-readable medium of claim 15 , wherein the IBC reference region is based on a maximum coding tree unit (CTU) size.
  18. 18 . The non-transitory computer-readable medium of claim 15 , wherein the setting comprises clipping an upper boundary or a left boundary of the TMP search region to a corresponding boundary of the IBC reference region.
  19. 19 . The non-transitory computer-readable medium of claim 15 , wherein the TMP search region comprises a plurality of subregions, and wherein the setting comprises constraining one or more boundaries of at least one subregion of the plurality of subregions to a corresponding boundary of the IBC reference region.
  20. 20 . The non-transitory computer-readable medium of claim 19 , wherein the at least one subregion has a rectangular shape.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of International Application No. PCT/US2024/035381, filed Jun. 25, 2024, which claims the benefit of U.S. Provisional Application No. 63/523,412, filed Jun. 27, 2023, all of which are hereby incorporated by reference in their entireties. BRIEF DESCRIPTION OF THE DRAWINGS Examples of several of the various embodiments of the present disclosure are described herein with reference to the drawings. FIG. 1 illustrates an exemplary video coding/decoding system in which embodiments of the present disclosure may be implemented. FIG. 2 illustrates an exemplary encoder in which embodiments of the present disclosure may be implemented. FIG. 3 illustrates an exemplary decoder in which embodiments of the present disclosure may be implemented. FIG. 4 illustrates an example quadtree partitioning of a coding tree block (CTB) in accordance with embodiments of the present disclosure. FIG. 5 illustrates a corresponding quadtree of the example quadtree partitioning of the CTB in FIG. 4 in accordance with embodiments of the present disclosure. FIG. 6 illustrates example binary and ternary tree partitions in accordance with embodiments of the present disclosure. FIG. 7 illustrates an example quadtree+multi-type tree partitioning of a CTB in accordance with embodiments of the present disclosure. FIG. 8 illustrates a corresponding quadtree+multi-type tree of the example quadtree+multi-type tree partitioning of the CTB in FIG. 7 in accordance with embodiments of the present disclosure. FIG. 9 illustrates an example set of reference samples determined for intra prediction of a current block being encoded or decoded in accordance with embodiments of the present disclosure. FIG. 10A illustrates the 35 intra prediction modes supported by HEVC in accordance with embodiments of the present disclosure. FIG. 10B illustrates the 67 intra prediction modes supported by HEVC in accordance with embodiments of the present disclosure. FIG. 11 illustrates the current block and reference samples from FIG. 9 in a two-dimensional x, y plane in accordance with embodiments of the present disclosure. FIG. 12 illustrates an example angular mode prediction of the current block from FIG. 9 in accordance with embodiments of the present disclosure. FIG. 13A illustrates an example of inter prediction performed for a current block in a current picture being encoded in accordance with embodiments of the present disclosure. FIG. 13B illustrates an example horizontal component and vertical component of a motion vector in accordance with embodiments of the present disclosure. FIG. 14 illustrates an example of bi-prediction, performed for a current block in accordance with embodiments of the present disclosure. FIG. 15A illustrates an example location of five spatial candidate neighboring blocks relative to a current block being coded in accordance with embodiments of the present disclosure. FIG. 15B illustrates an example location of two temporal, co-located blocks relative to a current block being coded in accordance with embodiments of the present disclosure. FIG. 16 illustrates an example of IBC applied for screen content in accordance with embodiments of the present disclosure. FIG. 17 illustrates an example of template matching prediction (TMP) for predicting a current block (CB) in accordance with embodiments of the present disclosure. FIG. 18A illustrates an example IBC reference region determined based on an IBC reference sample memory size of 128×128 samples and a CTU size of 128×128 samples in accordance with embodiments of the present disclosure. FIG. 18B illustrates another example IBC reference region determined based on an IBC reference sample memory size of 128×128 samples and a CTU size of 128×128 samples in accordance with embodiments of the present disclosure. FIG. 19A illustrates an example IBC reference region determined based on a CTU size of 128×128 samples in accordance with embodiments of the present disclosure. FIG. 19B illustrates an example IBC reference region determined based on a CTU size of 256×256 samples in accordance with embodiments of the present disclosure. FIG. 20 illustrates an example IBC reference region determined based on a template matching prediction (TMP) block size. FIG. 21 illustrates another example IBC reference region relative to a TMP search region determined based on a TMP block size. FIG. 22 illustrates an example adjusted template matching prediction (TMP) search region determined based on a size of a current block (CB) and an intra block copy (IBC) reference region in accordance with embodiments of the present disclosure. FIG. 23 illustrates another example adjusted TMP search region determined based on a size of a CB and an IBC reference region in accordance with embodiments of the present disclosure. FIG. 24 illustrates another example adjusted TMP search region determined based on a size of a CB and an IBC reference region in accord