Search

EP-4736414-A1 - INTRA-SUB PARTITIONING COMBINATION WITH INTRA TEMPLATE MATCHING PREDICTION

EP4736414A1EP 4736414 A1EP4736414 A1EP 4736414A1EP-4736414-A1

Abstract

Systems, methods, and instrumentalities are disclosed for performing intra template matching prediction (IntraTMP). IntraTMP may be performed for a video block to obtain a block vector associated with the video block. The video block may be determined to be associated with intra sub-partition (ISP) and may include a first and second sub-partition. A refined block vector associated with the first sub-partition may be obtained using template matching based on the block vector. The video block may be decoded based on the refined block vector associated with the first sub-partition. A refined block vector associated with the second sub-partition may be obtained using template matching based on the block vector. The video block may be decoded further based on the refined block vector associated with the second sub-partition.

Inventors

  • NASER, Karam
  • LE LEANNEC, FABRICE
  • ROBERT, ANTOINE
  • RADOSAVLJEVIC, Milos

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260506
Application Date
20240614

Claims (20)

  1. 1 . A video decoding method, comprising: performing IntraTMP for a video block to obtain a block vector associated with the video block; determining the video block is associated with intra sub-partition (ISP) and comprises a first subpartition and a second sub-partition; obtaining a refined block vector associated with the first sub-partition using template matching based on the block vector; and decoding the video block based on the refined block vector associated with the first sub-partition.
  2. 2. The method of claim 1 , further comprising: obtaining a refined block vector associated with the second sub-partition using template matching based on the block vector, wherein the video block is decoded further based on the refined block vector associated with the second sub-partition.
  3. 3. The method of claim 1 , further comprising: obtaining a first template associated with the first sub-partition; and identifying an IntraTMP refinement region based on the block vector, wherein the refined block vector associated with the first sub-partition is obtained based on performing template matching in the IntraTMP refinement region using the first template associated with the first sub-partition.
  4. 4. The method of claim 3, wherein the IntraTMP refinement region is a reduced range around the block vector.
  5. 5. The method of claim 4, wherein the reduced range may be defined as having dimensions of half the block width by half the block height.
  6. 6. The method of claim 1 , wherein the method further comprises: obtaining an IntraTMP candidate list with the video block; and obtaining an intraTMP index associated with the video block, wherein the block vector associated with the video block is determined based on the IntraTMP candidate list and the intraTMP index associated with the video block.
  7. 7. A device for video decoding, the device comprising: a processor configured to: perform IntraTMP for a video block to obtain a block vector associated with the video block; determine the video block is associated with intra sub-partition (ISP) and comprises a first subpartition and a second sub-partition; obtain a refined block vector associated with the first sub-partition using template matching based on the block vector; and decode the video block based on the refined block vector associated with the first sub-partition.
  8. 8. The device of claim 7, wherein the processor is further configured to: obtain a refined block vector associated with the second sub-partition using template matching based on the block vector, wherein the video block is decoded further based on the refined block vector associated with the second sub-partition.
  9. 9. The device of claim 7, wherein the processor is further configured to: obtain a first template associated with the first sub-partition; and identify an IntraTMP refinement region based on the block vector, wherein the refined block vector associated with the first sub-partition is obtained based on performing template matching in the IntraTMP refinement region using the first template associated with the first sub-partition.
  10. 10. The device of claim 9, wherein the IntraTMP refinement region is a reduced range around the block vector.
  11. 11 . The device of claim 10, wherein the reduced range may be defined as having dimensions of half the block width by half the block height.
  12. 12. The device of claim 7, wherein the processor is further configured to: obtain an IntraTMP candidate list with the video block; and obtain an intraTMP index associated with the video block, wherein the block vector associated with the video block is determined based on the IntraTMP candidate list and the intraTMP index associated with the video block.
  13. 13. A video encoding method, the method comprising: performing IntraTMP for a video block to obtain a block vector associated with the video block; determining the video block is associated with intra sub-partition (ISP) and comprises a first subpartition and a second sub-partition; obtaining a refined block vector associated with the first sub-partition using template matching based on the block vector; and encoding the video block based on the refined block vector associated with the first sub-partition.
  14. 14. The method of claim 13, further comprising: obtaining a refined block vector associated with the second sub-partition using template matching based on the block vector, wherein the video block is encoded further based on the refined block vector associated with the second sub-partition.
  15. 15. The method of claim 13, further comprising: obtaining a first template associated with the first sub-partition; and identifying an IntraTMP refinement region based on the block vector, wherein the refined block vector associated with the first sub-partition is obtained based on performing template matching in the IntraTMP refinement region using the first template associated with the first sub-partition.
  16. 16. The method of claim 15, wherein the IntraTMP refinement region is a reduced range around the block vector.
  17. 17. The method of claim 16, wherein the reduced range may be defined as having dimensions of half the block width by half the block height.
  18. 18. The method of claim 13, wherein the method further comprises: obtaining an IntraTMP candidate list with the video block; and obtaining an intraTMP index associated with the video block, wherein the block vector associated with the video block is determined based on the IntraTMP candidate list and the intraTMP index associated with the video block.
  19. 19. A device for video encoding, the device comprising: a processor configured to: perform IntraTMP for a video block to obtain a block vector associated with the video block; determine the video block is associated with intra sub-partition (ISP) and comprises a first subpartition and a second sub-partition; obtain a refined block vector associated with the first sub-partition using template matching based on the block vector; and encode the video block based on the refined block vector associated with the first sub-partition.
  20. 20. The device of claim 19, wherein the processor is further configured to: obtain a refined block vector associated with the second sub-partition using template matching based on the block vector, wherein the video block is encoded further based on the refined block vector associated with the second sub-partition.

Description

INTRA-SUB PARTITIONING COMBINATION WITH INTRA TEMPLATE MATCHING PREDICTION CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims the benefit of European Provisional Application No. EP23306111 .8, filed June 30, 2023, the contents of which are hereby incorporated by reference herein. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. SUMMARY [0003] Systems, methods, and instrumentalities are disclosed for performing intra template matching prediction (IntraTMP). [0004] For example, a device may receive a video bitstream. The device may perform IntraTMP at a transform unit (TU) level to obtain a refined block associated with a block vector. The device may perform IntraTMP at a coding unit (CU) level to obtain the block vector associated with an intra sub-partition block. [0005] In examples, the device may determine one or more CU level parameters and one or more TU level parameters associated with the video bitstream, wherein performing IntraTMP at the CU level uses the one or more CU level parameters, and performing IntraTMP at the TU level uses the one or more TU level parameters. [0006] Performing IntraTMP at the CU level may include using a fusion method and the one or more CU level parameters may include a fusion index indicating the fusion method used and a chosen block vector associated with the fusion method. [0007] The one or more CU level parameters may include a CU index indicating the block vector used for the IntraTMP at the CU level and the one or more TU level parameters include a TU level flag indicating use or nonuse of the CU index when performing IntraTMP for each sub-partition. [0008] The one or more TU level parameters may include a TU level index indicating the CU index, a first block vector in a candidate list, a second block vector in the candidate list, or a third block vector in the candidate list is selected for each sub-partition. [0009] The one or more CU level parameters may include a filtering flag indicating filtering is performed on IntraTMP prediction. [0010] For example, a device may perform intra template matching prediction (IntraTMP) at a coding unit (CU) level to obtain a block vector associated with an intra sub-partition block. The device may perform IntraTMP at a transform unit (TU) level to obtain a refined block vector from the block vector. [0011] In examples, the device may determine one or more CU level parameters based on the performed IntraTMP at the CU level, wherein the IntraTMP at the TU level uses the one or more CU level parameters. The device may determine one or more TU level parameters based on the performed IntraTMP at the TU level. The device may signal the one or more CU level parameters and/or the one or more TU level parameters. [0012] Performing IntraTMP at the CU level may include using a fusion method and the one or more CU level parameters may include a fusion index indicating the fusion method and a chosen block vector associated with the fusion method. [0013] The one or more CU level parameters may include a CU index indicating the block vector used for the IntraTMP at the CU level and the one or more TU level parameters may include a TU level flag indicating use or nonuse of the CU index when performing IntraTMP for each sub-partition. [0014] The one or more TU level parameters may include a TU level index indicating the CU index, a first block vector in a candidate list, a second block vector in the candidate list, or a third block vector in the candidate list is selected for each sub-partition. [0015] The one or more CU level parameters may include a filtering flag indicating filtering is performed on IntraTMP prediction. [0016] IntraTMP may be performed for a video block to obtain a block vector associated with the video block. The video block may be determined to be associated with intra sub-partition (ISP) and may include a first sub-partition and a second sub-partition. A refined block vector associated with the first sub-partition may be obtained using template matching based on the block vector. The video block may be encoded or decoded based on the refined block vector associated with the first sub-partition. [0017] A refined block vector associated with the second sub-partition may be obtained using template matching based on the block vector, wherein the video block is decoded further based on the refined block vector associated with the second sub-partition. A first template associated with the first sub-partition may be obtained. An IntraTMP refinement region may be identified based on the block vector. The refined block vector associated with the first sub-partition may be obtained based on performing template matching in the IntraTMP refinement region using the first template associated w