US-12621464-B2 - Methods and devices for geometric partitioning mode with split modes reordering

US12621464B2US 12621464 B2US12621464 B2US 12621464B2US-12621464-B2

Abstract

Methods for video decoding and encoding, apparatuses and non-transitory storage media are provided. In one decoding method, the decoder obtains a first geometric partition mode (GPM) part and a second GPM part for a coding unit (CU). The decoder disables template matching (TM) based GPM split modes reordering for multiple GPM split modes that are applied to the CU in response to determining that the first GPM part or the second GPM part is predicted with intra prediction. Furthermore, the decoder enables the TM based GPM split modes reordering for the multiple GPM split modes in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction.

Inventors

Han Gao
Xiaoyu Xiu
Yi-Wen Chen
Wei Chen
HONG-JHENG JHU
Ning Yan
Che-Wei KUO
Xianglin Wang
Bing Yu

Assignees

Beijing Dajia Internet Information Technology Co., Ltd.

Dates

Publication Date: 20260505
Application Date: 20240718

Claims (15)

1 . A method for video decoding, comprising: obtaining, by a decoder, a first geometric partition mode (GPM) part and a second GPM part for a coding unit (CU); in response to determining that the first GPM part or the second GPM part is predicted with intra prediction, disabling, by the decoder, template matching (TM) based GPM split modes reordering for multiple GPM split modes that are applied to the CU; and in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction, enabling, by the decoder, the TM based GPM split modes reordering for the multiple GPM split modes.
2 . The method of claim 1 , further comprising: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, decoding, by the decoder and using equal-length codes without context coded bins, an GPM mode index indicating a first GPM split mode selected from the multiple GPM split modes; and in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, decoding, by the decoder and using variable-length codes with context coded bins, the GPM mode index indicating a second GPM split mode selected from one or more reordered GPM split modes based on reference templates of the first and the second GPM parts, wherein the one or more reordered GPM split modes are from the multiple GPM split modes and are reordered based on TM costs.
3 . The method of claim 1 , further comprising: determining, by the decoder and based on a first GPM intra syntax element, whether the first GPM part is predicted with the intra prediction; and determining, by the decoder and based on a second GPM intra syntax element, whether the second GPM part is predicted with the intra prediction.
4 . The method of claim 2 , further comprising: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, obtaining, by the decoder, a first partitioning index syntax element to indicate the first GPM split mode, wherein the first partitioning index syntax element is coded using fixed-length codes.
5 . The method of claim 2 , further comprising: in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, obtaining, by the decoder, a second partitioning index syntax element to indicate the second GPM split mode, wherein the second partitioning index syntax element is coded using the variable-length codes.
6 . An apparatus for video decoding, comprising: one or more processors; and a memory coupled to the one or more processors and configured to store instructions executable by the one or more processors, wherein the one or more processors, upon execution of the instructions, are configured to perform operations comprising: obtaining a first geometric partition mode (GPM) part and a second GPM part for a coding unit (CU); in response to determining that the first GPM part or the second GPM part is predicted with intra prediction, disabling template matching (TM) based GPM split modes reordering for multiple GPM split modes that are applied to the CU; and in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction, enabling the TM based GPM split modes reordering for the multiple GPM split modes.
7 . The apparatus of claim 6 , wherein the operations further comprise: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, decoding, using equal-length codes without context coded bins, an GPM mode index indicating a first GPM split mode selected from the multiple GPM split modes; and in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, decoding, using variable-length codes with context coded bins, the GPM mode index indicating a second GPM split mode selected from one or more reordered GPM split modes based on reference templates of the first and the second GPM parts, wherein the one or more reordered GPM split modes are from the multiple GPM split modes and are reordered based on TM costs.
8 . The apparatus of claim 6 , wherein the operations further comprise: determining, based on a first GPM intra syntax element, whether the first GPM part is predicted with the intra prediction; and determining, based on a second GPM intra syntax element, whether the second GPM part is predicted with the intra prediction.
9 . The apparatus of claim 7 , wherein the operations further comprise: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, obtaining a first partitioning index syntax element to indicate the first GPM split mode, wherein the first partitioning index syntax element is coded using fixed-length codes.
10 . The apparatus of claim 7 , wherein the operations further comprise: in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, obtaining a second partitioning index syntax element to indicate the second GPM split mode, wherein the second partitioning index syntax element is coded using the variable-length codes.
11 . A method for storing a bitstream, comprising: storing a bitstream to be decoded by a decoding method, wherein the decoding method comprises: obtaining a first geometric partition mode (GPM) part and a second GPM part for a coding unit (CU); in response to determining that the first GPM part or the second GPM part is predicted with intra prediction, disabling template matching (TM) based GPM split modes reordering for multiple GPM split modes that are applied to the CU; and in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction, enabling the TM based GPM split modes reordering for the multiple GPM split modes.
12 . The method of claim 11 , wherein the decoding method further comprises: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, decoding, using equal-length codes without context coded bins, an GPM mode index indicating a first GPM split mode selected from the multiple GPM split modes; and in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, decoding, using variable-length codes with context coded bins, the GPM mode index indicating a second GPM split mode selected from one or more reordered GPM split modes based on reference templates of the first and the second GPM parts, wherein the one or more reordered GPM split modes are from the multiple GPM split modes and are reordered based on TM costs.
13 . The method of claim 11 , wherein the decoding method further comprises: determining, based on a first GPM intra syntax element, whether the first GPM part is predicted with the intra prediction; and determining, based on a second GPM intra syntax element, whether the second GPM part is predicted with the intra prediction.
14 . The method of claim 12 , wherein the decoding method further comprises: in response to determining that the first GPM part or the second GPM part is predicted with the intra prediction, obtaining a first partitioning index syntax element to indicate the first GPM split mode, wherein the first partitioning index syntax element is coded using fixed-length codes.
15 . The method of claim 12 , wherein the decoding method further comprises: in response to determining that both the first GPM part and the second GPM part are predicted with the inter prediction, obtaining a second partitioning index syntax element to indicate the second GPM split mode, wherein the second partitioning index syntax element is coded using the variable-length codes.

Description

CROSS-REFERENCE TO RELATED APPLICATION The present application is a continuation of International Application No. PCT/US2023/011359, filed on Jan. 23, 2023, which claims priority to U.S. Provisional Application No. 63/302,008, entitled “Methods and Devices for Geometric Partitioning Mode with Split Modes Reordering,” filed on Jan. 21, 2022, all disclosures of which are incorporated herein by reference in their entireties for all purposes. FIELD The present disclosure relates to video coding and compression, and in particular but not limited to, methods and apparatus on improving the coding efficiency of geometric partitioning (GPM) mode. BACKGROUND Various video coding techniques may be used to compress video data. Video coding is performed according to one or more video coding standards. For example, nowadays, some well-known video coding standards include Versatile Video Coding (VVC, also known as H.266 or MPEG-I Part3), High Efficiency Video Coding (HEVC, also known as H.265 or MPEG-H Part2) and Advanced Video Coding (AVC, also known as H.264 or MPEG-4 Part 10), which are jointly developed by ISO/IEC MPEG and ITU-T VECG. Most of the existing video coding standards are built upon the famous hybrid video coding framework i.e., using block-based prediction methods (e.g., inter-prediction, intra-prediction) to reduce redundancy present in video images or sequences and using transform coding to compact the energy of the prediction errors. An important goal of video coding techniques is to compress video data into a form that uses a lower bit rate while avoiding or minimizing degradations to video quality. The first version of the VVC standard was finalized in July 2020, which offers approximately 50% bit-rate saving or equivalent perceptual quality compared to the prior generation video coding standard HEVC. Although the VVC standard provides significant coding improvements than its predecessor, there is evidence that superior coding efficiency can be achieved with additional coding tools. Recently, Joint Video Exploration Team (JVET) under the collaboration of ITU-T VECG and ISO/IEC MPEG started the exploration of advanced technologies that can enable substantial enhancement of coding efficiency over VVC. In April 2021, one software codebase, called Enhanced Compression Model (ECM) was established for future video coding exploration work. The ECM reference software was based on VVC Test Model (VTM) that was developed by JVET for the VVC, with several existing modules (e.g., intra/inter prediction, transform, in-loop filter and so forth) are further extended and/or improved. In future, any new coding tool beyond the VVC standard need to be integrated into the ECM platform, and tested using JVET common test conditions (CTCs). SUMMARY The present disclosure provides examples of techniques relating to improving the coding efficiency of GPM mode in a video encoding or decoding process. According to a first aspect of the present disclosure, there is provided a method of video decoding. In the method of video decoding, a decoder may obtain a first geometric partition mode (GPM) part and a second GPM part for a coding unit (CU). Additionally, the decoder may disable template matching (TM) based GPM split modes reordering for multiple GPM split modes that are applied to the CU in response to determining that the first GPM part or the second GPM part is predicted with intra prediction. Furthermore, the decoder may enable the TM based GPM split modes reordering for the multiple GPM split modes in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction. According to a second aspect of the present disclosure, there is provided a method of video encoding. In the method of video encoding, an encoder may obtain a first GPM part and a second GPM part for a CU. Additionally, the encoder may disable TM based GPM split modes reordering for multiple GPM split modes that are applied to the CU in response to determining that the first GPM part or the second GPM part is predicted with intra prediction. Furthermore, the encoder may enable the TM based GPM split modes reordering for the multiple GPM split modes in response to determining that both the first GPM part and the second GPM part are predicted with inter prediction. According to a third aspect of the present disclosure, there is provided a method of video decoding. In the method of video decoding, a decoder may obtain a first GPM part and a second GPM part for a CU. Additionally, the decoder may obtain inter prediction samples of neighboring reconstructed samples of the CU based on a motion vector associated with the first GPM part in response to determining that the first GPM part is coded with inter prediction. Furthermore, the decoder, in response to determining that the second GPM part is coded with intra prediction, may construct an intra prediction mode (IPM) list for the second GPM part, obtain a candidate intr