KR-20260062979-A - Systems and methods of loop filtering with frame interpolation

KR20260062979AKR 20260062979 AKR20260062979 AKR 20260062979AKR-20260062979-A

Abstract

An exemplary video coding method comprises the step of receiving a video bitstream for a plurality of encoded pictures. The method further comprises the step of deriving a reconstructed picture for one of the plurality of encoded pictures using frame interpolation of a first type, and the step of determining whether to apply loop filtering to the reconstructed picture based on a signaled indicator in the video bitstream. When the signaled indicator has a first value, a decoded picture for the encoded picture is derived by applying one or more loop filters to the reconstructed picture. When the signaled indicator has a second value, a decoded picture is derived without applying one or more loop filters to the reconstructed picture.

Inventors

자오 신
자오, 량
예, 징
가오, 한
초, 위신
페린가세리 크리쉬난, 마두
류, 산

Assignees

텐센트 아메리카 엘엘씨

Dates

Publication Date: 20260507
Application Date: 20240412
Priority Date: 20240328

Claims (20)

A video decoding method performed on a computing system having memory and one or more processors, A step of receiving a video bitstream containing a plurality of encoded pictures; A step of deriving a reconstructed picture for one of the plurality of encoded pictures using a first type of frame interpolation; A step of determining whether to apply loop filtering to the reconstructed picture based on signaled indicators within the video bitstream; When the signaled indicator has a first value, a step of deriving a decoded picture for the encoded picture by applying one or more loop filters to the reconstructed picture; and When the signaled indicator has a second value, the step of deriving the decoded picture without applying the one or more loop filters to the reconstructed picture A method including
A method according to claim 1, wherein the signaled indicator indicates whether a plurality of loop filtering processes are applied to the reconstructed picture.
A method according to claim 1, wherein the signaled indicator includes a co-indicator indicating whether all loop filtering processes are enabled or disabled for the reconstructed picture.
A method according to claim 1, wherein the signaled indicator indicates the order for applying a set of loop filtering processes to the reconstructed picture.
In paragraph 1, A step of designating the reconstructed picture as a reference frame for another picture by applying a first loop filter process set to the reconstructed picture; and A method further comprising the step of abandoning designating the reconstructed picture as the reference frame by applying a second loop filter process set to the reconstructed picture, wherein the first loop filter process set is different from the second loop filter process set.
In claim 1, the one or more loop filters applied to the reconstructed picture have a corresponding first set of filter parameters, and the method is: A step of deriving a second reconstructed picture for a second encoded picture among the plurality of pictures above - the second reconstructed picture is derived without using the first type of frame interpolation -; and A method further comprising the step of applying one or more loop filters to the second reconstructed picture— wherein the one or more loop filters applied to the second reconstructed picture have a corresponding second filter parameter set different from the first filter parameter set.
A method according to claim 1, wherein one or more loop filters applied to the reconstructed picture have a corresponding set of filter parameters, a first subset of the set of filter parameters is parsed from the video bitstream and a second subset of the set of filter parameters is derived from the computing system.
In claim 1, the one or more loop filters include a cross-component filter set, and a first maximum number of bands is used when applying the cross-component filter set to the reconstructed picture, and the method is: A step of deriving a second reconstructed picture for a second encoded picture among the plurality of pictures above - the second reconstructed picture is derived without using the first type of frame interpolation -; and A method further comprising the step of applying the cross-component filter set to the second reconstructed picture, wherein when applying the cross-component filter set to the second reconstructed picture, a second maximum band number is used, and the second maximum band number is greater than the first maximum band number.
A method according to claim 1, further comprising the step of determining whether to apply one or more simplified loop filters to the reconstructed picture based on the signaled indicator.
In claim 9, the method wherein one or more simplified loop filters comprise a simplified cross-component loop filter.
A method according to claim 1, wherein the signaled indicator indicates whether a deblocking filtering process is applied to the reconstructed picture.
A method according to claim 1, wherein the signaled indicator indicates whether a cross-component sample offset loop filtering process is applied to the reconstructed picture.
A method according to claim 1, wherein the signaled indicator indicates whether a Wiener loop filtering process is applied to the reconstructed picture.
A method according to claim 1, wherein the signaled indicator indicates whether a restricted direction enhancement filtering process is applied to the reconstructed picture.
As a computing system, Control circuit section; Memory; and It includes one or more instruction sets configured to be stored in the memory and executed by the control circuit, and the one or more instruction sets are: Instructions for receiving video data including multiple pictures; Instructions for encoding the first picture among the plurality of pictures according to the first type of frame interpolation; Instructions for determining whether one or more loop filters are applied to a reconstructed picture for the encoded first picture; Instructions for transmitting the above-mentioned encoded first picture through a video bitstream; and A system comprising instructions for signaling, through the video bitstream, a first indicator indicating whether to apply the above one or more loop filters to the reconstructed picture.
In paragraph 15, the above decision is based on the first type of frame interpolation system.
A system according to claim 15, wherein determining whether one or more loop filters are applied includes determining whether one or more of a deblocking filter, a cross-component sample offset filter, a Wiener loop filter, and a constrained direction enhancement filter are applied.
In paragraph 15, the above-mentioned first indicator indicates whether multiple loop filtering processes are applied to the reconstructed picture, a system.
A system according to claim 15, further comprising signaling a set of filter parameters for one or more loop filters.
A non-transient computer-readable storage medium storing one or more instruction sets configured to be executed by a computing device having a control circuit and a memory, wherein the one or more instruction sets are: Instructions for acquiring a source video sequence; and It includes instructions for performing a conversion between the source video sequence and the visual media data bitstream, and the bitstream is: A plurality of encoded pictures including a first encoded picture encoded according to a first type of frame interpolation; and A non-transient computer-readable storage medium comprising a first indicator indicating whether to apply one or more loop filters to a reconstructed picture of the first encoded picture.

Description

Systems and methods of loop filtering with frame interpolation Related applications This application claims priority to U.S. Provisional Application No. 63/547,098, filed on November 2, 2023, with the title of the invention "Frame Interpolation with Loop Filtering," and to U.S. Patent Application No. 18/620,937, filed on March 28, 2024, with the title of the invention "Systems and Methods of Frame Interpolation with Loop Filtering," and claims priority to this. Technology field The disclosed embodiments relate to video coding, which generally includes, but is not limited to, frame interpolation prediction modes and systems and methods of loop filtering. Digital video is supported by various electronic devices such as digital televisions, laptops or desktop computers, tablet computers, digital cameras, digital recording devices, digital media players, video gaming consoles, smartphones, video teleconferencing devices, and video streaming devices. Electronic devices transmit and receive digital video data over communication networks, communicate in other ways, and/or store digital video data on storage devices. Due to the limited bandwidth capacity of communication networks and the limited memory resources of storage devices, video coding may be used to compress video data according to one or more video coding standards before it is transmitted or stored. Video coding may be performed by hardware and/or software on electronic/client devices or servers that provide cloud services. Video coding generally utilizes prediction methods (e.g., inter-prediction, intra-prediction, etc.) that take advantage of the redundancy inherent in video data. The purpose of video coding is to compress video data by using lower bit rates while preventing or minimizing video quality degradation. Numerous video codec standards have been developed. For example, High Efficiency Video Coding (HEVC/H.265) is a video compression standard designed as part of the MPEG-H project. The ITU-T and ISO/IEC released the HEVC/H.265 standards in 2013 (Version 1), 2014 (Version 2), 2015 (Version 3), and 2016 (Version 4). VVC/H.266 (Versatile Video Coding) is a video compression standard intended as a successor to HEVC. ITU-T and ISO/IEC published the VVC/H.266 standard in 2020 (Version 1) and 2022 (Version 2). AOMedia Video 1 (AV1) is an open video coding format designed as an alternative to HEVC. On January 8, 2019, a verified version 1.0.0 with Errata 1 of the specification was released. The present disclosure describes, among other things, applying loop filtering methods and/or techniques to reconstructed frames, including reconstructed frames derived using a frame-level mode of a frame interpolation method. Some embodiments include applying loop filtering optionally and using a signaled indicator to indicate whether to apply loop filtering optionally. Applying loop filtering optionally improves video decoding quality (e.g., using time and resources for loop filtering only when loop filtering significantly improves reconstruction accuracy and/or precision). According to some embodiments, a video decoding method comprises: (i) receiving a video bitstream comprising a plurality of encoded pictures; (ii) deriving a reconstructed picture for one of the plurality of encoded pictures using frame interpolation of a first type; (iii) determining whether to apply loop filtering to the reconstructed picture based on a signaled indicator in the video bitstream; (iv) deriving a decoded picture for an encoded picture by applying one or more loop filters to the reconstructed picture when the signaled indicator has a first value (e.g., indicating that loop filtering will be applied); and (v) deriving a decoded picture without applying one or more loop filters to the reconstructed picture when the signaled indicator has a second value (e.g., indicating that loop filtering will not be applied). According to some embodiments, a video encoding method comprises: (i) receiving video data including a plurality of pictures; (ii) encoding a first picture among the plurality of pictures according to a first type of frame interpolation; (iii) determining whether one or more loop filters are applied to a reconstructed picture for the encoded first picture; (iv) transmitting the encoded first picture through a video bitstream; and (v) signaling a first indicator through the video bitstream that indicates whether one or more loop filters are applied to the reconstructed picture. According to some embodiments, a method for processing visual media data comprises: (i) acquiring a source video sequence; and (ii) performing a conversion between the source video sequence and a visual media data bitstream, wherein the bitstream comprises: (a) a plurality of encoded pictures including a first encoded picture encoded according to a first type of frame interpolation; and (b) a first indicator indicating whether to apply one or more loop filters to a reconstructed picture of the first