EP-4740481-A1 - ADAPTIVE INPUT PICTURE SELECTION IN POST FILTER GROUPS

Abstract

An apparatus includes circuitry configured to: receive an encoding of at least one picture; receive signaling comprising information related to a group of at least one post-processing filter; and use the information related to the group of the at least one post-processing filter to infer whether and how to use at least one post-processing filter in the group of the at least one post-processing filter for the at least one picture; wherein the information indicates at least one of: whether and how to use the at least one post-processing filter in the group when a previous post-processing filter in a cascade outputs a different number of pictures than what is used as input for a current post-processing filter in the cascade, or whether and how to apply the at least one post-processing filter in a hierarchical manner.

Inventors

• HANNUKSELA, MISKA MATIAS

Assignees

• Nokia Technologies Oy

Dates

Publication Date

20260513

Application Date

20240613

Claims (20)

1. 1. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, causes the apparatus at least to: receive an encoding of at least one picture; receive signaling comprising information related to a group of at least one postprocessing filter; and use the information related to the group of the at least one post-processing filter to infer whether and how to use at least one post-processing filter in the group of the at least one postprocessing filter for the at least one picture; wherein the information indicates at least one of: whether and how to use the at least one post-processing filter in the group when a previous post-processing filter in a cascade outputs a different number of pictures than what is used as input for a current post-processing filter in the cascade, or whether and how to apply the at least one post-processing filter in a hierarchical manner.
2. 2. The apparatus of claim 1, wherein the at least one post-processing filter comprises a neural network post-filter.
3. 3. The apparatus of any of claims 1 to 2, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: apply a picture rate upsampling post-processing filter to obtain a second frequency from an input having a first frequency; and apply the picture rate upsampling post-processing filter to obtain a third frequency from an input having the second frequency; wherein the signaled information indicates that the picture rate upsampling postprocessing filter is to be applied to obtain the second frequency from the input having the first frequency, and that the picture rate upsampling post-processing filter is to be applied to obtain the third frequency from the input having the second frequency.
4. 4. The apparatus of any of claims 1 to 3, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures used as an input for a postprocessing filter in the group of the at least one post-processing filter.
5. 5. The apparatus of any of claims 1 to 4, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures used as input for each postprocessing filter in the group of the at least one post-processing filter.
6. 6. The apparatus of any of claims 1 to 5, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: infer one or more input pictures for an initial post-processing filter in the group of the at least one post-processing filter; and decode one or more indications identifying input pictures for each subsequent postprocessing filter in the group; wherein each subsequent post-processing filter in the group follows the initial postprocessing filter.
7. 7. The apparatus of any of claims 1 to 6, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures for a post-processing filter in the group of the at least one post-processing filter from a neural-network post-filter activation supplemental enhancement information message that is comprised in a processing order nesting supplemental enhancement information message.
8. 8. The apparatus of any of claims 1 to 7, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures for a post-processing filter in the group of the at least one post-processing filter from a neural-network post-filter extended activation supplemental enhancement information message.
9. 9. The apparatus of any of claims 1 to 8, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: derive a list of candidate input pictures for a second or later post-processing filter in the group of the at least one post-processing filter from filtered pictures that are output by previous post-processing filters in the the group of the at least one post-processing filter, when any; interpolated pictures that are output by a post-processing filter process of previous postprocessing filters in the group of the at least one post-processing filter, when any; and candidate input pictures for a first post-processing filter in the the group of the at least one post-processing filter.
10. 10. The apparatus of claim 9, wherein an order of pictures in the list of candidate input pictures is pre-defined.
11. 11. The apparatus of any of claims 9 to 10, wherein an order of pictures in the list of candidate input pictures is an inverse output order.
12. 12. The apparatus of any of claims 9 to 11, wherein the candidate input pictures within the list of candidate input pictures are non-overlapping in output time, the list comprising up to one picture per an output time.
13. 13. The apparatus of any of claims 9 to 12, wherein a picture resulting from a subsequent postprocessing filter in the group of the at least one post-processing filter precedes a picture resulting from a previous post-processing filter in the group of the at least one post-processing filter in the list of candidate input pictures, when the picture resulting from the subsequent postprocessing filter in the the group of the at least one post-processing filter has a same output order as the picture resulting from the previous post-processing filter in the group of the at least one post-processing filter.
14. 14. The apparatus of any of claims 1 to 13, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode, given a list of candidate input pictures for a post-processing filter in the group of the at least one post-processing filter, one or more indications that indicate which of the candidate input pictures in the list are selected as input pictures for the post-processing filter in the group of the at least one post-processing filter.
15. 15. The apparatus of claim 14, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode, given the list of candidate input pictures for the post-processing filter in the group of the at least one post-processing filter, one or both of: an indication for the post-processing filter when all the pictures in the list of candidate input pictures are input pictures to the post-processing filter, or one or more skip counts corresponding to how many pictures in the list of candidate input pictures are skipped when selecting pictures from the list of candidate input pictures to be used as input pictures.
16. 16. The apparatus of any of claims 14 to 15, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode, given the list of candidate input pictures for the post-processing filter in the group of the at least one post-processing filter, a bit mask, where a bit position in the bit mask corresponds to a picture in the list of candidate input pictures, and a value of a bit indicates whether a picture in a respective position within the list of candidate input pictures is selected as an input picture to the post-processing filter in the group of the at least one post-processing filter.
17. 17. The apparatus of any of claims 1 to 16, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode a description of the group of the at least one post-processing filter that comprises more than one occurrence of the same post-processing filter.
18. 18. An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, causes the apparatus at least to: include, in a bitstream, an encoding of at least one picture; determine information related to a group of at least one post-processing filter; and indicate, in the bitstream, the information related to the group of the at least one postprocessing filter; wherein the information related to the group of the at least one post-processing filter is configured to be used to infer whether and how to use at least one post-processing filter in the group of the at least one post-processing filter for the at least one picture; wherein the information indicates at least one of: whether and how to use the at least one post-processing filter in the group when a previous post-processing filter in a cascade outputs a different number of pictures than what is used as input for a current post-processing filter in the cascade, or whether and how to apply the at least one post-processing filter in a hierarchical manner.
19. 19. The apparatus of claim 18, wherein the at least one post-processing filter comprises a neural network post-filter.
20. 20. The apparatus of any of claims 18 to 19, wherein the signaled information indicates that a picture rate upsampling post-processing filter is to be applied to obtain a second frequency from an input having a first frequency, and that the picture rate upsampling post-processing filter is to be applied to obtain a third frequency from an input having the second frequency.

Description

ADAPTIVE INPUT PICTURE SELECTION IN POST FILTER GROUPS TECHNICAL FIELD [0001] The examples and non-limiting embodiments relate generally to multimedia transport and, more particularly, to signaling information about multiple post processing filters. BACKGROUND [0002] It is known to perform data compression and decoding in a multimedia system. SUMMARY [0003] Example 1: An apparatus comprising: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, causes the apparatus at least to: receive an encoding of at least one picture; receive signaling comprising information related to a group of at least one post-processing filter; and use the information related to the group of the at least one post-processing filter to infer whether and how to use at least one post-processing filter in the group of the at least one post-processing filter for the at least one picture; wherein the information indicates at least one of: whether and how to use the at least one post-processing filter in the group when a previous post-processing filter in a cascade outputs a different number of pictures than what is used as input for a current post-processing filter in the cascade, or whether and how to apply the at least one post-processing filter in a hierarchical manner. [0004] Example 2: The apparatus of example 1, wherein the at least one post-processing filter comprises a neural network post-filter. [0005] Example 3: The apparatus of any of examples 1 to 2, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: apply a picture rate upsampling post-processing filter to obtain a second frequency from an input having a first frequency; and apply the picture rate upsampling post-processing filter to obtain a third frequency from an input having the second frequency; wherein the signaled information indicates that the picture rate upsampling post-processing filter is to be applied to obtain the second frequency from the input having the first frequency, and that the picture rate upsampling post-processing filter is to be applied to obtain the third frequency from the input having the second frequency. [0006] Example 4: The apparatus of any of examples 1 to 3, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures used as an input for a post-processing filter in the group of the at least one post-processing filter. [0007] Example 5: The apparatus of any of examples 1 to 4, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures used as input for each post-processing filter in the group of the at least one post-processing filter. [0008] Example 6: The apparatus of any of examples 1 to 5, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: infer one or more input pictures for an initial post-processing filter in the group of the at least one post-processing filter; and decode one or more indications identifying input pictures for each subsequent post-processing filter in the group; wherein each subsequent post-processing filter in the group follows the initial postprocessing filter. [0009] Example 7: The apparatus of any of examples 1 to 6, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures for a post-processing filter in the group of the at least one post-processing filter from a neural-network post-filter activation supplemental enhancement information message that is comprised in a processing order nesting supplemental enhancement information message. [0010] Example 8: The apparatus of any of examples 1 to 7, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: decode one or more indications identifying input pictures for a post-processing filter in the group of the at least one post-processing filter from a neural-network post-filter extended activation supplemental enhancement information message. [0011] Example 9: The apparatus of any of examples 1 to 8, wherein the instructions, when executed by the at least one processor, cause the apparatus at least to: derive a list of candidate input pictures for a second or later post-processing filter in the group of the at least one post-processing filter from filtered pictures that are output by previous post-processing filters in the the group of the at least one post-processing filter, when any; interpolated pictures that are output by a postprocessing filter process of previous post-processing filters in the group of the at least one postprocessing filter, when any; and candidate input pictures for a first post-processing filter in the the group of the at