EP-4736430-A1 - STORING AND SIGNALING POST PROCESSING ORDER IN A HEADER

EP4736430A1EP 4736430 A1EP4736430 A1EP 4736430A1EP-4736430-A1

Abstract

Systems, methods, and instrumentalities are disclosed for storing a post processing order in dedicated code in a header of a region (e.g., a slice) and/or a picture. A video encoding and/or decoding device may include a processor configured to determine a post-filter order associated with a sub-region of a region or a picture. The post-filter order may be associated with at least two filters. The post-filter order may indicate a post-filter processing order. The device may send the post-filter order in a region header or a picture header. The device may generate a coding cost and/or a distortion. The coding cost and/or the distortion may be associated with the post-filter processing order.

Inventors

LEFEBVRE, FREDERIC
BOISSON, GUILLAUME
Urban, Fabrice
BORDES, PHILIPPE

Assignees

InterDigital CE Patent Holdings, SAS

Dates

Publication Date: 20260506
Application Date: 20240610

Claims (1)

IDVC_ 2023P00527WO PATENT CLAIMS 1. A video encoding device comprising a processor configured to: determine a post-filter order associated with a sub-region of a region or a picture, wherein the post- filter order is associated with at least two filters, and wherein the post-filter order indicates a post-filter processing order; and send the post-filter order in a region header or a picture header. 2. The video encoding device of claim 1, wherein the processor is further configured to: generate a coding cost and a distortion, wherein the coding cost and the distortion are associated with the post-filter processing order. 3. The video encoding device of any one of claims 1-2, wherein the processor is further configured to determine a luma post-filter order or a chroma post-filter order. 4. The video encoding device of any one of claims 1-2, wherein the processor is further configured to: determine a luma post-filter order; and apply the luma post-filter order to a chroma post-filter order. 5. The video encoding device of any one of claims 3-4, wherein the luma post-filter order is different than the chroma post-filter order. 6. The video encoding device of any one of claims 1-5, wherein the processor is further configured to: when the post-filter order is to be sent to the region header, determine a rate distortion cost for the sub-region of the region. 7. The video encoding device of any one of claims 1-5, wherein the processor is further configured to: when the post-filter order is to be sent to the picture header, determine a rate distortion cost for a sub-region of the picture. 8. The video encoding device of any one of claims 6-7, wherein the processor is further configured to: determine the rate distortion cost based on a distortion of a current block with the current block’s coding parameters, an associated rate or cost, and a parameter derived from a quantization parameter. 9. The video encoding device of any one of claims 1-6, or 8, wherein the sub-region is a coding tree IDVC_ 2023P00527WO PATENT unit (CTU), the region is a slice, and the region header is a slice header. 10. The video encoding device of any one of claims 1-9, wherein the at least two filters comprises a sample-adaptive offset (SAO), a cross-component SAO (CCSAO), an adaptive loop filter, or a deblocking filter. 11. The video encoding device of any one of claims 1-10, wherein the post-filter order indicates that a cross-component sample-adaptive offset (CCSAO) is to be applied before a sample adaptive offset (SAO). 12. A video decoding device comprising a processor configured to: determine a post-filter order associated with a sub-region of a region or a picture, wherein the post- filter order is associated with at least two filters, and wherein the post-filter order indicates a post-filter processing order; and send the post-filter order in a region header or a picture header. 13. The video decoding device of claim 12, wherein the processor is further configured to: generate a coding cost and a distortion, wherein the coding cost and the distortion are associated with the post-filter processing order. 14. The video decoding device of any one of claims 12-13, wherein the processor is further configured to determine a luma post-filter order or a chroma post-filter order. 15. The video decoding device of any one of claims 12-13, wherein the processor is further configured to: determine a luma post-filter order; and apply the luma post-filter order to a chroma post-filter order. 16. The video decoding device of any one of claims 14-15, wherein the luma post-filter order is different than the chroma post-filter order. 17. The video decoding device of any one of claims 12-16, wherein the processor is further configured to: when the post-filter order is to be sent to the region header, determine a rate distortion cost for the sub-region of the region. IDVC_ 2023P00527WO PATENT 18. The video decoding device of any one of claims 12-16, wherein the processor is further configured to: when the post-filter order is to be sent to the picture header, determine a rate distortion cost for a sub-region of the picture. 19. The video decoding device of any one of claims 17-18, wherein the processor is further configured to: determine the rate distortion cost based on a distortion of a current block with the current block’s coding parameters, an associated rate or cost, and a parameter derived from a quantization parameter. 20. The video decoding device of any one of claims 12-17, or 19, wherein the sub-region is a coding tree unit (CTU), the region is a slice, and the region header is a slice header. 21. The video decoding device of any one of claims 12-20, wherein the at least two filters comprises a sample-adaptive offset (SAO), a cross-component SAO (CCSAO), an adaptive loop filter, or a deblocking filter. 22. The video decoding device of any one of claims 12-21, wherein the post-filter order indicates that a cross-component sample-adaptive offset (CCSAO) is to be applied before a sample adaptive offset (SAO). 23. A method for video encoding comprising: determining a post-filter order associated with a sub-region of a region or a picture, wherein the post- filter order is associated with at least two filters, and wherein the post-filter order indicates a post processing order; and sending the post-filter order in a region header or a picture header. 24. The video encoding method of claim 23, further comprising: generating a coding cost and a distortion, wherein the coding cost and the distortion are associated with the post-filter processing order. 25. The video encoding method of any one of claims 23-24, further comprising determining a luma post- filter order or a chroma post-filter order. 26. The video encoding method of any one of claims 23-24, further comprising: determining a luma post-filter order; and IDVC_ 2023P00527WO PATENT applying the luma post-filter order to a chroma post-filter order. 27. The video encoding method of any one of claims 25-26, wherein the luma post-filter order is different than the chroma post-filter order. 28. The video encoding method of any one of claims 23-27, further comprising: when the post-filter order is to be sent to the region header, determining a rate distortion cost for the sub-region of the region. 29. The video encoding method of any one of claims 23-27, further comprising: when the post-filter order is to be sent to the picture header, determining a rate distortion cost for a sub-region of the picture. 30. The video encoding method of any one of claims 28-29, further comprising: determining the rate distortion cost based on a distortion of a current block with the current block’s coding parameters, an associated rate or cost, and a parameter derived from a quantization parameter. 31. The video encoding method of any one of claims 23-28, or 30, wherein the sub-region is a coding tree unit (CTU), the region is a slice, and the region header is a slice header. 32. The video encoding method of any one of claims 23-31, wherein the at least two filters comprises a sample-adaptive offset (SAO), a cross-component SAO (CCSAO), an adaptive loop filter, or a deblocking filter. 33. The video encoding device of any one of claims 23-32, wherein the post-filter order indicates that a cross-component sample-adaptive offset (CCSAO) is to be applied before a sample adaptive offset (SAO). 34. A method for video decoding comprising: determining a post-filter order associated with a sub-region of a region or a picture, wherein the post- filter order is associated with at least two filters, and wherein the post-filter order indicates a post-filter processing order; and sending the post-filter order in a region header or a picture header. 35. The video decoding method of claim 34, further comprising: generating a coding cost and a distortion, wherein the coding cost and the distortion are associated IDVC_ 2023P00527WO PATENT with the post-filter processing order. 36. The video decoding method of any one of claims 34-35, further comprising determining a luma post- filter order or a chroma post-filter order. 37. The video decoding method of any one of claims 34-35, further comprising: determining a luma post-filter order; and applying the luma post-filter order to a chroma post-filter order. 38. The video decoding method of any one of claims 36-37, wherein the luma post-filter order is different than the chroma post-filter order. 39. The video decoding method of any one of claims 34-38, further comprising: when the post-filter order is to be sent to the region header, determining a rate distortion cost for the sub-region of the region. 40. The video decoding method of any one of claims 34-38, further comprising: when the post-filter order is to be sent to the picture header, determining a rate distortion cost for a sub-region of the picture. 41. The video decoding method of any one of claims 39-40, further comprising: determining the rate distortion cost based on a distortion of a current block with the current block’s coding parameters, an associated rate or cost, and a parameter derived from a quantization parameter. 42. The video decoding method of any one of claims 34-39, or 41, wherein the sub-region is a coding tree unit (CTU), the region is a slice, and the region header is a slice header. 43. The video decoding device of any one of claims 34-42, wherein the at least two filters comprises a sample-adaptive offset (SAO), a cross-component SAO (CCSAO), an adaptive loop filter, or a deblocking filter. 44. The video decoding device of any one of claims 34-43, wherein the post-filter order indicates that a cross-component sample-adaptive offset (CCSAO) is to be applied before a sample adaptive offset (SAO). 45. A video encoding device comprising a processor, wherein the processor is configured to implement IDVC_ 2023P00527WO PATENT the steps of a method according to any one of claims 23-33. 46. A video decoding device comprising a processor, wherein the processor is configured to implement the steps of a method according to any one of claims 34-44. 47. A computer program product which is stored on a non-transitory computer readable medium and comprises program code instructions for implementing the steps of a method according to any one of claims 23-33 or 34-44. 48. Video data comprising information representative of the encoded coding block generated according to the method of any one of claims 23-33.

Description

IDVC_ 2023P00527WO PATENT STORING AND SIGNALING POST PROCESSING ORDER IN A HEADER CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims the benefit of European Provisional Patent Application No.23306072.2, filed June 29, 2023, the contents of which are hereby incorporated by reference herein. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. SUMMARY [0003] Systems, methods, and instrumentalities are disclosed for storing a post processing order in dedicated code in a header of a region or a picture. Signaling may be used to define a post-filter order. Signaling may specify an order at the encoder and decoder for post processing. A post processing order may be stored in a header. In examples, the post processing order may be stored in a header associated with a region or a slice, or in a picture header. [0004] In examples, a video coding device may determine a post-filter order associated with a sub- region or a coding tree unit (CTU) of a region (or slice) or a picture. The post-filter order may indicate a post processing order. In an example, cross-component sample-adaptive offset (CCSAO) may be applied before sample adaptive offset (SAO). The post-filter order may be a luma post-filter order or a chroma post- filter order. [0005] The video coding device may send the post-filter order in a region (or slice) header or a picture header. The video coding device may determine a luma post-filter order and apply the luma post-filter order to a chroma post-filter order. The luma post-filter order may be different than the chroma post-filter order. IDVC_ 2023P00527WO PATENT [0006] The video coding device may determine the post-filter order based on (e.g., optimization of) a coding cost and a distortion. The video coding device may determine a rate distortion cost for each sub- region of a region when the post-filter order is sent in a region header. The video coding device may determine a rate distortion cost for each sub-region of a picture when the post-filter order is sent in a picture header. The video coding device may determine the rate distortion cost based on a distortion of a current block with its coding parameters, an associated rate or cost, and/or a parameter derived from a quantization parameter. [0007] Systems, methods, and instrumentalities are disclosed for video encoding. A video encoding device may include a processor configured to determine a post-filter order associated with a sub-region of a region or a picture. The post-filter order may be associated with at least two filters. The post-filter order may indicate a post-filter processing order. The video encoding device may send the post-filter order in a region header or a picture header. [0008] The video encoding device as described herein may include one or more features. In examples, the video encoding device may be configured to generate a coding cost and a distortion. The coding cost and the distortion may be associated with the post-filter processing order. The video encoding device may be configured to determine a luma post-filter order or a chroma post-filter order. The video encoding device may be configured to determine a luma post-filter order. The video encoding device may be configured to apply the luma post-filter order to a chroma post-filter order. In examples, the luma post-filter order may be different than the chroma post-filter order. The video encoding device may be configured to, when the post- filter order is to be sent to the region header, determine a rate distortion cost for the sub-region of the region. [0009] The video encoding device may be configured to when the post-filter order is to be sent to the picture header, determine a rate distortion cost for a sub-region of the picture. The video encoding device may be configured to determine the rate distortion cost based on a distortion of a current block with the current block’s coding parameters, an associated rate or cost, and/or a parameter derived from a quantization parameter. In examples, the sub-region may be a coding tree unit (CTU), the region may be a slice, and the region header may be a slice header. The at least two filters may include a sample-adaptive offset (SAO), a cross-component SAO (CCSAO), an adaptive loop filter, or a deblocking filter. The post-filter order may indicate that a CCSAO is to be applied before a SAO. [0010] Systems, methods, and instrumentalities are disclosed for video decoding. A video decoding device may include a processor configured to determine a post-filter order associated with a sub-region of a region or a picture. The post-filter order may be associated with at least two filters. The post-filter order may indicate a post-filter processing order. The video decoding device may send the