Search

EP-4736457-A1 - LOW COMPLEXITY MULTIPLANE IMAGE PROFILE

EP4736457A1EP 4736457 A1EP4736457 A1EP 4736457A1EP-4736457-A1

Abstract

Systems, methods, and instrumentalities are disclosed for using a low complexity multiplane image (MPI) profile for an MPEG immersive video (MIV) standard. For example, a video encoding and/or decoding device may receive a representation of an MlV-encoded volumetric video that is encoded using a MPI format. The representation of the MlV-encoded volumetric video may be received via a single video bitstream. The device may receive an indication of a set of MPI parameters and a set of MIV parameters associated with an MlV-encoded volumetric video. The device may determine that the set of MPI parameters and the set of MIV parameters are associated with a low complexity configuration. The low complexity configuration may limit a rendering complexity of the MlV-encoded volumetric video. The device may encode and/or decode the representation of the MlV-encoded volumetric video based on the set of MPI parameters and the set of MIV parameters.

Inventors

  • CHUPEAU, BERTRAND
  • GALPIN, FRANCK
  • THUDOR, FRANCK

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260506
Application Date
20240711

Claims (20)

  1. 1 . A video decoding device comprising a processor configured to: receive a representation of an MPEG immersive video (MlV)-encoded volumetric video that is encoded using a multiplane image (MPI) format, wherein the representation of the MlV-encoded volumetric video is received via a single video bitstream; receive an indication of a set of MPI parameters and a set of MIV parameters associated with an MlV-encoded volumetric video; determine that the set of MPI parameters and the set of MIV parameters are associated with a low complexity configuration, wherein the low complexity configuration limits a rendering complexity of the MlV-encoded volumetric video; and decode the representation of the MlV-encoded volumetric video based on the set of MPI parameters and the set of MIV parameters.
  2. 2. The video decoding device of claim 1 , wherein the processor is further configured to: receive at least one constraint for the set of MPI parameters and the set of MIV parameters, and determine that the set of MPI parameters and the set of MIV parameters are associated with the low complexity configuration based on the at least one constraint.
  3. 3. The video decoding device of any one of claims 1-2, wherein the processor is further configured to: receive an indication of an MIV profile, wherein the MIV profile is associated with the low complexity configuration; and determine at least one parameter from the set of MPI parameters and the set of MIV parameters based on the indication of the MIV profile.
  4. 4. The video decoding device of any one of claims 1-3, wherein the indication of the set of MPI parameters and the set of MIV parameters are received via a supplemental enhancement information (SEI) message.
  5. 5. The video decoding device of any one of claims 1-4, wherein the set of MPI parameters associated with the MlV-encoded volumetric video comprises at least one of a number of MPI layers, a placement of layers, or a number of reference cameras.
  6. 6. The video decoding device of any one of claims 1-4, wherein the set of MPI parameters comprises a number of MPI layers, wherein the number of MPI layers is associated with a maximum number of layers based on the low complexity configuration, and wherein the processor is further configured to: determine that the set of MPI parameters and the set of MIV parameters are associated with the low complexity configuration based on the number of MPI layers.
  7. 7. The video decoding device of any one of claims 5 or 6, wherein the number of MPI layers is 16 or 32.
  8. 8. The video decoding device of any one of claims 1-7, wherein the set of MIV parameters associated with the MlV-encoded volumetric video comprises at least one of a number of complete layers, an indication of frame packing, or a level limit.
  9. 9. The video decoding device of any one of claims 1-7, wherein the set of MIV parameters associated with the MlV-encoded volumetric video comprises a level limit, wherein the level limit is associated with a single atlas, a pixel rate, or a bit rate.
  10. 10. The video decoding device of any one of claims 1-9, wherein the processor is further configured to: receive a patch atlas using the MlV-encoded volumetric video, the patch atlas comprising one or more patches, wherein the one or more patches are associated with texture or transparency information of at least one layer of the MlV-encoded volumetric video; and decode the representation of the MlV-encoded volumetric video further based on the patch atlas.
  11. 11. The video decoding device of any one of claims 1-9, wherein the processor is further configured to: receive a patch atlas using the MlV-encoded volumetric video, the patch atlas comprising one or more patches, wherein each patch of the one or more patches represents a complete layer; and decode the representation of the MlV-encoded volumetric video further based on the patch atlas.
  12. 12. A video encoding device comprising a processor configured to: receive a representation of an MPEG immersive video (MlV)-encoded volumetric video that is encoded using a multiplane image (MPI) format, wherein the representation of the MlV-encoded volumetric video is received via a single video bitstream; receive an indication of a set of MPI parameters and a set of MIV parameters associated with an MlV-encoded volumetric video; determine that the set of MPI parameters and the set of MIV parameters are associated with a low complexity configuration, wherein the low complexity configuration limits a rendering complexity of the MlV-encoded volumetric video; and encode the representation of the MlV-encoded volumetric video based on the set of MPI parameters and the set of MIV parameters.
  13. 13. The video encoding device of claim 12, wherein the processor is further configured to: receive at least one constraint for the set of MPI parameters and the set of MIV parameters, and determine that the set of MPI parameters and the set of MIV parameters are associated with the low complexity configuration based on the at least one constraint.
  14. 14. The video encoding device of any one of claims 12-13, wherein the processor is further configured to: receive an indication of an MIV profile, wherein the MIV profile is associated with the low complexity configuration; and determine at least one parameter from the set of MPI parameters and the set of MIV parameters based on the indication of an MIV profile.
  15. 15. The video encoding device of any one of claims 12-14, wherein the indication of the set of MPI parameters and the set of MIV parameters are received via a supplemental enhancement information (SEI) message.
  16. 16. The video encoding device of any one of claims 12-15, wherein the set of MPI parameters associated with the MlV-encoded volumetric video are associated with at least one of a number of MPI layers, a placement of layers, or a number of reference cameras.
  17. 17. The video encoding device of any one of claims 12-15, wherein the set of MPI parameters comprises a number of MPI layers, wherein the number of MPI layers is associated with a maximum number of layers based on the low complexity configuration, and wherein the processor is further configured to: determine that the set of MPI parameters and the set of MIV parameters are associated with the low complexity configuration based on the number of MPI layers.
  18. 18. The video encoding device of any one of claims 16 or 17, wherein the number of MPI layers is 16 or 32.
  19. 19. The video encoding device of any one of claims 12-18, wherein the set of MIV parameters associated with the MlV-encoded volumetric video comprises at least one of a number of complete layers, an indication of frame packing, or a level limit.
  20. 20. The video encoding device of any one of claims 12-18, wherein the set of MIV parameters comprises a level limit, wherein the level limit is associated with a single atlas, a pixel rate, or a bit rate.

Description

LOW COMPLEXITY MULTIPLANE IMAGE PROFILE CROSS-REFERENCE TO RELATED APPLICATIONS [0001] This application claims the benefit of European Provisional Patent Application No. 23306246.2, filed July 19, 2023, the contents of which are hereby incorporated by reference herein. BACKGROUND [0002] Video coding systems may be used to compress digital video signals, e.g., to reduce the storage and/or transmission bandwidth needed for such signals. Video coding systems may include, for example, block-based, wavelet-based, and/or object-based systems. Some video coding mechanisms may not be suitable for certain types of decoding/rendering devices. SUMMARY [0003] Systems, methods, and instrumentalities are disclosed for providing and/or using a low complexity multiplane image (MPI) profile (e.g., for the MPEG immersive video (MIV) coded content). [0004] For example, a video encoding and/or decoding device may include a processor. The device may be configured to receive a representation of an MlV-encoded volumetric video that may be encoded using a MPI format. The representation of the MlV-encoded volumetric video may be received via a single video bitstream. The device may receive an indication of a set of MPI parameters and/or a set of MIV parameters associated with an MlV-encoded volumetric video. The device may determine that the set of MPI parameters and/or the set of MIV parameters are associated with a low complexity configuration. The low complexity configuration may limit the rendering complexity of the MlV-encoded volumetric video. The device may encode and/or decode the representation of the MlV-encoded volumetric video based on the set of MPI parameters and/or the set of MIV parameters. [0005] One or more of features may be included. In examples, the device may receive at least one constraint for the set of MPI parameters and/or the set of MIV parameters. The device may determine that the set of MPI parameters and/or the set of MIV parameters are associated with the low complexity configuration based on the at least one constraint. The device may receive an indication of an MIV profile. The MIV profile may be associated with the low complexity configuration. The device may determine at least one parameter from the set of MPI parameters and/or the set of MIV parameters based on the indication of the MIV profile. The indication of the set of MPI parameters and/or the set of MIV parameters may be received via a supplemental enhancement information (SEI) message. [0006] The set of MPI parameters associated with the MlV-encoded volumetric video may include at least one of a number of MPI layers, a placement of layers, or a number of reference cameras. The number of MPI layers may be associated with a maximum number of layers based on the low complexity configuration. The device may determine that the set of MPI parameters and the set of MIV parameters are associated with the low complexity configuration based on the number of MPI layers. The number of MPI layers is 16 or 32. The set of MIV parameters associated with the MlV-encoded volumetric video may include at least one of a number of complete layers, an indication of frame packing, or a level limit. The level limit may be associated with a single atlas, a pixel rate, or a bit rate. [0007] A video encoding and/or decoding method may include receiving a representation of an MlV- encoded volumetric video that may be encoded using a MPI format. The representation of the MlV- encoded volumetric video may be received via a single video bitstream. The method may include receiving an indication of a set of MPI parameters and/or a set of MIV parameters associated with an MlV-encoded volumetric video. The method may include encoding determining that the set of MPI parameters and/or the set of MIV parameters are associated with a low complexity configuration. The low complexity configuration may limit the rendering complexity of the MlV-encoded volumetric video. The method may include encoding and/or decoding the representation of the MlV-encoded volumetric video based on the set of MPI parameters and/or the set of MIV parameters. [0008] One or more of features may be included. In examples, the method may include receiving at least one constraint for the set of MPI parameters and/or the set of MIV parameters. The method may include determining that the set of MPI parameters and/or the set of MIV parameters are associated with the low complexity configuration based on the at least one constraint. The method may include receiving an indication of an MIV profile. The MIV profile may be associated with the low complexity configuration. The method may include determining at least one parameter from the set of MPI parameters and/or the set of MIV parameters based on the indication of the MIV profile. The indication of the set of MPI parameters and/or the set of MIV parameters may be received via a supplemental enhancement information (SEI) message. [0009] The set of MPI paramet