Search

EP-3972277-B1 - VERSATILE VIDEO CODING TRACK CODING

EP3972277B1EP 3972277 B1EP3972277 B1EP 3972277B1EP-3972277-B1

Inventors

  • WANG, YE-KUI

Dates

Publication Date
20260506
Application Date
20210916

Claims (8)

  1. A method of processing visual media data, comprising: performing (8002) a conversion between a visual media file and a bitstream of visual media data according to a format rule, wherein the format rule specifies a condition that controls whether an information item is included in a versatile video coding, VVC, non-video coding layer, non-VCL, track of the visual media file, and wherein a presence of the VVC non-VCL track in the visual media file is indicated by a specific track reference in a VVC track of the visual media file, and wherein the condition specifies that picture header network abstraction layer units for a video stream is the information item that is stored either in a first set of samples of VVC tracks containing video coding layer network abstraction layer units or in a second set of samples of VVC non-VCL tracks but not both at a same time.
  2. The method of claim 1, wherein the condition specifies that the VVC non-VCL track includes adaptation parameter sets as the information item, wherein the adaptation parameter sets include adaptive loop filter parameters, luma mapping with chroma scaling parameters, or scaling list parameters, and wherein the condition specifies that the adaptation parameter sets are stored in and transmitted through a track that is separate from another track that includes video coding layer network abstraction layer units.
  3. The method of claim 2, wherein the condition allows the VVC non-VCL track to additionally include other types of non-VCL network abstraction layer units.
  4. The method of claim 2, wherein the condition disallows the VVC non-VCL track to additionally include other types of non-VCL network abstraction layer units.
  5. The method of any of claims 1-4, wherein the conversion comprises generating the visual media file and storing the bitstream to the visual media file according to the format rule.
  6. The method of any of claims 1-4, wherein the conversion comprises parsing the visual media file according to the format rule to reconstruct the bitstream.
  7. An apparatus (3600) for processing visual media data comprising a processor (3602) and a non-transitory memory (3604) with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to implement a method recited in any one or more of claims 1 to 6.
  8. A non-transitory computer-readable storage medium storing instructions that cause a processor to implement a method recited in any one or more of claims 1 to 6.

Description

CROSS REFERENCE TO RELATED APPLICATIONS Under the applicable patent law and/or rules pursuant to the Paris Convention, this application is made to timely claim the priority to and benefits of U.S. Provisional Patent Application No. 63/079,869, filed on September 17, 2020. TECHNICAL FIELD This patent document relates to generation, storage and consumption of digital audio video media information in a file format. BACKGROUND Digital video accounts for the largest bandwidth use on the internet and other digital communication networks. As the number of connected user devices capable of receiving and displaying video increases, it is expected that the bandwidth demand for digital video usage will continue to grow. "Text of ISO/IEC 14496-15:2019 DAM 2 Carriage of VVC and EVC in IOSBMFF", 131. MPEG Meeting; 20200629 - 20200703; Online, concerns the carriage of NAL unit structured video in the ISO base media file format. Jean le Feuvre (Telecom-Paris) et al: "Dynamic independent ROIs in VVC file format", 129. MPEG Meeting; 20200113 - 20200117; Brussels, discusses high level features of the future VCC file format for spatial access into a VCC file. Y-K Wang (Futurewei) et al: "On VVC file format", 127. MPEG Meeting; 20190708 - 20190712; Gothenburg, propose a file format design for storing of VCC video content based on the ISO base media file format. SUMMARY It is therefore the object of the present invention to provide an improved method of processing visual media data, and a corresponding apparatus for processing visual media data and a corresponding computer-readable storage medium storing instructions for implementing the method. This object is solved by the subject matter of the independent claims. Preferred embodiments are defined by the dependent claims. The present document discloses techniques that can be used by video encoders and decoders for processing coded representation of a video or an image according to a file format. In one example aspect, a video processing method is disclosed. The method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies a condition that controls whether an information item is included in a non-video coding layer track of the visual media file, and where a presence of the non-video coding layer track in the visual media file is indicated by a specific track reference in a video coding layer track of the visual media file. In another example aspect, a video processing method is disclosed. The method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that a type of a sample entry determines whether decoding capability information network abstraction layer units are included in either the sample entry of a video track in the visual media file or in a sample of the video track and the sample entry of the video track in the visual media file. In another example aspect, a video processing method is disclosed. The method includes performing a conversion between a visual media data and a file that stores information corresponding to the visual media data according to a format rule; wherein the format rule specifies a first condition for identifying a non-video coding layer (VCL) track of the file and/or a second condition for identifying a VCL track of the file. In yet another example aspect, a video encoder apparatus is disclosed. The video encoder comprises a processor configured to implement above-described methods. In yet another example aspect, a video decoder apparatus is disclosed. The video decoder comprises a processor configured to implement above-described methods. In yet another example aspect, a computer readable medium having code stored thereon is disclose. The code embodies one of the methods described herein in the form of processor-executable code. In yet another example aspect, a computer readable medium having a bitstream stored thereon is disclosed. The bitstream is generated or processed using a method described in the present document. These, and other, features are described throughout the present document. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a block diagram of an example video processing system.FIG. 2 is a block diagram of a video processing apparatus.FIG. 3 is a flowchart for an example method of video processing.FIG. 4 is a block diagram that illustrates a video coding system in accordance with some embodiments of the present disclosure.FIG. 5 is a block diagram that illustrates an encoder in accordance with some embodiments of the present disclosure.FIG. 6 is a block diagram that illustrates a decoder in accordance with some embodiments of the present disclosure.FIG. 7 shows an example of encoder block diagram.FIGS. 8 to 9 are flowcharts for example methods of video processing. DETAILED DESCRIPTION Section headings are used in the present docu