Search

US-12627839-B2 - Signaling CMAF switching sets in ISOBMFF using extended track selection box

US12627839B2US 12627839 B2US12627839 B2US 12627839B2US-12627839-B2

Abstract

There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining International Organization for Standardization base media file format (ISOBMFF) files associated with a video data, determining from the ISOBMFF files at least one of a track selection box indicating properties of switching sets of the ISOBMFF files and a track group box indicating a hierarchical grouping of track groups, and decoding the video data based on the at least one of the track selection box and the track group box.

Inventors

  • Iraj Sodagar

Assignees

  • Tencent America LLC

Dates

Publication Date
20260512
Application Date
20240110

Claims (14)

  1. 1 . A method for decoding media, the method being performed by at least one processor, the method comprising: obtaining International Organization for Standardization base media file format (ISOBMFF) files associated with a video data; determining, from the ISOBMFF files, a track selection box indicating properties of switching sets of the ISOBMFF files and a track group box indicating a hierarchical grouping of track groups, of which the track selection box specifies: a group of tracks, a switch group of groups, including the group of tracks, of the ISOBMFF files, whether the switch group of the groups belongs to another group, an aligned common media application format (CMAF) switching set, a CMAF switching set with a single initialization segment for all of the tracks, whether an initialization segment may be used for any track in the switch group, and a CMAF structural brand of the tracks, the track group box specifies: the CMAF switching set, the CMAF switching set with the single initialization segment for all of tracks of the ISOBMFF files, that the initialization segment may be used for any track in the switch group, and the CMAF structural brand of the tracks, and the track group box is included in a track group description box comprising an array of track group entry boxes each of which indicating characteristics of ones of track groups including the group of tracks; and decoding the video data based on the track selection box and the track group box.
  2. 2 . The method according to claim 1 , wherein the track selection box is contained in a user data box of a track that the track selection box modifies.
  3. 3 . The method according to claim 1 , wherein the track group box specifies that a track grouped by a CMAF switching track group is a track with an alternate group equal to an ID of the CMAF switching track group.
  4. 4 . The method according to claim 1 , wherein the track group box indicates a reference from a cmsg box to a prse box of an ISOBMFF moov box, and all CMAF switching groups with at least one contributing track having a track_in_movie flag set to 1 are qualified by CMAFSwitchingGroupEntryBoxes describing only track groups identified by a track_group_type equal to cmsg.
  5. 5 . The method according to claim 1 , wherein the track group description box comprises another track group entry box, other than the track group entry boxes of the array of track group entry boxes, pointing to a preselection track group entry box comprising CMAF track group boxes.
  6. 6 . The method according to claim 5 , wherein a second track group entry box, of the array of track group entry boxes of the track group description box, comprises a same track group entry type as the track group entry box and comprises a different track group identifier than the track group entry box.
  7. 7 . The method according to claim 6 , wherein the same track group entry type indicates a 4CC code.
  8. 8 . A apparatus for video streaming, the apparatus comprising: at least one memory configured to store computer program code; at least one processor configured to access the computer program code and operate as instructed by the computer program code, the computer program code including: obtaining code configure to cause the at least one processor to obtain International Organization for Standardization base media file format (ISOBMFF) files associated with a video data; determining code configure to cause the at least one processor to determine from the ISOBMFF files a track selection box indicating properties of switching sets of the ISOBMFF files and a track group box indicating a hierarchical grouping of track groups, of which the track selection box specifies: a group of tracks, a switch group of groups, including the group of tracks, of the ISOBMFF files, whether the switch group of the groups belongs to another group, an aligned common media application format (CMAF) switching set, a CMAF switching set with a single initialization segment for all of the tracks, whether an initialization segment may be used for any track in the switch group, and a CMAF structural brand of the tracks, the track group box specifies: the CMAF switching set, the CMAF switching set with the single initialization segment for all of tracks of the ISOBMFF files, that the initialization segment may be used for any track in the switch group, and the CMAF structural brand of the tracks, and the track group box is included in a track group description box comprising an array of track group entry boxes each of which indicating characteristics of ones of track groups including the group of tracks; and decoding code configure to cause the at least one processor to decode the video data based on the track selection box and the track group box.
  9. 9 . The apparatus according to claim 8 , wherein the track selection box is contained in a user data box of a track that the track selection box modifies.
  10. 10 . The apparatus according to claim 8 , wherein the track group box specifies that a track grouped by a CMAF switching track group is a track with an alternate group equal to an ID of the CMAF switching track group.
  11. 11 . The apparatus according to claim 8 , wherein the track group box indicates a reference from a cmsg box to a prse box of an ISOBMFF moov box, and all CMAF switching groups with at least one contributing track having a track_in_movie flag set to 1 are qualified by CMAFSwitchingGroupEntryBoxes describing only track groups identified by a track_group_type equal to cmsg.
  12. 12 . The apparatus according to claim 8 , wherein the track group description box comprises another track group entry box, other than the track group entry boxes of the array of track group entry boxes, pointing to a preselection track group entry box comprising CMAF track group boxes.
  13. 13 . The apparatus according to claim 12 , wherein a second track group entry box, of the array of track group entry boxes of the track group description box, comprises a same track group entry type as the track group entry box and comprises a different track group identifier than the track group entry box.
  14. 14 . A non-transitory computer readable medium storing a program causing a computer to execute a process, the process comprising: obtaining International Organization for Standardization base media file format (ISOBMFF) files associated with a video data; determining from the ISOBMFF files a track selection box indicating properties of switching sets of the ISOBMFF files and a track group box indicating a hierarchical grouping of track groups, of which the track selection box specifies: a group of tracks, a switch group of groups, including the group of tracks, of the ISOBMFF files, whether the switch group of the groups belongs to another group, an aligned common media application format (CMAF) switching set, a CMAF switching set with a single initialization segment for all of the tracks, whether an initialization segment may be used for any track in the switch group, and a CMAF structural brand of the tracks, the track group box specifies: the CMAF switching set, the CMAF switching set with the single initialization segment for all of tracks of the ISOBMFF files, that the initialization segment may be used for any track in the switch group, and the CMAF structural brand of the tracks, and the track group box is included in a track group description box comprising an array of track group entry boxes each of which indicating characteristics of ones of track groups including the group of tracks; and decoding the video data based on the track selection box and the track group box.

Description

CROSS REFERENCE TO RELATED APPLICATION The present application claims priority to provisional application U.S. 63/438,480, filed on Jan. 11, 2023, and to provisional application 63/460,562, filed on Apr. 19, 2023, the contents of which are hereby expressly incorporated by reference, in their entirety, into the present application. BACKGROUND 1. Field The present disclosure is directed to signaling Common Media Application Format (CMAF) Switching sets in the International Organization for Standardization base media file format (ISOBMFF) file, the properties of the switching sets, and the associated tracks using a new version of the ISOBMFF switching groups. Embodiments herein also provide signaling of multi-level grouping of tracks in an ISOBMFF file where at each level of track grouping, the properties of that grouping is defined. 2. Description of Related Art ISOBMFF is a widely used file format for media content. The CMAF standard defines common media format tracks that can be grouped as switching sets. The CMAF switching sets are used for delivering media with alternative tracks. The alternative tracks represent the same content but they have different attributes such as bitrate, resolution, frame rate, and other possible characteristics. While the CMAF standard uses ISOBMFF as the track format, it does not include any specific method for signaling the existence of CMAF switching sets. Up to now, out-of-band signaling such as DASH manifest is used for such signaling. There is no defined standard method for signaling the existence of CMAF switching sets in an ISOBMFF file. There is also no efficient solution in ISOBMFF standards that allows a multiple-level grouping of tracks, for instance, a preselection grouping of CMAF switching sets. SUMMARY To address those technical problems, embodiments herein represent a design that uses two boxes. A new version of the track selection box that provides information about switching sets, switchable switching sets, selectable sets, and the general properties of the switching sets. In the track group box to provide switching group parameters for the entire file. As such, there is hereby disclosed a method for signaling the existence, the association of tracks and properties of one or more CMAF switching sets in an ISOBMFF file, wherein the identification of switching set is signaled using a new switching group box, wherein it contains also possible switchable switching sets, where the switching is possible to cross switch groups, wherein the selectable switching groups are also signaled and the properties of each switching group are described. To further address those technical problems, embodiments herein further represent the definition, use, and signaling of a track group box in the track group entry box enabling the hierarchical grouping of the track groups without addition of any new parameters. As such, there is provided a method of defining the hierarchical track groups in ISOBMFF files where a track group can be a member of another track group, wherein a multi-level grouping of tracks can be achieved, wherein the addition of the track group description box to the track group entry box allows the entry box to become a member of another track group box, and the properties of this track entry box as a member of the other track group box expressed, wherein a track entry box can be a member of more than one track group by including two or more track group boxes in it wherein such design allows flexible multi-level multi-branch hierarchical track grouping where a track group can be a member of multiple track groups and therefore share various and different properties with different track groups. To address one or more different technical problems, there is included a method and apparatus comprising memory configured to store computer program code and a processor or processors configured to access the computer program code and operate as instructed by the computer program code. The computer program code includes obtaining code configured to cause the one or more processors to obtain International Organization for Standardization base media file format (ISOBMFF) files associated with a video data; determining code configured to cause the one or more processors to determine from the ISOBMFF files at least one of a track selection box indicating properties of switching sets of the ISOBMFF files and a track group box indicating a hierarchical grouping of track groups; and decoding code configured to cause the one or more processors to decode the video data based on the at least one of the track selection box and the track group box. The track selection box may be contained in a user data box of a track that the track selection box modifies The track selection box may specify any one or more of a group of tracks, a switch group of groups, including the group of tracks, of the ISOBMFF files, whether the switch group of the groups belongs to another group, an aligned common