Search

EP-4738839-A1 - CONTROLLERS IN MPEG AVATAR REPRESENTATION FORMAT

EP4738839A1EP 4738839 A1EP4738839 A1EP 4738839A1EP-4738839-A1

Abstract

Some embodiments of a method may include: obtaining a MPEG Avatar Representation Format (MARF)-based file; parsing the MARF-based file into a data structure; selecting an asset from the data structure; verifying the asset comprises a controller set property; obtaining controller set data corresponding to the controller set property; obtaining container data using the controller set data; determining a mime type using the controller set data; decoding the container data using the mime type; obtaining a mesh and a skeleton using the container data; and animating an avatar corresponding to the mesh and the skeleton.

Inventors

  • GOSSELIN, Philippe Henri
  • COVA REGATEIRO, João Pedro
  • LE CLERC, FRANCOIS
  • QUENTIN, Avril

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260506
Application Date
20241101

Claims (15)

  1. A method comprising: obtaining a MPEG Avatar Representation Format (MARF)-based file; parsing the MARF-based file into a data structure; selecting an asset from the data structure; verifying the asset comprises a controller set property; obtaining controller set data corresponding to the controller set property; obtaining container data using the controller set data; determining a mime type using the controller set data; decoding the container data using the mime type; obtaining a mesh and a skeleton using the container data; and animating an avatar corresponding to the mesh and the skeleton.
  2. The method of claim 1, wherein animating the avatar corresponding to the mesh and the skeleton comprises applying one or more transformations to the mesh associated with the avatar.
  3. The method of claim 2, wherein the controller set data comprises the one or more transformations.
  4. The method of any one of claims 1-3, wherein the controller set data comprises a link to a location storing a set of controller data structures corresponding to the avatar.
  5. The method of claim 4, wherein the link comprises a Uniform Resource Identifier (URI).
  6. The method of any one of claims 1-5, wherein the link comprises an index into a data location array.
  7. The method of any one of claims 4-6, further comprising retrieving information corresponding to the avatar using the link.
  8. The method of any one of claims 1-7, wherein the MARF-based file comprises a container corresponding to controller data for the avatar.
  9. The method of any one of claims 1-8, wherein parsing the MARF-based file into a data structure comprises determining one or more links to data structures corresponding to the avatar.
  10. The method of any one of claims 1-9, wherein the data structure complies with a MARF-based format.
  11. The method of any one of claims 1-10, wherein the container data comprises information corresponding to at least one of a mesh, a skeleton, a mime type, and a location of the avatar.
  12. The method of claim 11, wherein the mime type identifies a format of a controller associated with the avatar.
  13. The method of claim 11, wherein the mime type identifies at least one of an Avatar JSON Interchange Format (AJIF)-based format, and a Graphics Library Transmission Format (gITF)-based format.
  14. The method of claim 11, wherein the location of the avatar comprises a Uniform Resource Identifier (URI).
  15. An apparatus comprising: a processor; and a memory storing instructions operative, when executed by the processor, to cause the apparatus to perform the method of any one of claims 1 through 14.

Description

INCORPORATION BY REFERENCE The present application incorporates by reference in their entirety the following applications: International Patent Application Serial No. PCT/EP2024/078214, entitled "AVATAR JSON INTERCHANGE FILE FORMAT" and filed October 8, 2024 (‴214 application"); European Patent Application Serial No. EP24306391, entitled "CARRIAGE FORMAT FOR AVATAR CONTROLLERS" and filed August 23, 2024 ("`391 application"); International Patent Application Serial No. PCT/EP2024/068034, entitled "CONTROLLERS FOR 3D SCENE DESCRIPTIONS" and filed June 26, 2024 (‴034 application"); European Patent Application Serial No. EP24305458, entitled "AVATAR CONTROLLERS IN SCENE DESCRIPTIONS" and filed March 27, 2024 ("`458 application"); European Patent Application Serial No. EP24305094, entitled "AVATAR JSON INTERCHANGE FILE FORMAT" and filed January 15, 2024 (‴094 application"); and European Patent Application Serial No. EP23306167, entitled "CONTROLLERS FOR 3D SCENE DESCRIPTIONS" and filed July 10, 2023 (‴167 application"). BACKGROUND The present application is related to avatar controllers. SUMMARY An example apparatus in accordance with some embodiments may include at least one processor configured to perform any one of the methods described within this application. An example apparatus in accordance with some embodiments may include a computer-readable medium storing instructions for causing one or more processors to perform any one of the methods described within this application. An example apparatus in accordance with some embodiments may include at least one processor and at least one non-transitory computer-readable medium storing instructions for causing the at least one processor to perform any one of the methods described within this application. An example signal in accordance with some embodiments may include a bitstream generated according to any one of the methods described within this application. While the methods and systems in accordance with some embodiments are generally discussed in context of extended reality (XR), some embodiments may be applied to any XR contexts such as, e.g., virtual reality (VR) / mixed reality (MR) / augmented reality (AR) contexts. Also, although the term "head mounted display (HMD)" is used herein in accordance with some embodiments, some embodiments may be applied to a wearable device (which may or may not be attached to the head) capable of, e.g., XR, VR, AR, and/or MR for some embodiments. An example method in accordance with some embodiments may include: obtaining a MPEG Avatar Representation Format (MARF)-based file; parsing the MARF-based file into a data structure; selecting an asset from the data structure; verifying the asset comprises a controller set property; obtaining controller set data corresponding to the controller set property; obtaining container data using the controller set data; determining a mime type using the controller set data; decoding the container data using the mime type; obtaining a mesh and a skeleton using the container data; and animating an avatar corresponding to the mesh and the skeleton. For some embodiments of the example method, animating the avatar corresponding to the mesh and the skeleton comprises applying one or more transformations to the mesh associated with the avatar. For some embodiments of the example method, the controller set data comprises the one or more transformations. For some embodiments of the example method, the controller set data comprises a link to a location storing a set of controller data structures corresponding to the avatar. For some embodiments of the example method, the link comprises a Uniform Resource Identifier (URI). For some embodiments of the example method, the link comprises an index into a data location array. Some embodiments of the example method may further include retrieving information corresponding to the avatar using the link. For some embodiments of the example method, the MARF-based file comprises a container corresponding to controller data for the avatar. For some embodiments of the example method, parsing the MARF-based file into a data structure comprises determining one or more links to data structures corresponding to the avatar. For some embodiments of the example method, the data structure complies with a MARF-based format For some embodiments of the example method, the container data comprises information corresponding to at least one of a mesh, a skeleton, a mime type, and a location of the avatar. For some embodiments of the example method, the mime type identifies a format of a controller associated with the avatar. For some embodiments of the example method, the mime type identifies at least one of an Avatar JSON Interchange Format (AJIF)-based format, and a Graphics Library Transmission Format (gITF)-based format. For some embodiments of the example method, the location of the avatar comprises a Uniform Resource Identifier (URI). An example apparatus in accordance w