EP-4735980-A1 - SCENE DESCRIPTION FRAMEWORK FOR GLOBAL HAPTIC DATA STORAGE

Abstract

Apparatus and methods for providing haptics experiences. In an example embodiment, a 3D scene description file is obtained, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; and at least a first node object, the first node object including a reference to at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file. More than one node object may reference the same haptic element. A root-level haptics object may be used that includes an array of material elements that may be referenced by different mesh objects. More than one mesh object may reference the same material element.

Inventors

• GALVANE, Quentin
• HIRTZLIN, PATRICE
• JOUET, PIERRICK
• LELIEVRE, SYLVAIN
• GUILLOTEL, PHILIPPE
• LECUYER, Gurvan

Assignees

• InterDigital CE Patent Holdings, SAS

Dates

Publication Date

20260506

Application Date

20240704

Claims (15)

1. 1 . A method comprising: obtaining a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file; and presenting the 3D scene to a user, wherein the first node object is presented with a haptic property described by the first media file.
2. 2. An apparatus comprising one or more processors configured to perform at least: obtaining a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file; and presenting the 3D scene to a user, wherein the first node object is presented with a haptic property described by the first media file.
3. 3. The method of claim 1 or the apparatus of claim 2, wherein the information associating the first node object with the first one of the haptic elements includes an index associated with the first node object, the index identifying the first one of the haptic elements.
4. 4. The method of claim 1 or claim 3 as it depends from claim 1 , or the apparatus of claim 2 or claim 3 as it depends from claim 2, wherein the 3D scene description file further includes: at least a second root-level haptic object, the second root-node haptic object including an array of material elements, each material element describing a haptic property of a material; and at least a first mesh object, the first mesh object including a reference to at least a first one of the material elements in the array of material elements; wherein presenting the 3D scene to a user comprises presenting the first mesh object is presented with a haptic property described by the first material element.
5. 5. The method of claim 1 or claims 4-3 as they depend from claim 1 , or the apparatus of claim 2 or claims 3-4 as they depend from claim 2, wherein each of the material elements includes a reference to a 2D texture map.
6. 6. The method of claim 5 as it depends from claim 1 , or the apparatus of claim 5 as it depends from claim 2, wherein the 2D texture map associates each of a plurality of taxels with at least one physical property.
7. 7. The method of claim 6 as it depends from claim 1 , or the apparatus of claim 6 as it depends from claim 2, wherein the at least one physical property comprises one or more of: stiffness, friction, vibrotactile texture, temperature, or vibration.
8. 8. The method of claim 6 as it depends from claim 1 , or the apparatus of claim 6 as it depends from claim 2, wherein the 2D texture map associates at least one of the taxels with an associated media source.
9. 9. The method of any of claims 3-8 as they depend from claim 1 , or the apparatus of claims 3-8 as they depend from claim 2, wherein the 3D scene description file is in a JSON format.
10. 10. The method of any of claims 3-9 as they depend from claim 1 , or the apparatus of claims 3-9 as they depend from claim 2, wherein the 3D scene description file is in a gITF format.
11. 11 . A method comprising: generating a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; and at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file.
12. 12. An apparatus comprising one or more processors configured to perform at least: generating a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; and at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file.
13. 13. The method of claim 11 or the apparatus of claim 12, wherein the information associating the first node object with the first one of the haptic elements includes an index associated with the first node object, the index identifying the first one of the haptic elements.
14. 14. The method of claim 11 or claim 13 as it depends from claim 11 , or the apparatus of claim 12 or claim 13 as it depends from claim 12, wherein the 3D scene description file further includes: at least a second root-level haptic object, the second root-node haptic object including an array of material elements, each material element describing a haptic property of a material; and at least a first mesh object, the first mesh object including a reference to at least a first one of the material elements in the array of material elements.
15. 15. A computer-readable medium storing a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; and at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file.

Description

SCENE DESCRIPTION FRAMEWORK FOR GLOBAL HAPTIC DATA STORAGE CROSS REFERENCE [0001] This application claims the priority of European Patent Application No. 23306226.4, filed 17 July 2023, entitled “Scene Description Framework for Global Haptic Data Storage,” which is incorporated herein by reference in its entirety. BACKGROUND [0002] The present disclosure relates to encoding, delivery, decoding, and processing of haptics data. [0003] Haptics refers to the sense of touch and includes two dimensions, tactile and kinesthetic. The first one relates to tactile sensations such as friction, roughness, hardness, temperature and is felt through the mechanoreceptors of the skin (Merkel cell, Ruffini ending, Meissner corpuscle, Pacinian corpuscle), and thermoreceptors. The second one is linked to the sensation of force/torque, position, motion/velocity provided by the muscles, tendons, and the mechanoreceptors in the joints. [0004] Haptics can be considered as a top-level medium such as images or audio. It is now part of the MPEG standardization process that standardizes a haptic codec and associated information. SUMMARY [0005] A method according to some embodiments comprises: obtaining a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file; and presenting the 3D scene to a user, wherein the first node object is presented with a haptic property described by the first media file. [0006] An apparatus according to some embodiments comprises one or more processors configured to perform at least: obtaining a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; at least a first node object; and information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file; and presenting the 3D scene to a user, wherein the first node object is presented with a haptic property described by the first media file. [0007] In some embodiments, the information associating the first node object with the first one of the haptic elements includes an index associated with the first node object, the index identifying the first one of the haptic elements. [0008] In some embodiments, the 3D scene description file further includes: at least a second root-level haptic object, the second root-node haptic object including an array of material elements, each material element describing a haptic property of a material; and at least a first mesh object, the first mesh object including a reference to at least a first one of the material elements in the array of material elements; wherein presenting the 3D scene to a user comprises presenting the first mesh object is presented with a haptic property described by the first material element. [0009] In some embodiments, each of the material elements includes a reference to a 2D texture map. In some such embodiments, the 2D texture map associates each of a plurality of taxels with at least one physical property. [0010] In some embodiments, the at least one physical property comprises one or more of: stiffness, friction, vibrotactile texture, temperature, or vibration. [0011] In some embodiments, the 2D texture map associates at least one of the taxels with an associated media source. [0012] In some embodiments, the 3D scene description file is in a JSON format, such as a gITF format. [0013] A method according to some embodiments comprises: generating a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one reference to a media file; and at least a first node object; and [0014] information associating the first node object with at least a first one of the haptic elements in the array of haptic elements, the first one of the haptic elements including a reference to a first media file. [0015] An apparatus according to some embodiments comprising one or more processors configured to perform at least: generating a 3D scene description file, wherein the scene description file includes: at least a first one root-node haptic object, the first root-level haptic object including an array of haptic elements, each haptic element including at least one referen