CN-122003872-A - Controller user interface coding in a scene description

CN122003872ACN 122003872 ACN122003872 ACN 122003872ACN-122003872-A

Abstract

In an exemplary method, the runtime asset delivery file includes a controller syntax structure that defines associations between weight ranges and corresponding output transformations. The file also includes a user interface grammar structure that identifies at least one associated controller grammar structure and at least one location. At least one user interface element is displayed at a location identified by the first user interface syntax structure. User input indicating a first weight is received through a first user interface element. A first output transform associated with the first weight is determined based on a first controller grammar structure identified by the first user interface grammar structure. At least one node in the scene is transformed by applying a first output transform to nodes associated with the first controller syntax structure.

Inventors

P. H. Gosling
J. P. Kova Regatello
LECLERCQ FRANCOIS
Q. Afriel

Assignees

交互数字CE专利控股有限公司

Dates

Publication Date: 20260508
Application Date: 20240927
Priority Date: 20231004

Claims (15)

1. A method, comprising: Obtaining a runtime asset delivery file for a 3D scene, the file comprising a plurality of controller grammar structures, each controller grammar structure defining an association between a weight range and a respective output transformation of at least one association node in the scene, and a plurality of user interface grammar structures, each user interface grammar structure comprising information identifying at least one associated controller grammar structure and at least one association location; For at least a first one of the user interface grammar structures, causing display of at least a first user interface element at the associated location; receiving, by the first user interface element, user input indicating a first weight; determining a first output transform associated with the first weight based on a first controller grammar structure identified by the first user interface grammar structure, and A transformed node is generated by applying the first output transform to a node associated with the first controller syntax structure.
2. An apparatus comprising one or more processors, the one or more processors are configured to perform at least: Obtaining a runtime asset delivery file for a 3D scene, the file comprising a plurality of controller grammar structures, each controller grammar structure defining an association between a weight range and a respective output transformation of at least one association node in the scene, and a plurality of user interface grammar structures, each user interface grammar structure comprising information identifying at least one associated controller grammar structure and at least one association location; For at least a first one of the user interface grammar structures, causing display of at least a first user interface element at the associated location; receiving, by the first user interface element, user input indicating a first weight; determining a first output transform associated with the first weight based on a first controller grammar structure identified by the first user interface grammar structure, and A transformed node is generated by applying the first output transform to a node associated with the first controller syntax structure.
3. The method of claim 1 or the apparatus of claim 2, further comprising causing the transformed node to be displayed.
4. A method as claimed in claim 1, or claim 3 when dependent on claim 1, or claim 2, or claim 3 when dependent on claim 2, wherein the transformed node and the user interface element are displayed simultaneously.
5. The method of claim 1, or of claims 3-4 when dependent on claim 1, or the apparatus of claim 2, or of claims 3-4 when dependent on claim 2, wherein the first user interface element comprises a cursor movable along a line between a start point and an end point, and wherein the first weight is indicated by a position of the cursor within the range.
6. The method of claim 1, or of claims 3-4 when dependent on claim 1, or the apparatus of claim 2, or of claims 3-4 when dependent on claim 2, wherein: The first user interface grammar structure defines a rectangular or elliptical two-dimensional shape; The first user interface element includes a cursor movable within the two-dimensional shape; The first weight being indicated by a vertical position of the cursor within the two-dimensional shape, and The second weight is indicated by a horizontal position of the cursor within the two-dimensional shape.
7. The method of claim 1, or of claims 3-6 when dependent on claim 1, or the apparatus of claim 2, or of claims 3-6 when dependent on claim 2, further comprising: determining a second output transformation associated with the second weight based on a second controller syntax structure in the runtime asset delivery file; Wherein generating the transformed node further comprises applying the second output transform to the node associated with the first controller syntax structure.
8. The method of claim 1, or of claims 3-7 when dependent on claim 1, or the apparatus of claim 2, or of claims 3-7 when dependent on claim 2, wherein the first output transformation comprises at least one of a rotation, a translation, a scaling change, and a change in morphing target weights.
9. The method of claim 1, or claims 3-8 when dependent on claim 1, or the apparatus of claim 2, or claims 3-8 when dependent on claim 2, further comprising, after receiving the user input indicating the first weight, storing the first weight in the runtime asset delivery file.
10. A method, comprising: Encoding at least one node in a runtime asset delivery file for a 3D scene; Encoding a plurality of controller syntax structures in the runtime asset delivery file, each controller syntax structure defining an association between an input weight range and a respective output transformation of at least one associated node in the scene, and A plurality of user interface syntax structures are encoded in the runtime asset delivery file, each user interface syntax structure including information identifying at least one associated controller syntax structure and at least one location, each user interface syntax structure defining a respective user interface element for modifying input weights of the corresponding controller syntax structure.
11. An apparatus comprising one or more processors, the one or more processors are configured to perform at least: Encoding at least one node in a runtime asset delivery file for a 3D scene; Encoding a plurality of controller syntax structures in the runtime asset delivery file, each controller syntax structure defining an association between an input weight range and a respective output transformation of at least one associated node in the scene, and A plurality of user interface syntax structures are encoded in the runtime asset delivery file, each user interface syntax structure including information identifying at least one associated controller syntax structure and at least one location, each user interface syntax structure defining a respective user interface element for modifying input weights of the corresponding controller syntax structure.
12. The method of claim 10 or the apparatus of claim 11, wherein at least one of the user interface syntax structures indicates a start point and an end point, wherein a corresponding user interface element comprises a cursor movable along a line between the start point and the end point, and wherein a corresponding input weight is indicated by a position of the cursor within the range.
13. The method of claim 10 or the apparatus of claim 11, wherein: At least one of the user interface grammar structures defines a rectangular or elliptical two-dimensional shape; The corresponding user interface element includes a cursor movable within the two-dimensional shape; A first input weight is indicated by a vertical position of the cursor within the two-dimensional shape, and The second input weight is indicated by a horizontal position of the cursor within the two-dimensional shape.
14. The method of claim 10, or of claims 12-13 when dependent on claim 10, or the apparatus of claim 11, or of claims 12-13 when dependent on claim 11, wherein the transformation comprises at least one of rotation, translation, scaling changes, and changes in morphing target weights.
15. A signal comprising a runtime asset delivery file for a 3D scene, wherein the runtime asset delivery file comprises: at least one node; a plurality of controller grammar structures, each controller grammar structure defining an association between an input weight range and a respective output transform of at least one associated node in the scene, and A plurality of user interface syntax structures, each user interface syntax structure comprising information identifying at least one associated controller syntax structure and at least one location, each user interface syntax structure defining a respective user interface element for modifying input weights of the corresponding controller syntax structure.

Description

Controller user interface coding in a scene description Cross Reference to Related Applications The present application claims priority from european patent application number 23306701.6 entitled "controller user interface code in scene description" filed on 4/10/2023, which is incorporated herein by reference in its entirety. Background The present disclosure relates to encoding and decoding of 3D scene representations. The 3D scene may be represented by a runtime asset delivery file (e.g., glTF file). glTF or other runtime asset delivery files may provide information about the 3D scene, including geometric data and organization structures of objects in the scene and information for animating the objects. Although the glTF format has proven useful for delivering the final form of the 3D scene to the user, it is less effective as a format for use by the personnel who design and implement the 3D scene. In particular, the structure of the animation in glTF makes it difficult for the designer to make minor modifications to the animation without having to recalculate the entire animation. Disclosure of Invention Methods according to some embodiments include obtaining a runtime asset delivery file for a 3D scene, the file including a plurality of controller grammar structures, each controller grammar structure defining an association between a weight range and a respective output transformation of at least one association node in the scene, and a plurality of user interface grammar structures, each user interface grammar structure including information identifying at least one associated controller grammar structure and at least one location. The method also includes, for at least a first user interface syntax structure of the user interface syntax structures, displaying at least a first user interface element at a location identified by the first user interface syntax structure, receiving, by the first user interface element, a user input indicating a first weight, determining, based on a first controller syntax structure identified by the first user interface syntax structure, a first output transformation associated with the first weight, and generating a transformed node by applying the first output transformation to a node associated with the first controller syntax structure. Some embodiments further comprise displaying the transformed node. In some embodiments, the transformed node and the user interface element are displayed simultaneously. In some embodiments, the node associated with the first controller syntax structure comprises a mesh. In some embodiments, the first user interface element includes a cursor movable within a range defined by the first user interface syntax structure, and wherein the first weight is indicated by a position of the cursor within the range. In some embodiments, the first user interface syntax structure indicates a start point and an end point, wherein the first user interface element comprises a cursor movable along a line between the start point and the end point, and wherein the first weight is indicated by a position of the cursor within the range. In some embodiments, the first user interface syntax structure defines a rectangle, the first user interface element includes a cursor movable within the rectangle, the first weight is indicated by a vertical position of the cursor within the rectangle, and the second weight is indicated by a horizontal position of the cursor within the rectangle. In some embodiments, the first user interface syntax structure defines an ellipse, the first user interface element includes a cursor movable within the ellipse, the first weight is indicated by a vertical position of the cursor within the ellipse, and the second weight is indicated by a horizontal position of the cursor within the ellipse. Some embodiments further include determining a second output transformation associated with the second weight based on a second controller syntax structure in the runtime asset delivery file, wherein generating the transformed node further includes applying the second output transformation to a node associated with the first controller syntax structure. In some embodiments, the transformation includes at least one of a rotation, a translation, a scaling change, or a change in morphing target weights. Some embodiments include storing the first weight in the runtime asset delivery file after receiving a user input indicating the first weight. Methods according to some embodiments include encoding at least one node in a runtime asset delivery file for a 3D scene, encoding a plurality of controller grammar structures in the runtime asset delivery file, each controller grammar structure defining an association between an input weight range and a respective output transformation of at least one associated node in the scene, and encoding a plurality of user interface grammar structures in the runtime asset delivery file, each user interface grammar str