CN-121982268-A - Method, device, equipment and computer medium for mixed reality display of deformable object

CN121982268ACN 121982268 ACN121982268 ACN 121982268ACN-121982268-A

Abstract

Embodiments of the present disclosure disclose deformable object mixed reality display methods, apparatus, devices, and computer media. The method comprises the steps of carrying out geometric analysis on a target display object to obtain a geometric element set, carrying out digital coding on the target display object to obtain a component relation set, carrying out implicit relation modeling on the target display object according to the component relation set to obtain a deformable display model, carrying out projection pre-calibration on the deformable display model to obtain a mapping relation set, controlling a projector to carry out special-shaped projection on the deformable display model according to a preset projection file and the mapping relation set, carrying out real-time analysis on a received target user voice command to obtain a target deformation command, controlling an associated motor driving device to carry out morphological reconstruction on the deformable display model to obtain a reconstructed display model, and controlling the projector to carry out special-shaped projection on the reconstructed display model. This embodiment can reduce resource waste and save costs.

Inventors

LIU SHUNING
FU QIANG
Xi Pengye

Assignees

北京邮电大学

Dates

Publication Date: 20260505
Application Date: 20260112

Claims (8)

1. A deformable object mixed reality display method, comprising: Performing geometric analysis on the target display object to obtain a geometric element set; digitally encoding the target display object according to the geometric element set to obtain a component relation set; According to the component relation set, carrying out implicit relation modeling on the target display object to obtain a deformable display model, wherein the deformable display model comprises a plurality of sub-display models; According to the calibration control point set, carrying out projection pre-calibration on the deformable display model to obtain a mapping relation set; Controlling a projector to perform special-shaped projection on the deformable display model according to a preset projection file and the mapping relation set; based on a multi-Bluetooth communication protocol, analyzing the received voice command of the target user in real time to obtain a target deformation command; And controlling an associated motor driving device to conduct morphological reconstruction on the deformable display model according to the target deformation instruction to obtain a reconstructed display model, and controlling the projector to conduct special-shaped projection on the reconstructed display model.
2. The method of claim 1, wherein the performing geometric analysis on the target display object to obtain the set of geometric elements comprises: performing component identification on the target display object to obtain a component unit set; Geometrically simplifying the component unit set to obtain a geometric block set; carrying out topological relation analysis on the geometric block set to obtain a component topological relation set; Extracting dimension proportion parameters in the component topological relation set to obtain a geometric proportion set; And generating a geometric element set according to the geometric block set and the geometric proportion set.
3. The method of claim 1, wherein the digitally encoding the target presentation object according to the set of geometric elements to obtain a set of component relationships comprises: building relation definition on the geometric element set to obtain a relation type set; Generating a component relation set according to the relation type set and the geometric element set; Constructing a component relation graph according to the component relation set and the geometric element set; and serializing the component relation graph to obtain a component relation set.
4. The method of claim 1, wherein said performing a projection pre-calibration on the deformable display model according to the set of calibration control points to obtain a set of mapping relationships comprises: collecting characteristic points of the deformable display model to obtain a calibration control point set; Inputting the deformable display model into projection mapping software, and marking the projection position of the deformable display model to obtain a model coordinate point set; Generating a coordinate mapping matrix according to the model coordinate point set and the calibration control point set; and carrying out association packaging on the coordinate mapping matrix to obtain a mapping relation set.
5. The method of claim 1, wherein the analyzing the received voice command of the target user in real time based on the multiple bluetooth communication protocol to obtain the target deformation command comprises: Responding to the target user to start a voice acquisition function, and recording a voice instruction of the target user; preprocessing and packaging the voice command to obtain a voice data packet; Performing text conversion on the voice data packet to obtain a text instruction; Performing intention recognition on the text instruction to obtain an instruction classification result, wherein the instruction classification result is used for representing a voice control result or a voice question-answer result; And responding to the instruction classification result to represent a voice question-answering result, and executing the following operations: constructing a model query statement according to the text instruction; Generating an answer text based on the model query statement and the large language model; Visually packaging the answer text to obtain an answer text data packet; Transmitting the answer text data packet to an associated client for visual display; and responding to the instruction classification result to represent a voice control result, carrying out instruction conversion on the text instruction to obtain a target deformation instruction, and transmitting the target deformation instruction to the motor driving device based on a multi-Bluetooth communication protocol.
6. A deformable object mixed reality display device, comprising: the geometric analysis unit is configured to perform geometric analysis on the target display object to obtain a geometric element set; the digital coding unit is configured to carry out digital coding on the target display object according to the geometric element set to obtain a component relation set; An implicit relation modeling unit configured to perform implicit relation modeling on the target display object according to the component relation set to obtain a deformable display model, wherein the deformable display model comprises a plurality of sub-display models; The projection pre-calibration unit is configured to perform projection pre-calibration on the deformable display model according to the calibration control point set to obtain a mapping relation set; The first control unit is configured to control the projector to perform special-shaped projection on the deformable display model according to a preset projection file and the mapping relation set; The real-time analysis unit is configured to analyze the received voice command of the target user in real time based on the multi-Bluetooth communication protocol to obtain a target deformation command; The second control unit is configured to control the associated motor driving device to conduct morphological reconstruction on the deformable display model according to the target deformation instruction, obtain a reconstructed display model, and control the projector to conduct special-shaped projection on the reconstructed display model.
7. An electronic device, comprising: One or more processors; A storage device having one or more programs stored thereon; when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1 to 5.
8. A computer readable medium having stored thereon a computer program, wherein the program when executed by a processor implements the method of any of claims 1 to 5.

Description

Method, device, equipment and computer medium for mixed reality display of deformable object Technical Field Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a deformable object mixed reality display method, apparatus, device, and computer medium. Background Through dynamic display system, can realize showing cultural heritage, building, technological exhibit etc. in places such as museum, science and technology museum. In the prior art, a mode is often adopted in which a customized entity model is matched with a static image-text to be displayed or a virtual model is created through digital technologies such as virtual reality equipment (e.g. VR glasses) and the like to be displayed. However, when the model is displayed in the above manner, there are often the following technical problems: the traditional display mode with the physical model as the main mode changes the form of the model to adapt to different display content requirements (such as different sections of a display building or a building process), the model needs to be redesigned, the design period is long, the cost is high, and meanwhile, sustainable utilization of resources cannot be realized, so that resource waste is caused. And realize the dynamic display effect of model through virtual equipment, with high costs and inconvenient operation, be difficult to use on a large scale. The above information disclosed in this background section is only for enhancement of understanding of the background of the disclosed concept and, therefore, it may contain information that does not form the prior art that is known to those of ordinary skill in the art in this country. Disclosure of Invention The disclosure is in part intended to introduce concepts in a simplified form that are further described below in the detailed description. The disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Some embodiments of the present disclosure propose deformable object mixed reality presentation methods, apparatus, electronic devices, and computer readable media to address one or more of the technical problems mentioned in the background section above. In a first aspect, some embodiments of the present disclosure provide a mixed reality display method for a deformable object, where the method includes performing geometric analysis on a target display object to obtain a set of geometric elements, performing digital encoding on the target display object according to the set of geometric elements to obtain a set of component relationships, performing implicit relational modeling on the target display object according to the set of component relationships to obtain a deformable display model, where the deformable display model includes a plurality of sub-display models, performing projection precalibration on the deformable display model according to a set of calibration control points to obtain a set of mapping relationships, controlling a projector to perform special-shaped projection on the deformable display model according to a preset projection file and the set of mapping relationships, performing real-time analysis on a received target user voice command based on a multi-bluetooth communication protocol to obtain a target deformation command, controlling an associated motor driving device to perform morphological reconstruction on the deformable display model according to obtain a reconstructed display model, and controlling the projector to perform special-shaped projection on the reconstructed display model. In a second aspect, some embodiments of the present disclosure provide a deformable object mixed reality display device, which includes a geometry analyzing unit configured to perform geometry analysis on a target display object to obtain a set of geometry elements, a digital encoding unit configured to digitally encode the target display object according to the set of geometry elements to obtain a set of component relationships, an implicit relationship modeling unit configured to perform implicit relationship modeling on the target display object according to the set of component relationships to obtain a deformable display model, wherein the deformable display model includes a plurality of sub-display models, a projection precalibrating unit configured to perform projection precalibration on the deformable display model according to a set of calibration control points to obtain a set of mapping relationships, a first control unit configured to control a projector to perform special-shaped projection on the deformable display model according to a preset projection file and the set of mapping relationships, a real-time analyzing unit configured to perform real-time on a received target user voice command based on a multiple bluetooth communication protocol to obtain a t