Search

CN-122027760-A - Multimode holographic communication interaction method and system

CN122027760ACN 122027760 ACN122027760 ACN 122027760ACN-122027760-A

Abstract

The invention relates to the field of communication and information processing, in particular to a multimode holographic communication interaction method and system. The method comprises the steps of obtaining a participant list and an end capacity network state, uniformly registering a session number, a clock reference, a coordinate mapping table, a probe geometric table and a permission table, constructing a session probe arrangement package, collecting voice fragments and visual fragments, forming a multi-mode fragment set, executing clock space alignment to generate a session state frame, constructing an evidence item set based on the session state frame, completing evidence fusion and conflict arbitration, generating a semantic operation primitive sequence, constructing an interaction event diagram according to the semantic operation primitive sequence, generating a holographic presentation increment, forming a dual-channel load, and completing session health assessment and exception handling by combining policy execution and quality feedback. According to the invention, through an interaction organization mode of semantic and presentation decoupling, stable collaborative processing of multi-mode information under a complex network and multi-participation scenes is realized, and consistency, controllability and traceability of holographic communication interaction are improved.

Inventors

  • LIU YIHE
  • HUANG YAN

Assignees

  • 剑兰科技(重庆)有限公司

Dates

Publication Date
20260512
Application Date
20260114

Claims (10)

  1. 1. A multi-modal holographic communication interaction method, comprising: s100, acquiring a participant list and an end capacity network state, registering a session number, a clock reference, a coordinate mapping table, a probe geometry table and a permission table, and generating a session probe arrangement package; s200, collecting voice fragments and visual fragments based on a session probe arrangement packet, and generating a multi-mode fragment set with quality vectors and missing reason codes; S300, performing clock space alignment based on the multi-mode fragment set, outputting an alignment residual record and generating a session state frame; s400, constructing an evidence item set based on a session state frame, and executing evidence fusion and conflict arbitration to generate a semantic operation primitive sequence, wherein the semantic operation primitive sequence comprises an object identifier, a confidence coefficient and a conflict reason code; s500, constructing an interaction event diagram based on a semantic operation primitive sequence, wherein the interaction event diagram comprises event identification, causal dependency, object version and snapshot index; S600, generating a holographic representation increment based on the interaction event diagram, packaging the interaction event diagram increment and the holographic representation increment in a layering manner, and writing a check field to obtain a dual-channel load; s700, generating a semantic channel reliable parameter and a presentation channel elastic parameter based on the dual-channel load, and generating a strategy execution record and a quality feedback packet; S800, generating a session health score based on the quality feedback packet and the alignment residual record, judging the type of abnormality and outputting an abnormality treatment record, wherein the abnormality treatment record comprises a resynchronization parameter, a degradation configuration and a snapshot playback parameter.
  2. 2. The method of claim 1, wherein the session probe orchestration package comprises a session number field, a clock reference field, a coordinate mapping table field, a permission table field, a probe geometry table field, and a downgrade configuration table field, wherein the probe geometry table field comprises a probe number, an installation pose, and a field of view parameter, wherein the permission table comprises a role identifier, a set of authorization primitives, an object scope field, and a signature field, wherein conflict arbitration in the sequence of semantic operation primitives performs permission verification according to the signature field and writes an arbitration result code.
  3. 3. The method of claim 1, wherein the quality vector comprises an image sharpness score, an occlusion rate score, an audio signal-to-noise ratio score, and an end-to-end delay score, and wherein the missing reason code is comprised of an occlusion missing code, a noise missing code, and a frame loss missing code.
  4. 4. The method of claim 1, wherein the clock space alignment comprises a clock offset estimation, a sampling drift correction, and a calibration version alignment, and the aligned residual record comprises a residual amount of time, a residual amount of space, and an affected evidence item number.
  5. 5. The method of claim 1, wherein the set of evidence items consists of a voice instruction evidence item, a gesture track evidence item, a line-of-sight pointing evidence item, and a touch ray evidence item, each evidence item containing an evidence item number, primitive type, object candidate identification, spatial pose, and evidence confidence.
  6. 6. The method of claim 1, wherein the interaction event map further comprises a rollback playback plan comprising a conflicting event identification, a rollback boundary state digest, and a playback sequence number.
  7. 7. The method of claim 1, wherein the dual channel payload is comprised of a semantic event payload comprising an interaction event map delta, a snapshot index, and an object version, and a holographic representation payload, the check field comprising an object version number, an event sequence number, and a check hash value.
  8. 8. The method of claim 1 wherein the semantic channel reliability parameters include acknowledgement sequence numbers, retransmission windows, and sequence numbers, the presentation channel resilience parameters include layered coding layer numbers, region delta block indexes, and frame rate parameters, and the quality backhaul packets include interaction delay values, collision arbitration times, average of pairs Ji Cancha, and retransmission times.
  9. 9. The method of claim 1, wherein the session health score is generated by weighting Ji Cancha means, interaction delay values, number of collision arbitrations, and number of retransmissions, the anomaly type is composed of a spatiotemporal drift anomaly, a semantic collision anomaly, a network degradation anomaly, and an end-computing force degradation anomaly, and the anomaly handling record contains a resynchronization parameter, a degradation configuration table index, and a snapshot playback parameter.
  10. 10. A multi-modal holographic communication interactive system, for use in a method as claimed in any one of claims 1 to 9, comprising: the session probe arrangement module is used for acquiring the participant list and the end capacity network state, registering a session number, a clock reference, a coordinate mapping table, a probe geometry table and a permission table, and generating a session probe arrangement package; the multi-mode acquisition module is used for acquiring voice fragments and visual fragments based on the session probe arrangement package and generating a multi-mode fragment set containing quality vectors and missing reason codes; The clock space alignment module is used for executing clock space alignment based on the multi-mode fragment set, outputting an alignment residual record and generating a session state frame; the evidence fusion and conflict arbitration module is used for constructing an evidence item set based on the session state frame, executing evidence fusion and conflict arbitration and generating a semantic operation primitive sequence containing object identification, confidence and conflict reason codes; the interaction event diagram construction module is used for constructing an interaction event diagram based on the semantic operation primitive sequence; The dual-channel load generation module generates a holographic representation increment based on the interaction event map, packages the interaction event map increment and the holographic representation increment in a layering mode, writes a check field into the holographic representation increment, and obtains a dual-channel load formed by semantic event load and holographic representation load; The strategy and quality feedback module generates a semantic channel reliable parameter and a presentation channel elastic parameter based on the two-channel load, and generates a strategy execution record and a quality feedback packet; And the health score and exception handling module is used for generating a session health score based on the quality feedback packet and the Ji Cancha records, judging the exception type and outputting an exception handling record.

Description

Multimode holographic communication interaction method and system Technical Field The invention relates to the field of communication and information processing, in particular to a multimode holographic communication interaction method and system. Background In the field of communication and information processing, the existing scheme of multi-mode holographic communication interaction generally surrounds the collection of voice fragments and visual fragments, the management of session numbers and clock references, the configuration of a coordinate mapping table and a probe geometric table and the access control development of an authority table, and has the limitations of inconsistent configuration caliber of session levels, lack of traceability constraint of clock space alignment links, difficulty in forming unified output by evidence fusion and conflict arbitration and the like. The existing method is used for performing end-to-end processing by depending on fixed network conditions and fixed end capacity, and the problems that the quality of a multi-mode fragment set is fluctuant, the reason codes are difficult to unify and file, and the Ji Cancha records are difficult to stably generate and correlate easily occur in the scene that the network state fluctuation of the end capacity and the multi-participants are interacted concurrently, so that session state frames are difficult to continuously use as consistent references. Aiming at the joint processing from evidence item set construction, evidence fusion and conflict arbitration driven by a session state frame to semantic operation primitive sequences, the prior art generally has short boards in the aspects of field-level consistency of object identification, confidence and conflict reason codes, arbitration conclusion traceability under permission table constraint and causal dependency expression of cross-party conflict, and is difficult to form a consistent flow in links such as multi-mode acquisition, clock space alignment, judgment and arbitration, interactive event graph construction, dual-channel load generation, strategy execution record and quality feedback packet closed-loop linkage and the like, so that event identification, causal dependency, object version and snapshot index in the interactive event graph are difficult to stably correspond to holographic presentation increment and interactive event graph increment, and the collaborative mismatch of semantic event load and holographic presentation load is easy to be caused when a check field lacks a unified caliber, and the mismatch is further represented as a semantic channel reliable parameter and presentation channel elastic parameter are difficult to continuously adjust according to quality feedback packet, and the anomaly type is difficult to be consistently judged and mapped to a resynchronization parameter, a degradation configuration and a snapshot processing parameter in the abnormal playback record, so that the security and health score support of a closed-loop engineering can stably run. Disclosure of Invention In order to solve the technical problems, the invention provides a multimode holographic communication interaction method, which comprises the following steps: s100, acquiring a participant list and an end capacity network state, registering a session number, a clock reference, a coordinate mapping table, a probe geometry table and a permission table, and generating a session probe arrangement package; s200, collecting voice fragments and visual fragments based on a session probe arrangement packet, and generating a multi-mode fragment set with quality vectors and missing reason codes; S300, performing clock space alignment based on the multi-mode fragment set, outputting an alignment residual record and generating a session state frame; s400, constructing an evidence item set based on a session state frame, and executing evidence fusion and conflict arbitration to generate a semantic operation primitive sequence, wherein the semantic operation primitive sequence comprises an object identifier, a confidence coefficient and a conflict reason code; s500, constructing an interaction event diagram based on a semantic operation primitive sequence, wherein the interaction event diagram comprises event identification, causal dependency, object version and snapshot index; S600, generating a holographic representation increment based on the interaction event diagram, packaging the interaction event diagram increment and the holographic representation increment in a layering manner, and writing a check field to obtain a dual-channel load; s700, generating a semantic channel reliable parameter and a presentation channel elastic parameter based on the dual-channel load, and generating a strategy execution record and a quality feedback packet; S800, generating a session health score based on the quality feedback packet and the alignment residual record, judging the type of abnormality a