CN-122019355-A - Cross-platform visual transmission immersive media interaction method based on augmented reality

CN122019355ACN 122019355 ACN122019355 ACN 122019355ACN-122019355-A

Abstract

The invention discloses a cross-platform visual transmission immersive media interaction method based on augmented reality, and belongs to the technical field of media interaction. The method comprises the steps of establishing a content adaptation layer, collecting cross-terminal hardware and running environment parameters, generating annotated content adaptation configuration packages, compiling a unified rendering foundation of a standardized content frame framework, establishing a scene rendering layer, generating a dynamic visual framework to be rendered by combining the configuration packages with a scene database through interface call, establishing an interactive response layer, forming a unified interactive instruction by sub-instructions to realize cross-platform testing, establishing a cross-terminal adaptation regulation and control center, collecting test data to generate an interactive sample set and a sub-instruction set, establishing a content adaptation configuration package replacement model, optimizing the configuration packages through rendering adaptation degree, and screening the optimal visual framework according to test sharing degree. The invention solves the problems of poor cross-platform adaptation, insufficient immersion and low testing efficiency of the existing AR media, and improves cross-terminal interaction consistency and user immersion experience.

Inventors

CHEN LIYU
GENG JUN

Assignees

南京林业大学

Dates

Publication Date: 20260512
Application Date: 20251204

Claims (10)

1. An augmented reality-based cross-platform visual conveying immersive media interaction method is characterized by comprising the following steps of: Constructing a content adaptation layer, acquiring hardware parameters and operation environment parameters of a cross-platform visual augmented reality terminal, coding to generate a content adaptation configuration package, and instructing a basic rendering rule of visual media content by compiling a standardized content frame architecture before media interaction; Constructing a scene rendering layer, setting a content adaptation configuration package transmission interface and a scene database of a standardized content frame architecture, and calling the content adaptation configuration package through the transmission interface to generate a plurality of to-be-rendered visual media content architectures of the standardized content frame architecture after media interaction; Constructing an interaction response layer, setting sub-instructions based on basic presentation logic of visual media content, forming cross-platform unified interaction instructions by the sub-instructions, and matching each to-be-rendered content frame in a to-be-rendered visual media content architecture to test cross-platform interaction operation of the to-be-rendered visual media content architecture; Building a cross-end adaptation regulation center, collecting a plurality of to-be-rendered content frames correspondingly generated by a to-be-rendered visual media content architecture, generating an interaction sample set, and under a cross-platform interaction running test, matching the identification code of the sub-instruction with parameter annotation of a content adaptation configuration package of the to-be-rendered content frame to generate a sub-instruction set of the to-be-rendered visual media content architecture; Setting up an updating model of the content adaptation configuration package, carrying out replacement optimization on the content adaptation configuration package, and evaluating the test sharing degree of the interaction instruction after the replacement optimization is completed so as to select the optimal visual transmission architecture after the media interaction.
2. The augmented reality-based cross-platform visual transmission immersive media interaction method of claim 1, wherein the implementation process of constructing the content adaptation layer comprises the following steps: the method comprises the steps of calling hardware parameters and running environment parameters of a cross-platform visual augmented reality terminal, coding the hardware parameters and the running environment parameters, adding parameter comments to obtain a content adaptation configuration package, wherein one content adaptation configuration package corresponds to a group of combinations of the hardware parameters and the running environment parameters, uniformly coding the content adaptation configuration package, and the parameter comments comprise parameter types and parameter domain values; And compiling a standardized content frame framework before media interaction through basic presentation logic of the visual media content, wherein the standardized content frame framework is used for instructing basic rendering rules of the visual media content, a content adaptation configuration package corresponds to one visual requirement of the standardized content frame, and rendering parameters of the standardized content frame are defined through the content adaptation configuration package so as to meet the visual requirement.
3. The augmented reality-based cross-platform visual conveying immersive media interaction method of claim 1, wherein the specific implementation process of constructing the scene rendering layer comprises the following steps: the scene rendering layer is used for realizing dynamic scene construction of the standardized content frame architecture, and calling the content adaptation configuration package through a content adaptation configuration package transmission interface of the standardized content frame architecture so as to realize the dynamic scene construction; The scene rendering layer is internally provided with a scene database which is used for storing each content adaptation configuration package, when each standardized content frame in the standardized content frame architecture is connected with the scene database through a transmission interface, a plurality of visual media content architectures to be rendered after media interaction are obtained after the invocation of the content adaptation configuration package is realized.
4. The augmented reality-based cross-platform visual transmission immersive media interaction method of claim 1, wherein the specific implementation process of constructing the interaction response layer comprises the following steps: the interactive response layer is based on basic presentation logic of visual media content, sets and stores cross-platform unified interactive instructions, and tests cross-platform interactive operation of a visual media content framework to be rendered through the interactive instructions, wherein the interactive instructions comprise a plurality of sub-instructions, and one sub-instruction correspondingly tests one content adaptation configuration package; Setting an identification code of the sub-instruction, wherein the identification code has an association relation with parameter annotation of the content adaptation configuration package, uniformly encoding the sub-instruction through the identification code or the parameter annotation, and matching each to-be-rendered content frame in the to-be-rendered visual media content architecture through the identification code.
5. The method for interactive media delivery via cross-platform visual communication based on augmented reality according to claim 1, wherein the implementation process of step S4 comprises: Under the visual media content architecture to be rendered, when the operation test of cross-platform interaction is carried out on the content frames to be rendered corresponding to the standardized content frames, collecting a plurality of content frames to be rendered corresponding to one visual media content architecture to be rendered, generating an interaction sample set, and recording as , wherein, Representing an interaction sample set correspondingly generated by the ith visual media content architecture to be rendered, A content adaptation configuration package set which represents the corresponding call of the E-th content frame to be rendered, E represents the total number of the content frames to be rendered, and , Representing an R-th content adaptation configuration package, R representing the total number of content adaptation configuration packages; under cross-platform interactive operation test, after the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration package of the content frame to be rendered, the interactive instruction is extracted to generate a content adaptation configuration package set Is marked as a sub instruction group set of Wherein the sub-instruction set includes a plurality of sub-instructions.
6. The augmented reality-based cross-platform visual communication immersive media interaction method of claim 5, wherein the specific implementation process of performing replacement optimization on the content adaptation configuration package comprises the following steps: When the ith visual media content architecture to be rendered is dynamically generated, each content adaptation configuration package in the content adaptation configuration package set is operated, and the content adaptation configuration package is recorded Rendering adaptation at the e-th frame of content to be rendered In which, in the process, Representing run content adaptation configuration packages The mth actual rendering parameter of the content frame to be rendered generated at that time, Rendering parameter field representing standardized content frame corresponding to content frame to be rendered, if actual rendering parameter Belonging to the rendering parameter domain In the middle, let Otherwise let N represents the total number of actual rendering parameters; Presetting a content adaptation degree threshold, and if the rendering adaptation degree is the same Less than or equal to the content adaptation degree threshold, adapting the content to the configuration package Replacement and re-fusion to the content adaptation configuration package set In order to continue evaluating the rendering adaptation degree after replacement until the rendering adaptation degree is less than or equal to the content adaptation degree threshold value is satisfied, if the rendering adaptation degree is And if the rendering adaptation degree is larger than the content adaptation degree threshold, performing rendering adaptation degree evaluation of the next content adaptation configuration package.
7. The method for cross-platform visual transmission immersive media interaction based on augmented reality according to claim 6, wherein the specific implementation process of evaluating the test sharing degree of the interaction instruction to select the optimal visual transmission architecture after media interaction comprises: When the sample set is interacted with After each content adaptation configuration package participates in rendering adaptation degree evaluation and replacement, when testing cross-platform interactive operation of a visual media content architecture to be rendered through an interactive instruction, evaluating test sharing degree of the interactive instruction In which, in the process, Representing an interaction sample set Content-adaptive configuration package set Corresponding sub instruction set The number of sub-instructions contained in the union set, Is the mean value and , Is variance and G represents the total number of visual media content architectures to be rendered, which are correspondingly formed by the standardized content frame architecture; selecting a visual media content architecture to be rendered corresponding to a maximum value of the test sharing degree As an optimal visual communication architecture after media interaction.
8. The augmented reality-based cross-platform visual transmission immersive media interaction method according to claim 1, wherein the augmented reality-based cross-platform visual transmission immersive media interaction method is integrated in a storage in a form of a program, the storage is built in an augmented reality-based cross-platform visual transmission immersive media interaction system, the system further comprises a processor for executing the program of the augmented reality-based cross-platform visual transmission immersive media interaction method, and the processor further integrates a media interaction processing module and a cross-end regulation analysis module; The media interaction processing module is used for constructing a content adaptation layer, a scene rendering layer and an interaction response layer; the system comprises a content adaptation layer, a scene rendering layer, an interaction response layer, a visual media content framework, a scene database and a visual media content framework, wherein the content adaptation layer is used for acquiring hardware parameters and running environment parameters of a cross-platform visual augmented reality terminal, and coding to generate a content adaptation configuration package, and instructs basic rendering rules of visual media content by compiling a standardized content frame framework before media interaction; the cross-terminal regulation and control analysis module is used for building a cross-terminal adaptation regulation and control center and an alternation model of a content adaptation configuration package, wherein the cross-terminal adaptation regulation and control center is used for collecting a plurality of content frames to be rendered, which are correspondingly generated by a visual media content architecture to be rendered, and generating an interaction sample set, under a cross-platform interaction running test, the interaction sample set is matched with parameter annotations of the content adaptation configuration package of the content frames to be rendered through identification codes of sub-instructions so as to generate a sub-instruction set of the visual media content frame to be rendered, the alternation model of the content adaptation configuration package is used for carrying out replacement optimization on the content adaptation configuration package, and after the replacement optimization is completed, the test sharing degree of the interaction instructions is evaluated so as to select the optimal visual transmission architecture after media interaction.
9. The augmented reality-based cross-platform visual communication immersive media interaction method of claim 8, wherein the media interaction processing module comprises a content adaptation layer unit, a scene rendering layer unit and an interaction response layer unit; The content adaptation layer unit is used for calling hardware parameters and operation environment parameters of the cross-platform visual augmented reality terminal to obtain a content adaptation configuration package, and compiling a standardized content frame architecture before media interaction through the basic presentation logic of visual media content; The scene rendering layer unit is used for calling the content adaptation configuration package through a content adaptation configuration package transmission interface of the standardized content frame architecture so as to realize dynamic scene construction of the standardized content frame architecture and obtain a plurality of visual media content architectures to be rendered after media interaction; The interactive response layer unit is used for setting and storing cross-platform unified interactive instructions, testing cross-platform interactive operation of the visual media content framework to be rendered through the interactive instructions, setting identification codes of the sub-instructions, and matching each frame of the visual media content framework to be rendered through the identification codes.
10. The augmented reality-based cross-platform visual transmission immersive media interaction method of claim 8, wherein the cross-end regulation analysis module comprises an interaction sample set generation unit, a sub instruction set generation unit, a rendering adaptation analysis unit and a test sharing analysis unit; The interactive sample set generating unit is used for collecting a plurality of to-be-rendered content frames correspondingly generated by a to-be-rendered visual media content architecture and generating an interactive sample set; The sub-instruction set generating unit is used for generating a sub-instruction set of the visual media content architecture to be rendered after the identification code of the sub-instruction is matched with the parameter annotation of the content adaptation configuration packet of the content frame to be rendered; the rendering adaptation analysis unit is used for analyzing and recording the rendering adaptation degree of the content adaptation configuration package under the content frame to be rendered so as to realize the replacement optimization of the content adaptation configuration package; The test sharing analysis unit is used for evaluating the test sharing degree of the interaction instruction so as to screen the visual media content architecture to be rendered.

Description

Cross-platform visual transmission immersive media interaction method based on augmented reality Technical Field The invention relates to the technical field of media interaction, in particular to a cross-platform visual transmission immersive media interaction method based on augmented reality. Background Along with the deep penetration of the Augmented Reality (AR) technology in the media field, AR visual communication becomes a core technical support of scenes such as advertisement marketing, education science popularization, museum exhibition and the like by virtue of the characteristics of virtual-real fusion and real-time interaction, the current AR media interaction technology is developed by multi-focusing a single terminal, and in practical application, a user terminal presents multi-type and multi-parameter characteristics, such as covering a smart phone (iOS/Android dual system, resolution ratio is from 1080P to 4K), AR smart glasses (angle of view is 45-120 degrees, tracking precision is 0.1mm-1 mm), a tablet personal computer (screen size is 7-13 inches, running memory is 4GB-16 GB) and the like, and the terminal hardware parameters and running environment (system version, network bandwidth and environment light intensity) have the following defects in the prior art: The prior AR media content is mostly developed based on fixed terminal parameters, and a dynamic adaptation mechanism of the terminal-content is not established, for example, a 10-case-number high-definition household appliance model developed for high-end AR glasses is provided, the frame rate on a middle-end Android mobile phone is only 12-15fps, obvious blocking and texture loss occur, and a 5-case-number simplified model optimized for the mobile phone is provided, the AR glasses are provided with fuzzy display (the detail recognition rate is less than 60 percent), the visual requirements of different terminals cannot be met, and the consistency of cross-platform user experience is not met; In the prior art, a scene rendering mode of a fixed template and preset parameters is adopted, and cannot be dynamically adjusted according to terminal characteristics and environmental conditions, for example, in a market AR advertisement scene, advertisement content with fixed brightness (1.0 cd/m 2) under a strong light environment reflects too strongly, the visibility is only 40%, details are lost due to insufficient brightness under a weak light environment, the virtual effect and the real effect are poor, the AR scene is not matched with terminal display characteristics (such as AR glasses wide-angle display and mobile phone narrow-screen display), and the user's immersion feeling' is obvious from the experience difference of a real scene; Because of the intrinsic difference between AR interaction protocols and logics of different terminals, the prior art needs to independently write test instructions for each type of terminal, for example, test 'AR model rotation' interaction, 5 groups of independent scripts need to be developed for 5 types of terminals, the test period is as long as 10-15 days, the instruction sharing rate is insufficient, and because the instructions are not uniform, the cross-terminal interaction success rate is also reduced, the development cost is high, and the maintenance difficulty is high. Disclosure of Invention The invention aims to provide a cross-platform visual transmission immersive media interaction method based on augmented reality, which aims to solve at least one problem in the background technology. In order to solve the technical problems, the invention provides the following technical scheme: an augmented reality-based cross-platform visual transmission immersive media interaction method comprises the following steps: Constructing a content adaptation layer, acquiring hardware parameters and operation environment parameters of a cross-platform visual augmented reality terminal, coding to generate a content adaptation configuration package, and instructing a basic rendering rule of visual media content by compiling a standardized content frame architecture before media interaction; Constructing a scene rendering layer, setting a content adaptation configuration package transmission interface and a scene database of a standardized content frame architecture, and calling the content adaptation configuration package through the transmission interface to generate a plurality of to-be-rendered visual media content architectures of the standardized content frame architecture after media interaction; Constructing an interaction response layer, setting sub-instructions based on basic presentation logic of visual media content, forming cross-platform unified interaction instructions by the sub-instructions, and matching each to-be-rendered content frame in a to-be-rendered visual media content architecture to test cross-platform interaction operation of the to-be-rendered visual media content architecture; B