CN-122027638-A - Intelligent synchronization system based on multi-terminal interaction

CN122027638ACN 122027638 ACN122027638 ACN 122027638ACN-122027638-A

Abstract

The invention relates to the field of intelligent interaction, in particular to an intelligent synchronization system based on multi-terminal interaction, a terminal analysis module of the invention analyzes the motion of coordinate information of each action node of an instruction terminal, analyzes the action trend of the action nodes, an instruction transmission module adaptively selects a transmission strategy based on the action trend to transmit the coordinate information corresponding to the action nodes of the instruction terminal to a cloud, a positioning module verifies the coordinate time sequence matching of action periods, the interactive synchronous module responds to the verification result of the positioning module, the adaptive selective transmission strategy transmits coordinate information corresponding to the action nodes of the instruction terminal to the cloud, the model construction module restores all coordinate information in the disassembly unit and constructs a corresponding three-dimensional model.

Inventors

CHEN YANMEI
YUAN LIPING
Chai Mingyi

Assignees

北京布局未来科技发展有限公司

Dates

Publication Date: 20260512
Application Date: 20260413

Claims (10)

1. An intelligent synchronization system based on multi-terminal interaction, comprising: The terminal analysis module is used for acquiring the coordinate information of each action node of the instruction terminal in real time, and carrying out motion analysis on each action node every action period, and comprises the steps of determining space-time action characteristics based on the coordinate information and analyzing the action trend of the action node based on the change of the space-time action characteristics; the instruction transmission module is used for selecting a transmission strategy based on the action trend and transmitting coordinate information corresponding to the action node of the instruction terminal to the cloud; the positioning module is used for acquiring the coordinate information of each action node of the response terminal, positioning the action period of the response terminal based on the coordinate similarity between the coordinate information and the command terminal in each action period, and continuously verifying the coordinate time sequence matching of the subsequent action period; the interactive synchronization module is used for responding to the verification result of the positioning module and selecting a transmission strategy based on the action trend to transmit coordinate information corresponding to the action node of the response terminal to the cloud; the model construction module is used for restoring all corresponding coordinate information in the disassembly unit according to the residual coordinate information in the disassembly unit and constructing a corresponding three-dimensional model according to the coordinate information; The transmission strategy comprises the steps of carrying out time domain dimension disassembly on the coordinate information based on space-time action characteristics to determine a plurality of disassembly units, and respectively extracting part of the coordinate information of the disassembly units for transmission or transmitting all the coordinate information.
2. The intelligent synchronization system based on multi-terminal interaction of claim 1, wherein the terminal analysis module analyzes motion trends of the motion nodes based on changes in spatiotemporal motion characteristics comprising, The method comprises the steps of determining space-time action characteristics of action nodes in an action period, and obtaining space-time action characteristic variation of a plurality of sub-periods relative to adjacent sub-periods to solve the corresponding stability of the action nodes; If the stability is greater than or equal to a preset stability threshold, determining that the action node is a steady-state action trend; if the stability is smaller than the preset stability threshold, judging that the action node is an unsteady action trend; The time-space action feature comprises an acceleration value, a movement direction change angle and a movement speed value corresponding to each moment, and the stability is determined based on the statistical variance of the time-space action feature change quantity.
3. The intelligent synchronization system based on multi-terminal interaction of claim 2, wherein the instruction transmission module transmits the coordinate information to the cloud terminal comprises, Aiming at action nodes of steady-state action trend, selecting a plurality of dismantling units which are determined by carrying out time domain dimension dismantling on coordinate information based on space-time action characteristics, and respectively extracting part of coordinate information of the dismantling units to transmit to a cloud; And aiming at the action nodes of the unsteady action trend, selecting and transmitting all coordinate information to the cloud.
4. The intelligent synchronization system of claim 1, wherein the instruction transmission module and the interactive synchronization module perform time domain dimension disassembly to determine a plurality of disassembly units comprises, The time domain splitting unit is used for splitting the time domain based on the action splitting moment, and determining the split time period as a splitting unit; wherein the motion split time is captured on a created timeline based on spatiotemporal motion features.
5. The intelligent synchronization system based on multi-terminal interaction according to claim 4, wherein the instruction transmission module and the interaction synchronization module determine a time at which the action segmentation condition is satisfied on the time axis as an action segmentation time; The motion segmentation condition comprises that the moving speed value is equal to a preset speed threshold value or the acceleration value does not belong to the range of the acceleration value threshold value or the change angle of the moving direction is larger than a preset change angle threshold value.
6. The intelligent synchronization system based on multi-terminal interaction according to claim 1, wherein the positioning module positions the belonging action cycle based on the coordinate similarity between the coordinate information and the command terminal in each action cycle, The positioning module compares the coordinate information of each action node with the coordinate information of the corresponding action node in a plurality of action periods of the instruction terminal, and determines the action period corresponding to the maximum coordinate similarity; if the coordinate similarity corresponding to the action period is greater than a preset similarity threshold, locating the action node to belong to the action period; wherein the coordinate similarity is determined based on a single coordinate similarity of each action node.
7. The intelligent synchronization system of claim 1, wherein the positioning module continuously verifies coordinate timing matching of the motion cycle comprising, Extracting partial coordinate information of the corresponding action node of the response terminal in the subsequent action period, comparing the partial coordinate information with partial coordinate information of the action node of the command terminal in the corresponding action period, and determining the coordinate similarity; and only extracting partial coordinate information in a time period of a preset proportion after the action period starts, and verifying that the action period has coordinate time sequence matching if the coordinate similarity is larger than a preset time sequence matching threshold value.
8. The intelligent synchronization system of claim 7, wherein the interactive synchronization module verifies that the coordinate information is time-series matched in response to the positioning module, wherein, Aiming at action nodes of steady-state action trend, selecting a plurality of dismantling units which are determined by carrying out time domain dimension dismantling on coordinate information based on space-time action characteristics, and respectively extracting part of coordinate information of the dismantling units to transmit to a cloud; And aiming at the action nodes of the unsteady action trend, selecting and transmitting all coordinate information to the cloud.
9. The intelligent synchronization system based on multi-terminal interaction of claim 1, wherein the model building module restores the disassembly unit containing all coordinate information comprises, Marking a first class of time containing the coordinate information in the disassembly unit and a second class of time not containing the coordinate information in the time axis; forming a time group based on the time sequence order, and predicting coordinate information corresponding to the second class of time by using the coordinate information corresponding to the first class of time in the time group; wherein the time group comprises adjacent first-class time and second-class time.
10. The intelligent synchronization system based on multi-terminal interaction of claim 1, wherein predicting the coordinate information corresponding to the class II time instance comprises, The coordinate information of the first class of moments is read, and momentum characteristics including movement speed, movement direction and time interval between the second class of moments and the first class of moments are determined; And predicting coordinate information of the second class of moments after the corresponding time interval according to the momentum characteristic by taking the coordinate information of the first class of moments as a reference.

Description

Intelligent synchronization system based on multi-terminal interaction Technical Field The invention relates to the field of intelligent interaction, in particular to an intelligent synchronization system based on multi-terminal interaction. Background With the rapid development of computer technology and internet technology, the online multi-terminal interaction technology is mature gradually, motion data transmission among a plurality of terminals and three-dimensional modeling presentation corresponding to the multiple terminals can be realized at present, particularly in the online interaction field, a single terminal can project a three-dimensional model into a three-dimensional space in various forms for other terminals to observe, and meanwhile, the terminal can acquire feedback information of other terminals to realize online multi-terminal interaction, so that the online multi-terminal interaction system is applied to the multiple fields. For example, china patent publication No. CN114779942A discloses a virtual reality immersive interactive system, which comprises a virtual reality simulation module, a virtual teaching scene selection module, an identification positioning module and a display module, wherein the virtual reality simulation module is used for carrying out virtual teaching scene modeling, the virtual teaching scene is an unmanned aerial vehicle processing and manufacturing full scene, the virtual teaching scene selection module is used for selecting all sub-scenes of the unmanned aerial vehicle processing and manufacturing full scene, the identification positioning module is used for acquiring characteristic information of characters in the virtual teaching scene through a plurality of sensors and carrying out pose identification by utilizing the characteristic information, the pose comprises at least one of the poses of hands, feet and heads, and the display module is used for displaying the picture display of the virtual teaching scene after manual interaction. There are problems in the prior art that, In the prior art, in the multi-terminal interaction process, a plurality of terminals need to exchange data streams or collect the data streams to a cloud for processing, and data transmission of the plurality of terminals occupies a large amount of network bandwidth resources and easily causes transmission delay or data packet loss in a weak network environment. Disclosure of Invention Therefore, the invention provides an intelligent synchronization system based on multi-terminal interaction, which is used for solving the problems that in the prior art, a plurality of terminals need to exchange data streams or collect the data streams to a cloud for processing in the multi-terminal interaction process, the data transmission of the plurality of terminals occupies a large amount of network bandwidth resources, and transmission delay or data packet loss is easy to cause in a weak network environment. To achieve the above object, the present invention provides an intelligent synchronization system based on multi-terminal interaction, which includes: The terminal analysis module is used for acquiring the coordinate information of each action node of the instruction terminal in real time, and carrying out motion analysis on each action node every action period, and comprises the steps of determining space-time action characteristics based on the coordinate information and analyzing the action trend of the action node based on the change of the space-time action characteristics; the instruction transmission module is used for selecting a transmission strategy based on the action trend and transmitting coordinate information corresponding to the action node of the instruction terminal to the cloud; the positioning module is used for acquiring the coordinate information of each action node of the response terminal, positioning the action period of the response terminal based on the coordinate similarity between the coordinate information and the command terminal in each action period, and continuously verifying the coordinate time sequence matching of the subsequent action period; the interactive synchronization module is used for responding to the verification result of the positioning module and selecting a transmission strategy based on the action trend to transmit coordinate information corresponding to the action node of the response terminal to the cloud; the model construction module is used for restoring all corresponding coordinate information in the disassembly unit according to the residual coordinate information in the disassembly unit and constructing a corresponding three-dimensional model according to the coordinate information; The transmission strategy comprises the steps of carrying out time domain dimension disassembly on the coordinate information based on space-time action characteristics to determine a plurality of disassembly units, and respectively extracting part of