CN-122018835-A - Vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation and control method

CN122018835ACN 122018835 ACN122018835 ACN 122018835ACN-122018835-A

Abstract

The invention discloses a vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation and a control method thereof, in particular to the technical field of vehicle-mounted multimedia, which realizes real-time monitoring and analysis of system time sequence and semantic state by accurately collecting frame clock signals, rendering time delay, interaction events and content situation characteristics of a main screen, a secondary screen and a rear display screen, generates collaborative index dynamic evaluation and predicts the trend of time sequence-semantic dislocation coupling instability by applying a drift operator and a semantic deviation operator and combining a weighting formula, and starting a self-correction mechanism based on the instability trend, dynamically adjusting the refreshing phase of the screen and the synchronous proportion of the frame, and based on the recovery historical behavior track and the current state code, effectively rebuilding a context inheritance semantic path, ensuring semantic consistency in the interaction process, broadcasting the generated comprehensive control instruction to all screen nodes through a central control bus, and ensuring seamless coordination of content and interactive operation among multiple screens.

Inventors

XIE MINXIAO
CHEN HUAIXIANG
Dan qiang
HAO YONGJIAN

Assignees

深圳市鼎微科技有限公司

Dates

Publication Date: 20260512
Application Date: 20251216

Claims (9)

1. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation is characterized by comprising a data acquisition module, a drift and deviation calculation module, a coupling evaluation module, a self-correction starting module, a context recovery module and a control instruction broadcasting module; The data acquisition module is used for acquiring frame clock signals, rendering time delay, interaction events and content situation characteristics of the main screen, the auxiliary screen and the rear display screen, constructing a time sequence semantic joint monitoring chain and forming a time and semantic double-domain unified feature stream; the drift and deviation calculation module is used for calculating the cross-screen time drift and the context ambiguity by applying a drift operator and a semantic deviation operator on the unified feature stream and forming a collaborative index through a weighting formula; the coupling evaluation module is used for defining a time sequence-semantic coupling evolution equation according to the collaborative index and evaluating whether the time sequence-semantic dislocation coupling instability trend occurs in the system or not; The self-correction starting module is used for triggering a time drift self-correction mechanism according to the time sequence-semantic dislocation coupling instability trend and dynamically adjusting the screen refreshing phase and the frame synchronization proportion; the context recovery module is used for recovering a context inheritance semantic path through the historical behavior track and the current state code after the time drift is self-corrected; And the control instruction broadcasting module is used for combining the corrected screen refreshing phase and the context inheritance semantic path to generate a comprehensive control instruction, broadcasting the comprehensive control instruction to all screen nodes through the central control bus, and driving the multi-screen collaborative display and interaction.
2. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to claim 1, wherein drift operators and semantic deviation operators are applied to the unified feature stream to calculate cross-screen time drift and context ambiguity, and a collaborative index is formed through a weighting formula, and the method is specifically as follows: The drift operator is used to calculate the clock signal difference between each pair of screens: wherein In order for the cross-screen time to drift, And Time alignment signals of the source screen and the target screen respectively; the semantic deviation operator is used for calculating context ambiguity between cross screens, and the context ambiguity is calculated according to the extracted interaction event data and the content situation characteristics: wherein In order to make the context ambiguities, The difference degree is the difference degree of the interaction events; the content difference degree is used for calculating the content difference degree between the source screen and the target screen; drift of cross-screen time Context ambiguity Weighted combining to form a synergy index Wherein In the form of a synergy index, As a weight coefficient for the cross-screen time drift, Is a weight coefficient of context ambiguity, and And Are all greater than 0.
3. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to claim 2, wherein a time sequence-semantic coupling evolution equation is defined according to the collaborative index, and whether the time sequence-semantic misalignment coupling instability trend of the system occurs is evaluated, specifically as follows: by tracking synergy index The change in a plurality of time windows can obtain the evolution sequence of the synergy index along with time: wherein Is a discrete point in time of the day, Then the synergy index calculated at the discrete time points; analyzing the evolution trend of the synergy index, and calculating the change rate of the synergy index in time: ; introducing the time change rate and the history dependency of the synergy index into a time sequence-semantic coupling evolution equation, wherein the equation model is as follows: wherein Representing a time-series-semantic-coupling instability risk index, Time rate of change as a synergy index; is a history dependency coefficient; Is a time delay term, represents a collaborative exponential state of system history, Is the perceived latency.
4. The vehicle-mounted multimedia system supporting multi-screen interaction and content seamless circulation according to claim 3, wherein the vehicle-mounted multimedia system is characterized in that whether the system has a time sequence-semantic miscoupling instability trend or not is evaluated according to a time sequence-semantic coupling evolution equation, in particular, by observing a time sequence-semantic miscoupling instability risk index And (3) judging whether the system is at risk of instability or not: when time sequence-semantic coupling instability risk index Greater than a preset threshold of destabilization When the coupling instability trend exists, judging that the current system enters an instability risk area; when time sequence-semantic coupling instability risk index Less than or equal to a preset threshold of instability When this is the case, the system is shown to remain stable.
5. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to claim 4, wherein the vehicle-mounted multimedia system is characterized in that according to the time sequence-semantic dislocation coupling instability trend, a time drift self-correction mechanism is triggered, and the specific gravity of screen refreshing phase and frame synchronization is dynamically adjusted, wherein the specific gravity is as follows: when the time drift self-correction mechanism is triggered, the current cross-screen time drift needs to be recalculated Context ambiguity ; Based on current cross-screen time drift Context ambiguity Calculating a synchronization adjustment coefficient for adjusting the proportion of screen refresh phase to frame synchronization, and obtaining a first adjustment coefficient by weighted synthesis of cross-screen time drift and context ambiguity And a second adjustment coefficient Wherein And As a weighting factor for the current cross-screen time drift and context ambiguity, And Maximum cross-screen time drift and context ambiguity allowed for the system, a first adjustment coefficient And a second adjustment coefficient Dynamic adjustment amplitude for determining screen refresh phase and frame sync weight.
6. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless transfer of content according to claim 5, wherein according to the first adjustment coefficient And a second adjustment coefficient The screen refreshing phase and the frame synchronization proportion are dynamically adjusted to correct the time sequence and the semantic misalignment, and the specific adjustment is as follows: Refresh phase adjustment based on cross-screen time drift And a first adjustment coefficient Correcting the screen refresh phase: wherein Is a screen Is used to determine the current refresh phase of (a), The adjusted refresh phase; Frame synchronization weight adjustment based on context ambiguity And a second adjustment coefficient Correcting the frame synchronization proportion of the screen: wherein Is a screen The current frame sync rate is higher than the one, The specific gravity is adjusted for the frame synchronization.
7. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to claim 6, wherein after time drift self-correction, context inheritance semantic paths are recovered through historical behavior tracks and current state codes, and the method is characterized by comprising the following steps: after the time drift self-correction, collecting time stamps, event types, triggered screen nodes and corresponding content changes of all interaction events to obtain a historical behavior track: wherein In order to be a trace of the historical behavior, Is the interaction event data at the mth time point t; According to historical behavior track Extracting historical behavioral semantic mappings ; Generating current screen content features by real-time encoding of current screen state And current interaction event ; Semantic mapping through historical behavior And current screen content features The semantic path between the current state and the historical behavior is restored.
8. The vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to claim 7, wherein the semantic path between the current state and the historical behavior is recovered by calculating a mapping relation between the current screen state and the historical behavior, and recovering the context inheritance semantic path according to the relation, and a specific mapping formula is as follows: wherein In order to recover the semantic path, To at the point of time At the moment, the content characteristics of the screen, And representing the similarity between the current state code and the historical state content, and calculating through cosine similarity.
9. The vehicle-mounted multimedia control method supporting multi-screen interaction and seamless content circulation is used for realizing the vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation according to any one of claims 1-8, and is characterized by comprising the following steps: Acquiring frame clock signals, rendering time delay, interaction events and content situation characteristics of a main screen, a secondary screen and a rear display screen, constructing a time sequence semantic joint monitoring chain, and forming a feature stream with unified time and semantic double domains; applying a drift operator and a semantic deviation operator on the unified feature stream to calculate cross-screen time drift and context ambiguity, and forming a collaborative index through a weighting formula; defining a time sequence-semantic coupling evolution equation according to the collaborative index, and evaluating whether a time sequence-semantic dislocation coupling instability trend occurs in the system or not; Triggering a time drift self-correction mechanism according to the time sequence-semantic dislocation coupling instability trend, and dynamically adjusting the refresh phase of a screen and the proportion of frame synchronization; After the time drift is self-corrected, the context inheritance semantic path is recovered through the historical behavior track and the current state code; And combining the corrected screen refreshing phase and the context inheritance semantic path to generate a comprehensive control instruction, broadcasting the comprehensive control instruction to all screen nodes through a central control bus, and driving the multi-screen collaborative display and interaction.

Description

Vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation and control method Technical Field The invention relates to the technical field of vehicle-mounted multimedia, in particular to a vehicle-mounted multimedia system supporting multi-screen interaction and seamless circulation of contents and a control method. Background Along with the evolution of a vehicle-mounted intelligent cabin system to a multi-screen cooperation and cross-domain interaction direction, a vehicle-mounted multimedia control method supporting multi-screen interaction and seamless content circulation gradually becomes one of core technologies of man-machine interaction design. The system realizes multi-terminal collaborative display and operation continuation of navigation, entertainment, communication and other contents by establishing a unified content situation management and time sequence control mechanism among a main screen, an auxiliary screen, an instrument screen and a rear entertainment screen. However, in the multi-screen parallel, asynchronous refreshing and cross-screen state migration processes, the time synchronization and semantic inheritance inside the system are difficult to be consistent, so that a potential phenomenon of time sequence-semantic coupling instability is formed. Specifically, when the refresh rate, rendering delay and communication clock of each display screen have small differences, the time reference of the system can drift, so that the interactive sampling and content presentation of different screens are misplaced. The time drift not only causes visual dyssynchrony of the cross-screen content, but also directly interferes with the accuracy of state coding and context inheritance. Since the context inheritance module generally relies on time sequence features to reconstruct user operation intent, once time base drift breaks continuity of interaction events, the system may misjudge user behavior when performing semantic coding, and analyze an original coherent operation sequence into a plurality of independent segments, thereby generating semantic ambiguity. This semantic ambiguity in turn exacerbates the accumulation of time drift. When the context state is not correctly restored, the content situation reconstruction module calculates the synchronization time of the content refresh rate and the target screen based on the wrong semantic state, so that the screen rendering plan is further misplaced from the actual clock. In order to correct the deviation, the system often triggers repeated synchronous instructions and rendering callbacks, so that time drift and semantic deviation form nonlinear positive feedback, which not only causes visual anomalies such as multi-screen flickering and content jumping, but also causes system-level instability of thread rescheduling and cache repeated reconstruction. Disclosure of Invention In order to overcome the above-mentioned drawbacks of the prior art, embodiments of the present invention provide an on-vehicle multimedia system and a control method for supporting multi-screen interaction and seamless transfer of content, so as to solve the problems set forth in the above-mentioned background art. In order to achieve the above purpose, the present invention provides the following technical solutions: the vehicle-mounted multimedia system supporting multi-screen interaction and seamless content circulation comprises a data acquisition module, a drift and deviation calculation module, a coupling evaluation module, a self-correction starting module, a context recovery module and a control instruction broadcasting module; The data acquisition module is used for acquiring frame clock signals, rendering time delay, interaction events and content situation characteristics of the main screen, the auxiliary screen and the rear display screen, constructing a time sequence semantic joint monitoring chain and forming a time and semantic double-domain unified feature stream; the drift and deviation calculation module is used for calculating the cross-screen time drift and the context ambiguity by applying a drift operator and a semantic deviation operator on the unified feature stream and forming a collaborative index through a weighting formula; the coupling evaluation module is used for defining a time sequence-semantic coupling evolution equation according to the collaborative index and evaluating whether the time sequence-semantic dislocation coupling instability trend occurs in the system or not; The self-correction starting module is used for triggering a time drift self-correction mechanism according to the time sequence-semantic dislocation coupling instability trend and dynamically adjusting the screen refreshing phase and the frame synchronization proportion; the context recovery module is used for recovering a context inheritance semantic path through the historical behavior track and the current state code after the t