CN-121983268-A - Intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system and control method

CN121983268ACN 121983268 ACN121983268 ACN 121983268ACN-121983268-A

Abstract

The invention provides an intelligent health physiotherapy entertainment interaction device, a multi-source audio/video bidirectional cooperative interaction system and a control method, and aims to solve the problem that a multi-source audio/video rhythm scheduling mechanism is lacked in the prior art. The system comprises a device end and a presentation end, wherein the device end and the presentation end realize bidirectional collaborative interaction through a bidirectional rhythm synchronization engine, the multimode data acquisition unit of the device end acquires action/physiological data during forward interaction, the presentation end is driven to play synchronous audio and video after rhythm characteristics are extracted, and the presentation end extracts the audio and video rhythm characteristics through machine vision and voice recognition during reverse interaction and converts the extracted audio and video rhythm characteristics into control instructions to drive the device end to execute multidimensional actions. The invention supports multi-sensing/non-sensing full-scene adaptation, has an intelligent resource seamless switching function, can realize recreation and personalized health physiotherapy experience, adapts to multiple scenes such as sleep aiding, postpartum recovery, physiological dysfunction training, body building training and the like, and has the advantages of high synchronization precision, strong adaptability and flexible interaction.

Inventors

DONG LEI
DONG ZHIYAO
Chen Mianli

Assignees

杭州赛思无际科技有限公司

Dates

Publication Date: 20260505
Application Date: 20260106

Claims (10)

1. The intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system comprises a device end, wherein the device end is connected with a presentation end, and the intelligent health physiotherapy entertainment interaction device is characterized in that a bidirectional rhythm synchronization engine is integrated between the device end and the presentation end and is used for realizing the following interaction: Forward interaction, namely converting action characteristics of the equipment end into control parameters to drive the presenting end to play the rhythmically synchronous audio and video contents; Reverse interaction, namely converting the audio and video characteristics of the presentation end into control parameters to drive the equipment end to execute the physical action of rhythm synchronization; The forward interaction and the reverse interaction can operate independently or simultaneously.
2. The intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system according to claim 1, wherein the equipment end comprises a microcontroller, a wireless communication module, a multi-mode data acquisition unit for acquiring motion data and a motion execution driving core module for executing multi-dimensional motion.
3. The interactive device for intelligent health physiotherapy and entertainment and the multi-source audio/video bidirectional collaborative interaction system according to claim 2, wherein the multi-mode data acquisition unit comprises one or more of an acceleration sensor, a gyroscope sensor, a pressure sensor, a blood oxygen sensor and a heart rate sensor.
4. The intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system according to claim 3, wherein the multi-mode data acquisition unit processes motion data by adopting an adaptive weight fusion algorithm: And dynamically distributing the fusion weights of the acceleration, the gyroscope and the pressure sensor data according to the motion state coefficients, lifting the gyroscope weight in a moving scene, lifting the acceleration weight in a fixed vibration scene, and lifting the boost weight in a pressing scene.
5. The intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system according to claim 2, wherein the multi-mode data acquisition unit is a sensorless mechanical detection scheme, comprising: the Hall element is used for detecting displacement change of the action part at any moment; And/or a motor parameter detection module for collecting back electromotive force or phase current or other parameters approximately representing mechanical motion intensity of the motor; And calculating the simulated motion acceleration, speed or rhythm characteristics through the displacement change or motor parameters and the mathematical mapping relation.
6. The system of claim 1, wherein the presentation end comprises a multi-source audio/video scheduling module for scheduling audio/video content, a motion-audio/video mapping engine for implementing bi-directional feature conversion, and an audio/video sensing and control conversion module for extracting features from audio/video.
7. The interactive system of intelligent health physiotherapy entertainment and interaction device and multi-source audio/video bidirectional cooperation according to claim 6, wherein the multi-source audio/video scheduling module has an intelligent seamless switching function: The scheduling source is automatically switched from the current resource pool to a lower latency or more local resource pool upon detection of at least one of a network outage, an AI generation delay exceeding a threshold, an action repeatability exceeding a threshold, or a device power being below a threshold.
8. An intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional cooperative interaction control method, which adopts the intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional cooperative interaction system as set forth in any one of the claims 1-7, is characterized by comprising the following steps: s1, initializing a system and establishing connection; S2, receiving an interaction mode instruction selected by a user; s3, executing a selected interaction mode: If the mode is the forward mode, executing a forward interaction flow; if the mode is the reverse mode, executing a reverse interaction flow; And if the mode is a bidirectional mode, executing the forward interaction flow and the reverse interaction flow concurrently.
9. The method for controlling bidirectional collaborative interaction between an intelligent health physiotherapy entertainment interaction device and a multi-source audio/video according to claim 8, wherein the control flow of forward interaction comprises: s41, collecting original motion data of a device end; s42, processing the original motion data and extracting standardized action rhythm characteristics; S43, transmitting the action rhythm characteristics to a presentation end; S44, scheduling matched audio and video contents from an AI generation resource pool, a pre-generation resource pool or a preset resource pool based on the action rhythm characteristics and the real-time scene information; s45, converting the action rhythm characteristics into audio and video control parameters according to a preset mapping rule and playing corresponding contents; And S46, monitoring and adjusting the synchronization error.
10. The method for controlling the interaction between the intelligent health physiotherapy entertainment interaction device and the multi-source audio/video bi-directional collaborative interaction according to claim 8, wherein the control flow of the reverse interaction comprises the following steps: S51, loading an audio and video source at a presentation end; s52, extracting visual action characteristics and/or audio rhythm characteristics of the audio and video source through the machine visual sub-module and/or the voice recognition sub-module; S53, converting the characteristics into standardized equipment control instructions; S54, transmitting an equipment control instruction to an equipment end; s55, the equipment end analyzes and executes the equipment control instruction, and drives the action execution module to complete corresponding actions.

Description

Intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system and control method Technical Field The invention belongs to the technical field of intelligent health equipment and man-machine interaction, and particularly relates to an intelligent health physiotherapy entertainment interaction device and multi-source audio/video bidirectional collaborative interaction system and a control method. Background The existing physiotherapy equipment, body-building devices, physiological dysfunction trainer, postpartum rehabilitation trainer, dance training and physical training interaction schemes are all one-way interaction architecture, and cannot meet the immersive health requirements of users on multi-sensor/sensorless adaptation, bidirectional rhythm synchronization and multi-source audio-video linkage; the sensor chip is only used for collecting the motion of equipment, can not drive the motion of the equipment and can not drive the audio and video content, has single rhythm interaction dimension and no double synchronization capability, part of technologies can only realize simple audio effect of equipment motion driving, but have no capability of controlling the motion of the equipment in the opposite direction, can not form equipment-audio and video closed loop interaction, has limited type of the audio and video driving motion, is strong in sensor dependence, only supports the basic vibration of the audio and video driving equipment, can not realize the regular synchronization of multi-dimensional motions such as stretching, rotating, beating, point vibration and swinging, can not realize the linkage after being dependent on the sensor, can not accurately drive the motion of the equipment under the sensorless scene, has insufficient technology universality, has the defects of logic deficiency of multi-source audio and video adaptation, has insufficient robustness, has the problems of being dependent on strong cloud switching interruption, being incapable of adapting to private health-physiotherapy scenes and the like, has the defects of low synchronization precision, has the defect of simple touch response in the prior art, the accurate mapping model of the no action-audio and video rhythms has the rhythms synchronous delay of >200ms and the matching error of >15 percent, and cannot meet the rhythms cooperative requirement of the fine health physiotherapy entertainment scene. In order to solve the defects existing in the prior art, long-term exploration is performed, and various solutions are proposed. For example, chinese patent literature discloses a portable integrated intelligent interactive exercise system and method [201910647389.1] comprising portable integrated intelligent exercise equipment, a data acquisition and sensing module, a mobile terminal, an app program, external audio and video equipment and a wireless communication module. The scheme solves the problem of single sensing mode to a certain extent, but the scheme still has a plurality of defects, such as low synchronization precision, lack of a scheduling mechanism of multi-source audio and video, and the like. Disclosure of Invention Aiming at the problems, the invention provides a multi-mode sensing intelligent health physiotherapy entertainment interaction device capable of realizing multi-source audio and video scheduling and a multi-source audio and video bidirectional collaborative interaction system. The invention further aims to provide an intelligent health physiotherapy entertainment interaction device with good interactivity and a multi-source audio/video bidirectional collaborative interaction control method aiming at the problems. In order to achieve the purpose, the intelligent health physiotherapy entertainment interaction device and the multi-source audio/video bidirectional collaborative interaction system adopt the following technical scheme that the intelligent health physiotherapy entertainment interaction device and the multi-source audio/video bidirectional collaborative interaction system comprise equipment ends, the equipment ends are connected with presentation ends, a bidirectional rhythm synchronization engine is integrated between the equipment ends and the presentation ends, and the bidirectional rhythm synchronization engine is used for realizing the following interaction: forward interaction, namely converting action characteristics of the equipment end into control parameters to drive the presentation end to play the audio and video contents with synchronous rhythms; reverse interaction, namely converting the audio and video characteristics of the presentation end into control parameters, and driving the equipment end to execute the physical action of rhythm synchronization; the forward interaction and the reverse interaction can operate independently or simultaneously. In the intelligent health physiotherapy entertainment inte