CN-121983270-A - Regulating and controlling method and system based on multi-level Chinese character writing motion rhythm and nerve oscillation feedback

CN121983270ACN 121983270 ACN121983270 ACN 121983270ACN-121983270-A

Abstract

The invention discloses a regulating and controlling method and a regulating and controlling system based on multi-level Chinese character writing motion rhythms and nerve oscillation feedback, which are used for collecting high-time sequence precision motion data when a user writes, extracting multidimensional motion time sequence signals for performing behavior rhythmic feature analysis and constructing a behavior rhythmic template; the method comprises the steps of synchronously collecting multichannel electroencephalogram signals of a user, obtaining nerve oscillation characteristics through signal processing, establishing a cross-modal mapping model between behavior rhythm characteristics and the nerve oscillation characteristics, defining a nerve oscillation standard template for reflecting writing rhythm fluency, collecting the electroencephalogram signals of the user during writing tasks in real time, aligning the electroencephalogram characteristics to the nerve oscillation standard template, calculating real-time deviation between real-time nerve activities and the standard template, generating and presenting a visualized rhythm guiding template, simulating the writing of the rhythm guiding template by the user, performing closed-loop feedback regulation and control on the rhythm guiding template based on the real-time electroencephalogram signals, efficiently remodelling individual brain nerve activity rhythms, and realizing behavior intervention.

Inventors

YANG YANG
Zhang Aoxue

Assignees

中国科学院心理研究所

Dates

Publication Date: 20260505
Application Date: 20260123

Claims (10)

1. A regulating and controlling method based on multi-level Chinese character writing motion rhythms and nerve oscillation feedback is characterized by comprising the following steps: acquiring high-time-sequence precision motion data of a user in a Chinese character writing task through digital writing equipment, and extracting multidimensional motion time sequence signals comprising motion time, time interval, instantaneous speed, acceleration and stroke pressure based on three levels of strokes, parts and whole characters; performing behavior rhythm feature analysis on the extracted multidimensional movement time sequence signals to construct a behavior rhythm template describing the individual writing movement time structure; synchronously acquiring multichannel electroencephalogram signals of a user in the writing task process, and acquiring nerve oscillation characteristics related to writing motions through signal preprocessing and characteristic extraction; establishing a cross-modal mapping model between behavior rhythm characteristics and nerve oscillation characteristics; defining a neural oscillation standard template for reflecting writing rhythm fluency based on the cross-modal mapping model; collecting an electroencephalogram signal of a user in a Chinese character writing task in real time, aligning the electroencephalogram characteristic to a nerve oscillation standard template, and calculating real-time deviation between real-time nerve activity and the standard template; A visual rhythm guiding template is dynamically generated and presented according to the real-time deviation, a user performs writing training by imitating the rhythm guiding template, and closed-loop feedback regulation and control are performed on the rhythm guiding template based on the real-time electroencephalogram signals.
2. The method according to claim 1, wherein the Chinese character writing task is a transcription task, and the test material used covers individual characters, combined characters and parts and is used for examining the motion rhythm characteristics of the Chinese character on three structural levels of strokes, parts and whole characters.
3. The method of claim 1, wherein the behavioral rhythm feature analysis comprises: stability characteristic analysis, namely calculating variation coefficients of all motion indexes in the repeating units; Performing sequence pattern feature analysis, performing cluster analysis on interval duration between strokes, and calculating autocorrelation of a motion sequence; And c, analyzing coordination characteristic analysis, namely analyzing cross-correlation relations among speed-pressure coupling coefficients and different motion events.
4. The method of claim 1, wherein the neural oscillation feature focuses on θ -band and β -band activities associated with motion planning, execution, and control, and is quantified using time-frequency analysis, inter-trial phase consistency analysis, and cross-frequency coupling analysis methods.
5. The regulation and control method according to claim 1, wherein a data-driven association algorithm is adopted to establish a cross-modal mapping model between behavioral rhythm characteristics and neural oscillation characteristics, and the cross-modal mapping model is used for determining the characterization relation of a specific neural oscillation mode to the stroke, component and whole word each level of motion rhythms.
6. The method of claim 1, wherein the defined neural oscillation criteria template is established based on a stable neural oscillation pattern of a typical skilled writer at the part and whole word level.
7. The regulation and control method according to claim 1, wherein the closed-loop feedback regulation and control is performed on the rhythm guiding template based on the real-time electroencephalogram signal, and the specific method comprises: evaluating the deviation between the electroencephalogram signal and the nerve oscillation standard template in real time; acquiring a personalized rhythm abnormal mode deviating from a nerve oscillation standard template; setting targeted training targets and parameters based on the personalized rhythm abnormal mode; guiding an individual to perform repeated writing training under closed-loop real-time feedback, and remodelling the writing movement rhythm and the related nerve oscillation mode.
8. A regulation and control system based on multi-level chinese character writing motion rhythms and neural oscillation feedback, the system comprising: The digital writing equipment is used for recording the multidimensional movement time sequence signals of the movement track, the pressure and the time sequence in the writing process of the user; the multichannel electroencephalograph is connected with the digital writing equipment and is used for synchronously collecting the full cranial nerve electrophysiology signals of a user in the writing process; a characteristic analysis module, a model construction module and a feedback regulation and control module are also embedded in the multichannel electroencephalograph; The characteristic analysis module is used for carrying out behavior rhythm characteristic analysis and nerve oscillation characteristic analysis on the multidimensional movement time sequence signal and the electroencephalogram signal respectively; The model construction module adopts a cross-modal correlation analysis algorithm to establish a cross-modal mapping model between multi-level behavior rhythm characteristics and nerve oscillation characteristics, and constructs a nerve oscillation standard template; The feedback regulation and control module maps the real-time electroencephalogram characteristics to a neural oscillation standard template space, calculates the real-time deviation between the neural oscillation standard template space and the standard mode, and dynamically generates a visualized rhythm guiding template on an interaction and training interface of the digital writing equipment according to the real-time deviation for a user to retrain.
9. The regulation and control system of claim 8, wherein the signature analysis module comprises: The behavior rhythm analysis unit is used for automatically dividing the written motion data, extracting the kinematic timing sequence characteristics of three layers of strokes, parts and whole characters, and calculating rhythm stability, sequence mode and coordination indexes of the kinematic timing sequence characteristics; and the neural oscillation analysis unit is used for preprocessing and time-frequency analyzing the synchronously acquired electroencephalogram signals and extracting the power, phase consistency and cross-frequency coupling characteristics of theta and beta frequency bands related to motion execution, planning and control.
10. The regulation system of claim 8, wherein the feedback regulation module comprises: the real-time signal decoding and deviation calculating unit maps the real-time electroencephalogram characteristics to a neural oscillation standard template space and calculates the real-time deviation between the neural oscillation standard template space and a standard mode; The self-adaptive guide template generating unit dynamically generates and adjusts a visualized optimized motion rhythm guide template according to the real-time deviation; And the user interaction and training interface presents the generated rhythm guiding template for the user to write and exercise.

Description

Regulating and controlling method and system based on multi-level Chinese character writing motion rhythm and nerve oscillation feedback Technical Field The invention belongs to the technical field of intersection of nerve engineering, rehabilitation engineering and education technology, and particularly relates to a regulating and controlling method and system based on multi-level Chinese character writing motion rhythms and nerve oscillation feedback, which are used for evaluating, intervening and improving reading and writing skills and nerve regulation and control. Background Writing is a complex learned vision-motor skill whose fluency depends on fine temporal organization, i.e., motor rhythms. Rhythms are patterns of regularity of behavior in the time dimension, and are also the extrinsic manifestations of brain neural oscillatory activity. Studies have demonstrated that the course of motion of skilled writers exhibits stable rhythmic structures (e.g., isochronism versus constant ratio) at multiple levels of strokes, parts, and whole words. In contrast, the destruction of this rhythm is closely related to various developmental disorders (e.g., specific writing disorder, attention deficit hyperactivity disorder, developmental coordination disorder) and neurological diseases (e.g., parkinson's disease), and is one of the core mechanisms that leads to insufficient writing fluency and writing disorder. Rhythms are a fundamental organizational principle of human motor and cognitive activities, referring to a structured pattern that repeatedly occurs over time. Various physiological activities (e.g., heart beat, respiration) and behaviors exhibit significant rhythmic characteristics. Rhythms provide a time-series organizational framework for actions and play a central role in the timing and strength regulation of actions. At present, the research generally divides the rhythm sources into two types, namely an endogenous spontaneous rhythm, which is derived from an inherent oscillation mechanism of a nervous system, so that an individual can still maintain continuous and stable action output when no external time clue exists, and an exogenous induced rhythm, which is coupled with internal nerve oscillation through a sensing channel (such as hearing or vision), so that the time sequence prediction and synchronization capability of the action are improved. The two mechanisms cooperate to support human beings to realize efficient and flexible motion coordination in a changeable environment. Writing is a human-specific "language-sport" process involving multiple levels of processing from language information extraction to sport execution. The skilled writing shows a high degree of automation in spatial layout and temporal sequence, a complex motor skill of closed-loop controlled, modular organization. Writing can be divided into two major components, central and peripheral. The central process mainly refers to the glyph extraction related processing, while the peripheral process mainly moves the execution part. Children typically begin to receive systematic writing training from around 6 years old to around 15 years old to develop a stable, efficient handwriting exercise pattern. The writing capability development is a control processing mode converted into an automatic processing process, and is mainly represented by the improvement of handwriting quality and the enhancement of movement fluency. The initial child writes in a stroke-by-stroke manner, with skill, with the basic coding unit gradually transitioning from stroke to letter or even letter strings. Writing is not only a fine movement but is also regulated by linguistic factors. According to the cascading model, linguistic variables continue to influence during the entire process from motion initiation until word completion. Studies have shown that syllables are the basic unit of coding for writing movements, with speech effects lasting from one to five years. The writing movement has a distinct temporal structure and repeating pattern. The skilled writer exhibits stable rhythm characteristics in stroke start, end, engagement and conversion, mainly in terms of isochronism and constant ratio. Isochrony means that the whole writing unit (such as a word) keeps the time length relatively constant under different writing conditions to reflect the whole stability of the writing rhythm, and constant ratio means that when the writing speed is changed, the duration time of each sub-event is synchronously stretched in proportion so as to maintain the coordination structure among the movement units. The two principles ensure that writing is still smooth and stable under different speeds, sizes or complexity. For example, as font size increases, writing speed increases accordingly to maintain single stroke movement time constant, embodying a constant ratio mechanism. More notably, children already possess internal rhythm characterization even though automated writing