Search

CN-121983223-A - Language rehabilitation training interaction system for autism spectrum disorder children

CN121983223ACN 121983223 ACN121983223 ACN 121983223ACN-121983223-A

Abstract

The invention relates to the technical field of rehabilitation medical treatment and digital health, in particular to a language rehabilitation training interaction system for children with autism spectrum disorders, which comprises a user terminal and a server, wherein the user terminal comprises a parent terminal, a child interaction terminal and an expert management terminal, and the server comprises a data acquisition module, a data verification module, a personalized training module and an evaluation module. The system receives a child training video from a parent terminal, receives voice, operation behaviors and response duration data from a child interaction terminal, carries out logic association verification on multi-terminal association data, marks verified training data, updates child ability evaluation data based on the last verified training data, generates and pushes a personalized training task package through a personalized training module, quantitatively evaluates the language ability, social interaction behaviors and compliance indexes of the child based on the verified training data in a preset evaluation period, generates a visual evaluation report, and further comprises an early warning and prompting module capable of timely pushing early warning information.

Inventors

  • Tian Renqiong
  • SHANG HUIJING
  • LIU WANG

Assignees

  • 遵义市第一人民医院(遵义医学院第三附属医院)

Dates

Publication Date
20260505
Application Date
20260128

Claims (8)

  1. 1. The language rehabilitation training interaction system for the autism spectrum disorder children is characterized by comprising a user terminal and a server, wherein the user terminal comprises a parent terminal, a child interaction terminal and an expert management terminal; the server comprises a data acquisition module, a data verification module, a personalized training module and an evaluation module; The system comprises a data acquisition module, a child interaction terminal, a child interaction module, a data acquisition module and a response time length module, wherein the data acquisition module is used for receiving a child training video from the parent terminal, the voice data comprises pronunciation and statement expression data when the child completes an interactive training task, the operation behavior data comprises screen click and gesture interaction data when the child completes the interactive training task, and the response time length data comprises task response delay and single-ring-section completion time consumption data when the child completes the interactive training task; The data verification module is used for integrating the child training video, the voice data, the operation behavior data and the response time length data in the same standardized training period to obtain training data, carrying out logic relevance verification, and marking the verified training data as verified training data, wherein the standardized training period is a training period which is developed according to preset frequency and lasts for preset time length each time; The personalized training module is used for outputting a personalized training task package according to child capacity evaluation data and the last verified training data, the personalized training task package comprises a guide video, an interactive checkpoint and an enhancer animation, the personalized training module is used for pushing the personalized training task package to a parent terminal and a child interaction terminal, the child capacity evaluation data comprises a language definition score, an accumulated vocabulary and an instruction compliance correct rate, the child capacity evaluation data is collected through a standardized scale and is dynamically updated based on the verified training data after an intervention event, the intervention event is a behavior that the system pushes the training task package to the child interaction terminal for the first time and starts data collection, the language definition score represents the intelligibility of child pronunciation, the accumulated vocabulary is capable of actively pronouncing and understanding the total number of meanings, and the instruction compliance correct rate represents the execution correct rate of the child to the instruction; The evaluation module is used for quantitatively evaluating the language ability, social interaction behavior and compliance index of the child according to the verified training data in the preset evaluation period, and generating a visual evaluation report.
  2. 2. The language rehabilitation training interaction system for autism spectrum disorder children according to claim 1, wherein the data verification module comprises a space-time correlation verification unit, a behavior result logic verification unit and a data integrity check unit; the time-space correlation verification unit is used for verifying whether the time stamp and the place information of the child training video reported by the parent terminal are matched with the task starting time and the equipment identification recorded by the child interaction terminal and are within a preset tolerance range; The behavior result logic verification unit is used for judging whether a key behavior frame in the child training video corresponds to a corresponding task node recorded by the child interaction terminal, and the judgment standard comprises whether the time stamp deviation of the action occurrence time of the key behavior frame and the operation behavior data meets the preset time deviation requirement, whether the acquisition time period of the child pronunciation action and the voice data in the behavior frame meets the preset coincidence condition, and whether the difference value of the reaction time length data and the task execution time consumption in the behavior frame is in the preset difference value range; the data integrity checking unit is used for checking that the difference value between the training duration corresponding to the child training video in the single training data and the total time consumption recorded by the child interaction terminal meets the preset duration difference value requirement; and marking the training data as verified training data if and only if the verification results of the space-time correlation verification unit, the behavior result logic verification unit and the data integrity check unit all accord with preset rules.
  3. 3. The language rehabilitation training interaction system for autism spectrum disorder children according to claim 2, wherein the personalized training module comprises a child ability information unit, a task difficulty setting model and a content generation unit; the child ability information unit is used for dynamically updating the child ability evaluation data according to the last verified training data; The task difficulty setting model is input into child ability evaluation data and outputs optimal challenge difficulty of a recommended task, wherein the optimal challenge difficulty comprises vocabulary difficulty grades, sentence complexity grades and interaction link strength, the vocabulary difficulty grades are divided into a first grade, a second grade and a third grade according to language definition scores and preset scoring thresholds, the sentence complexity grades are divided into the first grade, the second grade and the third grade according to accumulated vocabulary quantity and preset vocabulary quantity thresholds, and the interaction link strength is divided into the first grade, the second grade and the third grade according to instruction compliance accuracy and preset accuracy thresholds; The content generation unit is used for automatically assembling and generating a personalized training task package comprising a guide video, an interactive checkpoint and an enhancer animation from the multimedia resource library according to the optimal challenge difficulty and the preset training target.
  4. 4. The language rehabilitation training interaction system for autism spectrum disorder children according to claim 3, wherein the evaluation module comprises a voice feature analysis unit, a social behavior quantification unit and a progress tracking unit; The voice characteristic analysis unit is used for automatically analyzing the voice data in the verified training data, extracting the characteristics of voice speed, average sentence length and specific phoneme correct rate, and outputting voice capability change trend data; the social behavior quantification unit is used for analyzing the child training video in the verified training data through a computer vision technology, quantifying the eye contact frequency, common attention frequency and emotion response frequency of the child, and outputting social interaction capacity scores; The progress tracking unit is used for calculating and outputting a compliance index based on the completion frequency, the task interruption rate and the preset training plan achievement rate in the verified training data, wherein the completion frequency is the ratio of the number of standardized training periods actually completed in a preset period to the number of preset standardized training periods, the task interruption rate is the ratio of the number of task interruption times in a single standardized training period to the total number of tasks, and the preset training plan achievement rate is the ratio of the actually completed training inner capacity to the preset training inner capacity.
  5. 5. The language rehabilitation training interaction system for the autism spectrum disorder children according to claim 4, wherein the children interaction terminal is a tablet personal computer or a robot carrying special interaction application, is integrated with a microphone and a front camera, and is used for presenting the content of a training task package, and collecting voice data, operation behavior data and response duration data of the children and synchronizing the voice data, the operation behavior data and the response duration data to a data collecting module of a server.
  6. 6. The language rehabilitation training interaction system for the autism spectrum disorder children according to claim 5, wherein the parent terminal is a smart phone provided with a parent terminal application program, and the functions of the system comprise at least receiving and viewing a personalized training task package, shooting and uploading a child training video, receiving a visual evaluation report and system prompt information, wherein the system prompt information comprises a training related prompt, a data uploading related prompt, an evaluation report updating prompt and a training operation guidance prompt.
  7. 7. The language rehabilitation training interaction system for the autism spectrum disorder children according to claim 6, wherein the expert management terminal is used by rehabilitation therapists or researchers, is used for checking dynamic capability evaluation data, verified training data and visual evaluation reports of managed children in batches, can manually calibrate parameters such as difficulty matching coefficients, data weights and the like of personalized recommendation models, and can supplement or replace and update guide videos, interactive checkpoints and reinforcement animations in a multimedia resource library.
  8. 8. The language rehabilitation training interaction system for autism spectrum disorder children according to claim 7, further comprising an early warning and prompting module, wherein when any index of the voice ability change trend data and the social interaction ability score is continuously evaluated for cycle arrest or decline by preset times, or the compliance index is lower than a preset compliance threshold, early warning information is automatically generated and pushed to the expert management terminal.

Description

Language rehabilitation training interaction system for autism spectrum disorder children Technical Field The invention relates to the technical field of rehabilitation medical treatment and digital health, in particular to a language rehabilitation training interaction system for children with autism spectrum disorders. Background Autism Spectrum Disorder (ASD) is a common group of neurological dysplastic disorders whose central clinical manifestations include social communication disorders, language retardation, and repetitive notch behaviors. Clinical studies have demonstrated that early, dense and personalized linguistic intervention is a key means to improve ASD children prognosis. However, the traditional ASD children language rehabilitation intervention mode faces a plurality of reality dilemmas that firstly, professional treatment teachers and resources are scarce and unevenly distributed, children in remote areas are difficult to obtain high-quality intervention service, face-to-face intervention is high in cost, long-term intervention brings heavy economic burden to families, secondly, training data depend on parents to report automatically in the family intervention process, objective verification mechanisms are lacking, so that data authenticity is doubtful, curative effect evaluation accuracy is affected, thirdly, the training content of the traditional intervention system is mostly static preset, dynamic adjustment is difficult to realize according to real-time training of the children, individuation suitability is insufficient, interaction form is single and boring, training interests of ASD children are difficult to maintain, family intervention compliance is generally low, final effect evaluation is also dependent on subjective scales, quantitative analysis of multi-mode data in the training process is lacking, and accurate closed loop feedback is difficult to form. In recent years, a parental-mediated intervention mode based on a mobile terminal is gradually rising, but the prior art still does not solve the problems. Therefore, there is a need for an autism spectrum disorder children language rehabilitation training interaction system that can guarantee the authenticity of training data, realize dynamic personalized intervention, promote children engagement and perform multidimensional intelligent evaluation. Disclosure of Invention Aiming at the defects of the prior art, the invention aims to provide the language rehabilitation training interaction system for the children with autism spectrum disorder, which can improve the effectiveness, accessibility and accuracy of rehabilitation training. The basic scheme provided by the invention is that the autism spectrum disorder children language rehabilitation training interaction system comprises a user terminal and a server, wherein the user terminal comprises a parent terminal, a children interaction terminal and an expert management terminal; the server comprises a data acquisition module, a data verification module, a personalized training module and an evaluation module; The system comprises a data acquisition module, a child interaction terminal, a child interaction module, a data acquisition module and a response time length module, wherein the data acquisition module is used for receiving a child training video from the parent terminal, the voice data comprises pronunciation and statement expression data when the child completes an interactive training task, the operation behavior data comprises screen click and gesture interaction data when the child completes the interactive training task, and the response time length data comprises task response delay and single-ring-section completion time consumption data when the child completes the interactive training task; The data verification module is used for integrating the child training video, the voice data, the operation behavior data and the response time length data in the same standardized training period to obtain training data, carrying out logic relevance verification, and marking the verified training data as verified training data, wherein the standardized training period is a training period which is developed according to preset frequency and lasts for preset time length each time; The personalized training module is used for outputting a personalized training task package according to child capacity evaluation data and the last verified training data, the personalized training task package comprises a guide video, an interactive checkpoint and an enhancer animation, the personalized training module is used for pushing the personalized training task package to a parent terminal and a child interaction terminal, the child capacity evaluation data comprises a language definition score, an accumulated vocabulary and an instruction compliance correct rate, the child capacity evaluation data is collected through a standardized scale and is dynamically updated based on the verifie