Search

CN-122024306-A - Automatic scoring and artistic expression power assisting system for complete set of actions of artistic gymnastics

CN122024306ACN 122024306 ACN122024306 ACN 122024306ACN-122024306-A

Abstract

The invention relates to the field of artificial intelligence, computer vision and sports science and technology, in particular to an automatic scoring and artistic expression power assisting system for an artistic gymnastics complete action, which comprises a gesture analysis module, a feature extraction module, a quality evaluation module, an artistic expression evaluation module, a comprehensive scoring module and a visual output module, wherein the system maps human body gestures to Riemann manifold based on differential geometry theory to construct a measurement space adapting to human body movement characteristics; the method realizes the comprehensive capture of microcosmic details and macroscopic harmony by a time-space multiscale manifold feature extraction technology, adopts geodesic distance as core measurement to objectively evaluate action quality, introduces an expression dynamic model on manifold to quantify artistic expression, realizes the objective evaluation of artistic gymnastics action difficulty, execution quality and artistic expression, and remarkably enhances the robustness of visual angle change, illumination condition and athlete stature difference.

Inventors

  • LI MANZI
  • JIANG YONG

Assignees

  • 深圳大学

Dates

Publication Date
20260512
Application Date
20251020

Claims (10)

  1. 1. Automatic scoring and artistic expression power assisting system for complete set of actions of artistic gymnastics, which is characterized by comprising: the gesture analysis module is used for receiving the artistic gymnastics competition video, extracting the coordinates of key points of a human body, constructing a skeleton topology connection relation, mapping the gesture in the Euclidean space to a Riemann manifold, and generating manifold gesture representation; the feature extraction module is connected with the gesture analysis module and is used for receiving the manifold gesture representation, executing multi-scale manifold decomposition, extracting time sequence dependent features and generating multi-level action features through manifold convolution operation; The quality evaluation module is connected with the characteristic extraction module and is used for receiving the multi-level action characteristics, matching with a standard action library, calculating a geodesic distance, evaluating action execution quality and generating an action difficulty score and an execution quality score; the artistic expression evaluation module is connected with the gesture analysis module and the feature extraction module and is used for analyzing the synchronization of actions and music, evaluating the facial expression change, calculating the action fluency and the overall coordination and generating an artistic expression score; the comprehensive scoring module is connected with the quality evaluation module and the art expressive force evaluation module and is used for fusing the difficulty score, the execution quality score and the art expressive force score to generate a final scoring result; And the visual output module is connected with the comprehensive scoring module and used for displaying scoring results, visualizing action deviation and providing technical improvement suggestions.
  2. 2. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein the gesture analysis module comprises: the key point detection unit is used for processing the input video and extracting 17 key joint point coordinates of the human body; the gesture estimation unit is connected with the key point detection unit and is used for constructing a human skeleton structure according to the key joint point coordinates; The manifold mapping unit is connected with the gesture estimation unit and is used for mapping the human skeleton structure from Euclidean space to Riemann manifold to construct manifold representation of gesture; And the gesture correction unit is connected with the manifold mapping unit and is used for carrying out noise suppression and normalization processing on the manifold representation to generate normalized manifold gesture representation.
  3. 3. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein the feature-extraction module comprises: the multi-scale analysis unit is used for performing multi-level decomposition on the manifold gesture representation to generate a feature pyramid; The time sequence modeling unit is connected with the multi-scale analysis unit and is used for capturing the time sequence dependency relationship of actions through parallel transmission operation on the manifold; the manifold convolution unit is connected with the multi-scale analysis unit and is used for executing local feature aggregation on manifold and extracting local structural features; and the characteristic integration unit is connected with the time sequence modeling unit and the manifold convolution unit and is used for fusing the multi-scale characteristics and the time sequence characteristics to generate comprehensive action characteristic representation.
  4. 4. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein the quality-assessment module comprises: The standard action matching unit is used for matching the multi-level action characteristics with a preset standard action library and identifying action types and difficulty levels; The geodesic distance calculation unit is connected with the standard action matching unit and is used for calculating manifold geodesic distance between the multi-level action characteristics and the standard action and quantifying action deviation; the difficulty recognition unit is connected with the standard action matching unit and is used for determining action difficulty scores according to the recognized action types and the difficulty grades; And the execution quality evaluation unit is connected with the geodesic distance calculation unit and is used for evaluating the execution accuracy of the action according to the manifold geodesic distance and generating an execution quality score.
  5. 5. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein the artistic-expression-level-assessment module comprises: the music synchronization analysis unit is used for extracting music beat characteristics, identifying action node time points and calculating the synchronization degree of actions and music; the expression recognition unit is used for detecting facial key points, recognizing expression change modes and evaluating coordination of expressions and actions; the action fluency unit is used for analyzing the smoothness of gesture conversion and evaluating the continuity of actions; and the integral coordination unit is used for evaluating coordination of all parts of the body and integral appearance aesthetic feeling and comprehensively generating an artistic expression score.
  6. 6. The automatic scoring and artistic-performance-enhancement assisting system of an artistic gym kit according to claim 1, wherein said manifold-gesture representation is generated by: The coordinates of key points of the human body are regarded as points on the Riemann manifold; constructing Riemann measurement adapting to human motion characteristics; defining a local coordinate system and connection characteristics on the manifold; extracting essential attitude characteristics by using manifold dimension reduction technology; an embedded representation of the pose manifold is constructed, maintaining the geometric invariance of the pose.
  7. 7. An automatic scoring and artistic-performance-enhancement assisting system for an artistic gym kit according to claim 3, wherein said multi-scale analysis unit performs multi-level decomposition by: Constructing a scale space on the manifold; designing discrete implementation of manifold diffusion process; Generating a feature pyramid comprising 5 scale levels; extracting a 64 to 256 dimensional feature representation at each scale level; and establishing association relations among the features of different scales.
  8. 8. The automatic scoring and artistic-expression-force-based system for an artistic gym suit according to claim 4, wherein said geodesic distance calculation unit calculates a manifold geodesic distance by: establishing a point-to-point corresponding relation between the action characteristics and the standard action characteristics; calculating the length of the geodesic wire between the corresponding points; Generating geodesic distance field distribution; Calculating a weighted geodesic distance statistic; The maximum deviation area is identified, and the motion quality difference is quantified.
  9. 9. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein said composite scoring module generates a final scoring result by: Setting a weight coefficient of a difficulty score, an execution quality score and an artistic expression score; Adjusting the scoring range of each part according to the international gymnastics association rule; calculating a comprehensive score by applying a weighted fusion algorithm; comparing and analyzing with the historical scoring data; a detailed score of the sub-term and a total score result are generated.
  10. 10. The automated scoring and artistic-performance-enhancement assisting system of an artistic gym kit of claim 1, wherein said visual output module comprises: A score display unit for displaying the score of each part and the total score in a graph form; The action deviation visualization unit is used for intuitively displaying the deviation position and degree of the action and the standard action through thermodynamic diagrams; The improvement suggestion generation unit is used for generating a targeted technical improvement suggestion according to the geodesic distance analysis result; and the history comparison unit is used for displaying the comparison analysis result of the current performance and the history performance of the athlete.

Description

Automatic scoring and artistic expression power assisting system for complete set of actions of artistic gymnastics Technical Field The invention relates to the field of artificial intelligence, computer vision and sports science and technology, in particular to an automatic scoring and artistic expression power assisting system for complete actions of an artistic gymnastics, which is used for objectively evaluating and quantitatively scoring action difficulty, execution quality and artistic expression of athletes in an artistic gymnastics match. Background The art gymnastics are sports which combine the artistic expressive force and the technical difficulty, and the match scores are usually judged by human judges according to rules formulated by the International gymnastics association. The traditional scoring method relies on subjective judgment of referees to a great extent, is easily influenced by factors such as personal preference, visual fatigue, distraction and the like, and causes inconsistency and disputes in scoring results. Currently, computer vision and deep learning techniques have advanced in the field of sports motion analysis, for example, the position of a key point of an athlete can be extracted by a gesture estimation algorithm, and different motion types can be classified by a motion recognition algorithm. However, the prior art mainly focuses on simple motion recognition and classification, and is difficult to accurately capture complex nonlinear motion characteristics in artistic gymnastics, and is more unable to quantitatively evaluate a highly subjective factor of artistic expression. Conventional motion analysis methods are generally based on coordinate representation in euclidean space, and such representation methods have obvious limitations in handling complex motions such as rotation and torsion in artistic gymnastics. In addition, the existing system often divides the motion into isolated segments for analysis, so that the consistency and fluency of the whole set of motion are difficult to capture, and the harmony of the motion and music cannot be estimated. Therefore, an automatic system capable of objectively and accurately evaluating the complete set of actions of the artistic gymnastics is needed, not only can the technical difficulty and the execution quality of the actions be evaluated, but also the artistic expression can be quantified, so that references are provided for referees, and scientific training feedback is provided for athletes and coaches. Disclosure of Invention The invention aims to provide an automatic grading and artistic expression power assisting system for an artistic gymnastics complete set of actions, and aims to solve the problems that grading subjectivity is strong, consistency is poor, complex action characteristics and artistic expression power cannot be accurately captured in the prior art. The invention provides an automatic scoring and artistic expression strength assisting system for an artistic gymnastics complete set of actions, which comprises the following components: the gesture analysis module is used for receiving the artistic gymnastics competition video, extracting the coordinates of key points of a human body, constructing a skeleton topology connection relation, mapping the gesture in the Euclidean space to a Riemann manifold, and generating manifold gesture representation; the feature extraction module is connected with the gesture analysis module and is used for receiving the manifold gesture representation, executing multi-scale manifold decomposition, extracting time sequence dependent features and generating multi-level action features through manifold convolution operation; The quality evaluation module is connected with the characteristic extraction module and is used for receiving the multi-level action characteristics, matching with a standard action library, calculating a geodesic distance, evaluating action execution quality and generating an action difficulty score and an execution quality score; the artistic expression evaluation module is connected with the gesture analysis module and the feature extraction module and is used for analyzing the synchronization of actions and music, evaluating the facial expression change, calculating the action fluency and the overall coordination and generating an artistic expression score; the comprehensive scoring module is connected with the quality evaluation module and the art expressive force evaluation module and is used for fusing the difficulty score, the execution quality score and the art expressive force score to generate a final scoring result; And the visual output module is connected with the comprehensive scoring module and used for displaying scoring results, visualizing action deviation and providing technical improvement suggestions. Preferably, the gesture analysis module includes: the key point detection unit is used for processing the input video and extracting