Search

CN-121982946-A - Education and training system and device based on VR

CN121982946ACN 121982946 ACN121982946 ACN 121982946ACN-121982946-A

Abstract

The invention discloses an education training system based on VR, which relates to the technical field of virtual reality education training, and comprises a client, a central processing module, a vision module, a modeling module and an education training device, wherein the client is used for logging in an account, the central processing module is used for processing data, the vision module is used for recognizing facial expressions of a user and is connected with the central processing module, the modeling module is used for building a user virtual model and is linked with the vision module, and the education training device specifically comprises the vision module for recognizing the facial expressions of the user and connecting the modeling module to update the virtual model in real time.

Inventors

  • Zhan Taiqi

Assignees

  • 衡阳阳翔互联网科技有限公司

Dates

Publication Date
20260505
Application Date
20251231

Claims (7)

  1. 1. The VR-based education and training system comprises a client (1) and is used for logging in an account, and is characterized by further comprising a central processing module (2) for processing data, a vision module (3) for recognizing facial expressions of a user and connected with the central processing module, and a modeling module (4) for building a user virtual model and linking the vision module.
  2. 2. The VR based educational training system of claim 1, further comprising a temperature acquisition module (5) for monitoring user body temperature and ambient temperature data, an output of said temperature acquisition module being coupled to said central processing module for transmitting said user body temperature and ambient temperature data to said central processing module.
  3. 3. The VR-based educational training system as set forth in claim 1, wherein said account number comprises a management account number, a teaching account number, and a supervision account number, said management account number, said teaching account number, and said supervision account number cooperatively enabling a user to log in at said client (1).
  4. 4. A VR-based educational training system as set forth in claim 3, characterized in that said management account is a system configuration account that is logged in through said client (1) and connected to said central processing module (2) for sending system configuration instructions (19) to said central processing module (2) for parameter setting and management of said client (1), said central processing module (2), said vision module (3) or said modeling module (4).
  5. 5. The VR based educational training system of claim 4, wherein said supervising account is a passive viewing account, said supervising account establishing a data connection with said central processing module (2) for receiving and displaying user facial expression data recognized by said vision module (3) and user virtual model pictures generated by said modeling module (4) forwarded by said central processing module (2) when logging in said supervising account via said client (1).
  6. 6. The VR-based educational training system as set forth in claim 5, wherein said teaching account is a learning account, and wherein when a user builds his own virtual model through said management account, a data connection is established with said central processing module (2) to realize real-time learning.
  7. 7. The VR based educational training system of any of claims 1-6, wherein the collection is built into an electronic device.

Description

Education and training system and device based on VR Technical Field The invention relates to the technical field of virtual reality education and training, in particular to an education and training system based on VR and a device thereof. Background The existing online education and training system has the common dilemma of low user participation and poor learning effect. In a remote learning scene, the on-hook behaviors of students are frequent, namely, the students leave the equipment or are in a non-concentration state for a long time after logging in the system, and the system cannot effectively recognize and intervene, so that training resource waste and learning targets are difficult to achieve. The problem of insufficient interaction is highlighted by lack of natural emotion communication between teachers and students, and the interaction in the virtual environment often flows on the surface, so that the real-time feedback and emotion resonance of a real classroom cannot be simulated. The poor reality is caused by the fact that the virtual avatar is seriously disjointed from the actual state of the user, for example, the expression change of the user cannot be mapped into the virtual model in real time, so that the virtual environment appears stiff and unrealistic, and the immersion and learning power are weakened. The traditional VR education system is generally only provided with two types of simple accounts, namely a teacher and a student, lacks multi-level management mechanisms such as a management account, a teaching account, a supervision account and the like, and cannot support role division and cooperation in a complex teaching scene. More importantly, these systems fail to integrate facial expression recognition technology for real-time user state monitoring, for example, the concentration degree, emotion fluctuation or cognitive load of the user cannot be estimated by analyzing the eye movements, mouth angle changes and other fine expressions of the user, so that the system cannot dynamically adjust teaching strategies to cope with the distraction or confusion state of the user. While the prior art attempts to improve by building a virtual scene or capturing limb movements, these schemes tend to ignore the critical dimension of facial expressions, making user state detection unilateral. For example, some systems can generate the images of the virtual students and analyze the behaviors of the virtual students, but do not dynamically link expression data with the virtual model, so that the virtual avatar cannot truly reflect the current psychological state of the user, while other systems have a basic face capturing function, but are only used for simple emotion classification, are not deeply combined with educational training flows, and are difficult to effectively prevent on-hook behaviors or improve interaction quality. The intelligent remote education system is characterized in that a virtual scene is built, an expression recognition module is not included, fine emotion changes of a user cannot be captured, an intelligent teaching system integrates motion capture and face capture, an evaluation mechanism is isolated and operated, expression data cannot be driven to update a virtual model in real time, a multi-person virtual experiment teaching system is focused on operation interaction information synchronization, evaluation of expression monitoring on the concentration degree of the user is ignored, a nursing operation exercise platform records limb movement tracks, focuses on skill assessment, multi-stage account management and expression state comprehensive analysis in education training are not covered, and the remote virtual teaching system is matched with teacher resources of different levels, but lacks expression recognition technical support, so that the whole process real participation of the user cannot be ensured. The defects commonly cause the system to have obvious short plates in the aspects of preventing the on-hook behavior, enhancing the interactive reality and realizing the overall user state perception, so that users can be in a non-learning state for a long time without being aware of the system, and the reality sense and teaching pertinence of the virtual environment are continuously insufficient. Based on this, there is a need for VR based educational training systems and devices therefor that address or at least alleviate the above-described deficiencies. Disclosure of Invention The invention mainly aims to provide an education and training system and device based on VR, and provides an education and training system based on VR, which has the advantages of effectively improving the monitoring capability of user states, enhancing the reality and interactivity of virtual environments and further improving learning effects. In order to achieve the above purpose, the technical scheme adopted by the invention is as follows: The application provides an education and tra