CN-122024560-A - AR system and method suitable for aeroengine teaching detection

CN122024560ACN 122024560 ACN122024560 ACN 122024560ACN-122024560-A

Abstract

The invention relates to the technical field of aeroengine detection, and belongs to the technical field of augmented reality, and the AR system and the method suitable for aeroengine teaching detection comprise an aeroengine teaching detection management module, a virtual model processing module, an AR rendering module, a data processing module, a reference mark management module and the like, wherein the reference mark management module is introduced, a high-temperature-resistant reference mark is deployed, an accurate mapping relation of a three-dimensional coordinate system is established, a real-time dynamic calibration algorithm is combined to calculate a coordinate offset and compensate and adjust a virtual information position, so that the accurate alignment of virtual faults and real faults is realized, the virtual-real matching error is controlled, the error is far superior to the error of the prior art, the high-temperature-resistant Wen Jizhun mark is adapted to the high-temperature and closed environment of an aeroengine cabin, the positioning of a fault position can be realized, and the problem that the positioning deviation of a traditional AR system in the aeroengine training is large is solved.

Inventors

SHI JING
LI ZHIAN
TIAN ZHENYUAN

Assignees

成都航空职业技术大学

Dates

Publication Date: 20260512
Application Date: 20260414

Claims (9)

1. The AR system suitable for the teaching detection of the aeroengine is characterized by comprising an aeroengine teaching detection management module, a virtual model processing module, an AR rendering module, a data processing module, a data management module, a reference mark management module and an exchange tracking module; The aeroengine teaching detection management module acquires and manages aeroengine teaching detection course data, and transmits course instructions and resource requests to the virtual model processing module for loading a specific aeroengine component model; The virtual model processing module receives a course resource request from the aeroengine teaching detection management module, inquires and acquires 3D model data of the aeroengine from the data management module, and transmits the 3D model data to the AR rendering module for superposition display of virtual information; the data processing module acquires ID and coordinate mapping data of the reference mark from the reference mark management module, receives the real-time video stream from the interactive tracking module, invokes an internal algorithm to process, and transmits a processing result to the AR rendering module for generating prompt information; The exchange tracking module acquires multi-mode input data of a learner, transmits a real-time video stream to the data processing module for feature recognition, and transmits processed gesture coordinates and head gesture data to the AR rendering module for adjusting the visual angle of virtual information and responding to the interaction of the learner; the reference mark management module maintains a mapping relation library of the ID of the reference mark and the aeroengine component, receives a mark identification request from the data processing module, transmits coordinate data of the mark to the data processing module, is used for space positioning, and calculates and transmits a coordinate offset after dynamic calibration to the AR rendering module; the data management module is used for receiving storage requests from other modules, providing 3D model data of the aeroengine for the virtual model processing module, providing course data and history learning data for the aeroengine teaching detection management module, providing fault library and detection model parameters for the data processing module, and providing mark deployment and calibration history data for the reference mark management module; The AR rendering module receives the 3D model data of the aeroengine from the virtual model processing module, receives fault information and prompt data from the data processing module, receives the dynamic calibration coordinate offset from the reference mark management module, receives the learner data from the interaction tracking module, integrates the input data, renders in real time to generate virtual information superimposed on a real scene, and displays the virtual information to the learner.
2. The AR system according to claim 1, wherein the exchange tracking module obtains multimodal input data of a learner including camera video stream, gesture motion, and head pose angle.
3. The AR system according to claim 1, further comprising a user management module, wherein the user management module obtains a login credential of a user, verifies a user identity and rights, and transmits user identity information and rights data to the aeroengine teaching detection management module to control course access and operation rights.
4. An AR system adapted for use in aeroengine teaching inspection according to claim 3, wherein said user identity comprises a learner and a teacher.
5. The AR system according to claim 3, further comprising a communication module, wherein the communication module receives a data upload instruction from the aeroengine teaching detection management module or the data management module, packages and transmits the local data to the cloud server, receives an update instruction or the aeroengine 3D model data from the cloud server, and transmits the update instruction or the aeroengine 3D model data to the data management module.
6. An AR method suitable for aeroengine teaching detection, based on an AR system implementation suitable for aeroengine teaching detection according to claim 5, characterized by comprising the following steps for a teacher: Logging in a system, creating or selecting courses through an aeroengine teaching detection management module, setting teaching parameters and assessment standards, and loading an aeroengine 3D model by an AR system; starting theoretical teaching through the aeroengine teaching detection management module, and triggering the AR rendering module to display the animation of the engine component; Selecting a preset fault through a fault setting submodule of the data processing module, deploying a reference mark on the entity engine, recording mark coordinates by a reference mark management module, scanning marks by AR glasses, and dynamically calibrating the position of a virtual fault prompt box by the system; triggering and dismantling a course through an aeroengine teaching detection management module, and displaying an animation by an AR rendering module; And generating an assessment task through the aeroengine teaching detection management module, and setting time limit.
7. The AR method for aircraft engine teaching inspection according to claim 6, further comprising recommending personalized content via the aircraft engine teaching inspection management module based on the assessment data.
8. An AR method suitable for aeroengine teaching detection, based on an AR system implementation suitable for aeroengine teaching detection according to claim 5, characterized by comprising the following steps for a learner side: logging in the system, selecting the same course, finishing environment registration by the AR glasses, and aligning the virtual model with the entity engine; Analyzing the animation through the AR glasses watching component, and clicking a virtual control by a learner through gesture rotation and/or scaling of the model, so as to explain the function of the component through system voice; Scanning an entity aeroengine, capturing a video stream by an interactive tracking module, identifying a reference mark by a data processing module, positioning a fault area, highlighting a fault point by an AR rendering module through an AR interface, confirming the fault position by a learner through gestures, verifying the operation accuracy of an AR system in real time, and triggering recalibration if the deviation is larger; Gradually operating along with the AR animation, using a gesture simulation tool, and prompting correct steps by an AR interface when the operation is wrong; and finishing the assessment task at the AR interface, and automatically grading by the AR system.
9. The AR method for use in aeroengine teaching inspection according to claim 8, further comprising receiving an AR reinforcement lesson, and interacting via an interaction tracking module.

Description

AR system and method suitable for aeroengine teaching detection Technical Field The invention relates to the technical field of aeroengine detection, in particular to an AR system and method suitable for aeroengine teaching detection. Background In the process of carrying out aeroengine explanation teaching, the structure and the connection relation of each part are required to be taught, in general, on-site teaching is adopted, and as the aeroengine configured under general conditions is limited, only one person can participate in the examination in the follow-up examination, and the teacher is required to frequently set an abnormal point, along with the development of science and technology, a part of institutions adopts an augmented reality system to carry out practical training teaching, such as a new energy automobile engine disassembly and assembly teaching system realizes fault setting and virtual model interaction through a mobile terminal APP, or utilizes AR technology to demonstrate oestrus characteristics in stages, and an electric detection remote guidance system realizes remote assistance based on head and gesture tracking. However, these systems exhibit significant drawbacks when applied to high precision, high risk scenes such as aeroengines: firstly, the existing fault setting module lacks a dynamic calibration mechanism, so that position deviation exists between preset virtual faults and artificially set real faults, and the positioning requirement of complex components of the aeroengine is difficult to meet; Secondly, the image recognition algorithm is insufficient in stability in a reflective or shielding environment, the recognition accuracy is limited, and the response delay affects real-time interaction; thirdly, the teaching flow is stiff, bidirectional self-adaptive adjustment of a teacher end and a student end is not supported, and the content cannot be dynamically optimized according to the operation of the student; fourth, the module has weak cooperativity, the data stream is split, and closed loop design aiming at the professional characteristics of the aeroengine is lacking. These deficiencies limit teaching efficiency and safety, and a new solution integrating high-precision calibration, low-delay interaction and intelligent teaching management is needed. Disclosure of Invention The invention aims to solve the problems, and provides an AR system and method suitable for teaching and detecting an aeroengine. The AR system suitable for the teaching detection of the aeroengine comprises an aeroengine teaching detection management module, a virtual model processing module, an AR rendering module, a data processing module, a data management module, a reference mark management module and an exchange tracking module; The aeroengine teaching detection management module acquires and manages aeroengine teaching detection course data, and transmits course instructions and resource requests to the virtual model processing module for loading a specific aeroengine component model; The virtual model processing module receives a course resource request from the aeroengine teaching detection management module, inquires and acquires 3D model data of the aeroengine from the data management module, and transmits the 3D model data to the AR rendering module for superposition display of virtual information; the data processing module acquires ID and coordinate mapping data of the reference mark from the reference mark management module, receives the real-time video stream from the interactive tracking module, invokes an internal algorithm to process, and transmits a processing result to the AR rendering module for generating prompt information; The exchange tracking module acquires multi-mode input data of a learner, transmits a real-time video stream to the data processing module for feature recognition, and transmits processed gesture coordinates and head gesture data to the AR rendering module for adjusting the visual angle of virtual information and responding to the interaction of the learner; the reference mark management module maintains a mapping relation library of the ID of the reference mark and the aeroengine component, receives a mark identification request from the data processing module, transmits coordinate data of the mark to the data processing module, is used for space positioning, and calculates and transmits a coordinate offset after dynamic calibration to the AR rendering module; the data management module is used for receiving storage requests from other modules, providing 3D model data of the aeroengine for the virtual model processing module, providing course data and history learning data for the aeroengine teaching detection management module, providing fault library and detection model parameters for the data processing module, and providing mark deployment and calibration history data for the reference mark management module; The AR rendering module receives the 3D model