CN-122018670-A - AR-based cultural relic restoration and real-time interaction system

Abstract

The application discloses an AR-based cultural relic repairing and real-time interaction system, which relates to the technical field of cultural relic repairing, wherein a cultural relic activating and repairing module is used for acquiring cultural relic images shot by a camera of an AR (augmented reality) eyeglass, performing deletion repairing and three-dimensional modeling based on the cultural relic images to obtain a cultural relic three-dimensional model, displaying the cultural relic three-dimensional model to a user through the AR eyeglass, a database is used for storing the cultural relic three-dimensional model and corresponding cultural relic information, a real-object recognition module is used for acquiring the cultural relic images shot by the camera of the AR eyeglass, determining characteristic data of the cultural relic based on the cultural relic images by the entity recognition model, determining cultural relic three-dimensional model and cultural relic information stored in the database based on the characteristic data, displaying the cultural relic three-dimensional model cultural relic and the cultural relic information to the user through the AR eyeglass, and an intelligent role interaction module is used for recommending voice introduction and interactive content of the cultural relic for the user in real time based on the user data along a route of the user. The method and the device realize accurate identification, repair and accurate recommendation of the cultural relics.

Inventors

• PAN JUN

Assignees

• 北京中嘉空间展示设计有限公司

Dates

Publication Date

20260512

Application Date

20250206

Claims (10)

1. 1. The AR-based cultural relic repairing and real-time interaction system is characterized by comprising AR glasses, a cultural relic activating and repairing module, a physical identification module, an intelligent role interaction module and a database, wherein the cultural relic activating and repairing module, the physical identification module, the intelligent role interaction module and the database are deployed in the AR glasses; the cultural relic activation and restoration module is used for: acquiring cultural relic images shot by cameras of AR (augmented reality) glasses; Performing deletion repair and three-dimensional modeling based on the cultural relic image to obtain a cultural relic three-dimensional model; Displaying the cultural relic three-dimensional model to a user through the AR glasses; The database is used for storing the three-dimensional model of each cultural relic and the corresponding cultural relic information; The entity identification module is used for: acquiring cultural relic images shot by cameras of AR (augmented reality) glasses; Determining feature data of the cultural relics based on the cultural relic images by utilizing a built-in entity recognition model; determining cultural relics of the corresponding cultural relics and the cultural relics information of the cultural relics based on the characteristic data; Displaying the cultural relic three-dimensional model cultural relic and cultural relic information to a user through the AR glasses; The intelligent role interaction module is used for: The user data are acquired in real time along with the route of the user; and recommending the voice introduction and the interactive content of the cultural relics for the user in real time based on the user data.
2. 2. The AR based cultural relic repairing and real-time interaction system according to claim 1, further comprising a central control, wherein the central control is connected with the intelligent role interaction module; The central control is used for collecting the user data.
3. 3. The AR-based relic repair and real-time interactive system according to claim 1, wherein the deletion repair and three-dimensional modeling are performed based on the relic image to obtain a relic three-dimensional model, comprising: performing image contour segmentation on the cultural relic image to obtain a segmented cultural relic image; denoising the segmented cultural relic image to obtain a denoised cultural relic image; Repairing and three-dimensional modeling is carried out on the missing part of the cultural relics according to the denoised cultural relic images by using built-in modeling software, so as to obtain a cultural relic repair model; Determining a texture map according to the cultural relic image; and determining the cultural relic three-dimensional model according to the cultural relic repair model and the texture map.
4. 4. The AR based cultural relic repair and real-time interaction system according to claim 3, wherein said modeling software comprises 3ds Max and Maya.
5. 5. The AR-based relic repair and real-time interaction system of claim 1, wherein determining feature data of a relic based on the relic image using a built-in entity recognition model comprises: Performing data cleaning and denoising on the cultural relic image to obtain a processed cultural relic image; And inputting the processed cultural relic image into the entity recognition model to obtain characteristic data of the cultural relic.
6. 6. The AR-based relic repair and real-time interactive system according to claim 5, wherein said entity recognition model determination process comprises: The training set comprises a plurality of sample cultural relic images and characteristic data of corresponding cultural relics; constructing a convolutional neural network; and training the convolutional neural network by using the training set to obtain the entity identification model.
7. 7. The AR-based cultural relic repair and real-time interaction system according to claim 6, wherein training the convolutional neural network with the training set to obtain the entity recognition model comprises: and training the convolutional neural network by taking various text images as input and corresponding feature data of the cultural relics as output to obtain the entity recognition model.
8. 8. The AR-based relic repair and real-time interactive system according to claim 6, wherein the entity recognition model is optimized and updated in real-time using the extended training set.
9. 9. The AR-based relic repair and real-time interaction system of claim 1, wherein recommending voice introductions and interactive content of relics to a user in real-time based on the user data comprises: and recommending the voice introduction and the interactive content of the cultural relics for the user in real time according to the user data by using a recommendation algorithm.
10. 10. The AR based cultural relic repair and real-time interaction system according to claim 9, wherein the recommendation algorithm comprises content-based recommendation, collaborative filtering recommendation and mixed recommendation.

Description

AR-based cultural relic restoration and real-time interaction system Technical Field The application relates to the technical field of cultural relic repair, in particular to an AR-based cultural relic repair and real-time interaction system. Background AR glasses need to sense and analyze real world in real time, and the current technology can present problems of real object recognition delay or false recognition under complex environment or fast moving object. In a scene of multi-object recognition, the AR glasses need to process information of a plurality of objects at the same time, which may cause a decrease in processing speed or uneven resource allocation, and particularly, in the case that a plurality of objects interfere with each other, accuracy of recognition may be affected, and a repairing effect of the cultural relics is poor. The cultural relic data in the initial stage or the specific field is very limited, and is often influenced by various factors such as environment, equipment and the like, so that the quality of the cultural relic data collected on site is low or the content is insufficient, and the recommendation effect on a user is poor. Disclosure of Invention The application aims to provide an AR-based cultural relic repairing and real-time interaction system, which aims to solve the problem that accurate identification, repairing and accurate recommendation of cultural relics cannot be realized. In order to achieve the above object, the present application provides the following solutions: The application provides an AR-based cultural relic repairing and real-time interaction system, which comprises AR glasses, a cultural relic activating and repairing module, a physical identification module, an intelligent role interaction module and a database, wherein the cultural relic activating and repairing module, the physical identification module, the intelligent role interaction module and the database are deployed in the AR glasses; the cultural relic activation and restoration module is used for: acquiring cultural relic images shot by cameras of AR (augmented reality) glasses; Performing deletion repair and three-dimensional modeling based on the cultural relic image to obtain a cultural relic three-dimensional model; Displaying the cultural relic three-dimensional model to a user through the AR glasses; The database is used for storing the three-dimensional model of each cultural relic and the corresponding cultural relic information; The entity identification module is used for: acquiring cultural relic images shot by cameras of AR (augmented reality) glasses; Determining feature data of the cultural relics based on the cultural relic images by utilizing a built-in entity recognition model; determining cultural relics of the corresponding cultural relics and the cultural relics information of the cultural relics based on the characteristic data; Displaying the cultural relic three-dimensional model cultural relic and cultural relic information to a user through the AR glasses; The intelligent role interaction module is used for: The user data are acquired in real time along with the route of the user; and recommending the voice introduction and the interactive content of the cultural relics for the user in real time based on the user data. Optionally, the AR-based cultural relic restoration and real-time interaction system further comprises a central control, wherein the central control is connected with the intelligent role interaction module; The central control is used for collecting the user data. Optionally, performing deletion repair and three-dimensional modeling based on the cultural relic image to obtain a cultural relic three-dimensional model, including: performing image contour segmentation on the cultural relic image to obtain a segmented cultural relic image; denoising the segmented cultural relic image to obtain a denoised cultural relic image; Repairing and three-dimensional modeling is carried out on the missing part of the cultural relics according to the denoised cultural relic images by using built-in modeling software, so as to obtain a cultural relic repair model; Determining a texture map according to the cultural relic image; and determining the cultural relic three-dimensional model according to the cultural relic repair model and the texture map. Optionally, the modeling software includes 3ds Max and Maya. Optionally, determining feature data of the cultural relics based on the cultural relic image by using a built-in entity recognition model includes: Performing data cleaning and denoising on the cultural relic image to obtain a processed cultural relic image; And inputting the processed cultural relic image into the entity recognition model to obtain characteristic data of the cultural relic. Optionally, the determining process of the entity identification model includes: The training set comprises a plurality of sample cultural relic images and character