KR-102964620-B1 - Method and system for stably displaying augmented reality content in a marker-based environment and computing device for performing the same

KR102964620B1KR 102964620 B1KR102964620 B1KR 102964620B1KR-102964620-B1

Abstract

A method and system for reliably displaying augmented reality content in a marker-based environment, and a computing device for performing the same are disclosed. A method according to one disclosed embodiment includes the steps of receiving augmented reality content through link information extracted from a marker, displaying the augmented reality content on a screen using the position of the marker as a reference point, extracting one or more key points from the background on the screen, and converting the coordinate system of the augmented reality content into a coordinate system based on the key point according to the reliability of the marker on the screen.

Inventors

이재호

Assignees

주식회사 에이플러스알

Dates

Publication Date: 20260513
Application Date: 20251105

Claims (17)

One or more processors, and A method performed in a computing device having a memory for storing one or more programs executed by the above-mentioned one or more processors, wherein A step of receiving augmented reality content through link information extracted from a marker; A step of displaying the augmented reality content on a screen using the position of the marker as a reference point; A step of extracting one or more key points targeting the background in the above screen; and The method includes the step of converting the coordinate system of the augmented reality content into a coordinate system based on the key point according to the reliability of the marker on the screen. The step of transforming the above coordinate system is, A step of calculating the reliability of the marker on the above screen; A step of checking whether the extracted key point is valid when the above marker reliability falls below a preset threshold; and A method for displaying augmented reality content, comprising the step of converting the coordinate system of the augmented reality content into a coordinate system based on the key point when the key point is valid.
delete
In claim 1, The above marker reliability is, A method for displaying augmented reality content, calculated based on one or more of marker display quality, screen share, and detection consistency for the above marker.
In claim 1, The step of calculating the above marker reliability is, A step of assigning a first reliability score based on the marker display quality for the above marker; A step of assigning a second reliability score based on the screen occupancy rate for the above marker; A step of assigning a third confidence score based on the detection consistency for the above marker; and A method for displaying augmented reality content, comprising the step of calculating the marker reliability based on the first to third reliability scores.
In claim 4, The step of assigning the first reliability score above is, A step of assigning a 1-1 reliability score based on the corner alignment error for the above marker; A step of assigning a first-second reliability score based on the shape retention of the above marker; and A method for displaying augmented reality content, comprising the step of calculating a first reliability score by summing the first-1 reliability score and the first-2 reliability score.
delete
In claim 1, The above method for displaying augmented reality content is, A step of displaying the augmented reality content on a screen based on the above key points; A step of checking whether the above marker reliability becomes above a preset threshold again; and A method for displaying augmented reality content, further comprising the step of converting the reference coordinate system of the augmented reality content from a key point coordinate system to a marker coordinate system when the above marker reliability becomes above a preset threshold value again.
In claim 7, The above re-switching step is, A method for displaying augmented reality content, comprising the step of calculating a cumulative offset between the key point coordinate system and the marker coordinate system, and displaying augmented reality content in the marker coordinate system based on the calculated cumulative offset.
One or more processors, and A method performed in a computing device having a memory for storing one or more programs executed by the above-mentioned one or more processors, wherein A step of receiving augmented reality content through link information extracted from a marker; A step of extracting one or more key points from the background on the screen where the augmented reality content is to be displayed; A step of calculating the marker reliability and key point reliability on the screen, respectively; and A method for displaying augmented reality content, comprising the step of displaying the augmented reality content on a screen based on the calculated marker reliability and key point reliability.
In claim 9, The step of displaying on the above screen is, A step of checking whether the above marker reliability and the above key point reliability are each greater than or equal to a preset threshold; and A method for displaying augmented reality content, comprising the step of fusing a pose based on a marker coordinate system and a pose based on a key point coordinate system for the augmented reality content and displaying them on a screen when the marker reliability and the key point reliability are each greater than or equal to a preset threshold value.
In claim 10, The step of displaying on the above screen is, A step of comparing the marker reliability and the key point reliability and setting the coordinate system having a higher reliability as the reference coordinate system; and A method for displaying augmented reality content, comprising the step of converting a posture based on the marker coordinate system or a posture based on the key point coordinate system into a posture based on the reference coordinate system.
In claim 11, The step of fusing the above posture is, A method for displaying augmented reality content, comprising the step of assigning weights to the corresponding posture according to the marker reliability and the key point reliability.
In claim 9, The step of displaying on the above screen is, A method for displaying augmented reality content, wherein if either the marker reliability or the key point reliability is greater than or equal to a preset threshold value, a coordinate system corresponding to the reliability greater than or equal to the threshold value is set as a reference coordinate system to display the augmented reality content on a screen.
In claim 9, The above marker reliability is calculated based on one or more of the marker display quality, screen share, and detection consistency for the above marker, and An augmented reality content display method in which the above key point reliability is calculated based on one or more of the display quality, screen share, and detection consistency of an object corresponding to the above key point.
processor; and A computing device comprising memory for storing one or more programs executed by the above processor, wherein the processor, The action of receiving augmented reality content through link information extracted from a marker; The operation of displaying the augmented reality content on the screen using the position of the marker as a reference point; An operation to extract one or more key points targeting the background in the above screen; and Based on the reliability of the marker on the screen, the operation of converting the coordinate system of the augmented reality content into a coordinate system based on the key point is performed, and The operation of transforming the above coordinate system is, An operation to calculate the reliability of a marker on the above screen; An operation to check whether the extracted key point is valid when the above marker reliability falls below a preset threshold; and A computing device comprising, when the above key point is valid, an operation of converting the coordinate system of the augmented reality content to a coordinate system based on the above key point.
processor; and A computing device comprising memory for storing one or more programs executed by the above processor, wherein the processor, The action of receiving augmented reality content through link information extracted from a marker; An action of extracting one or more key points from the background on the screen where the above augmented reality content is to be displayed; The operation of calculating marker reliability and key point reliability on the above screen, respectively; and A computing device that performs the operation of displaying the augmented reality content on a screen based on the marker reliability and key point reliability calculated above.
A user terminal transmitting link information extracted from a marker; and It includes a management server that receives the above link information, extracts one or more augmented reality contents corresponding to the above link information, and transmits them to the user terminal. The above user terminal is, The augmented reality content is displayed on a screen using the position of the marker as a reference point, one or more key points are extracted from the background on the screen, and the coordinate system of the augmented reality content is converted into a coordinate system based on the key points according to the reliability of the marker on the screen. An augmented reality content service system that calculates the reliability of a marker on the screen, checks whether the extracted key point is valid when the reliability of the marker falls below a preset threshold value, and converts the coordinate system of the augmented reality content to a coordinate system based on the key point when the key point is valid.

Description

Method and system for stably displaying augmented reality content in a marker-based environment and computing device for performing the same An embodiment of the present invention relates to a technique for stably displaying augmented reality content in a marker-based environment. Marker-based augmented reality systems use a camera to recognize markers, such as QR codes, and display virtual objects (i.e., augmented reality content) on the screen based on those markers. While this method offers the advantages of rapid initial position estimation and the provision of an absolute reference, it becomes difficult to maintain a coordinate system reference if the marker is obscured, moves out of the screen, or if the shooting distance is too long, leading to unstable marker recognition. Consequently, instances of interrupted augmentation of virtual objects or unpredictable positioning occur. Therefore, a solution is required to stably display augmented reality content in a marker-based environment. FIG. 1 is a diagram showing the configuration of an augmented reality content service system according to one embodiment of the present invention. FIG. 2 is a schematic diagram illustrating the state in which a user terminal photographs a business card and transmits link information to a management server in one embodiment of the present invention. FIG. 3 is a flowchart illustrating a method for stably displaying augmented reality content on a user terminal according to an embodiment of the present invention. FIG. 4 is a flowchart illustrating a method for stably displaying augmented reality content on a user terminal according to another embodiment of the present invention. FIG. 5 is a block diagram illustrating a computing environment including a computing device suitable for use in exemplary embodiments. Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. The following detailed description is provided to facilitate a comprehensive understanding of the methods, apparatuses, and/or systems described herein. However, this is merely illustrative and the present invention is not limited thereto. In describing the embodiments of the present invention, detailed descriptions of known technologies related to the present invention are omitted if it is determined that such detailed descriptions may unnecessarily obscure the essence of the present invention. Furthermore, the terms described below are defined in consideration of their functions within the present invention, and these may vary depending on the intentions or practices of the user or operator. Therefore, such definitions should be based on the content throughout this specification. Terms used in the detailed description are intended merely to describe the embodiments of the present invention and should not be limiting in any way. Unless explicitly stated otherwise, expressions in the singular form include the meaning of the plural form. In this description, expressions such as "include" or "comprise" are intended to refer to certain characteristics, numbers, steps, actions, elements, parts thereof, or combinations thereof, and should not be interpreted to exclude the existence or possibility of one or more other characteristics, numbers, steps, actions, elements, parts thereof, or combinations thereof other than those described. Meanwhile, directional terms such as upper side, lower side, one side, other side, etc., are used in relation to the orientation of the disclosed drawings. Since the components of the embodiments of the present invention can be positioned in various orientations, directional terms are used for illustrative purposes only and are not intended to be limiting. Additionally, terms such as "first," "second," etc., may be used to describe various components, but said components should not be limited by said terms. These terms may be used for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be named the second component, and similarly, the second component may be named the first component. FIG. 1 is a diagram showing the configuration of an augmented reality content service system according to one embodiment of the present invention, and FIG. 2 is a diagram schematically showing the state in which a user terminal photographs a business card and transmits link information to a management server in one embodiment of the present invention. Referring to FIGS. 1 and 2, the augmented reality content service system (100) may include a user terminal (102) and a management server (104). The user terminal (102) and the operator terminal (104) may each be connected to communicate with the management server (106) through a communication network (150). In the disclosed embodiment, the communication network (150) may include the Internet, one or more local area networks, wide area networks, cellular netw