KR-20260064813-A - UNIVERSAL XR PLATFORM DESIGNED TO BUILD USER ADAPTIVE METAVERSE SPACE

KR20260064813AKR 20260064813 AKR20260064813 AKR 20260064813AKR-20260064813-A

Abstract

The present invention relates to an XR platform that provides a metaverse environment enabling participants to engage in various cultural exchanges using avatars synchronized with the actual participants in a virtual space. The present invention comprises: a participant device that provides generated XR images to a participant and recognizes the user's motion; and a service providing server that creates a virtual metaverse space, generates virtual characters (meta-humans) synchronized with the physical characteristics of each participant through information collected from the participant device, and generates XR images including dynamic images of the characters and provides them to the participant device. The participant device comprises: a Head Mounted Display (HMD) module for providing XR images to the participant, which is worn by the participant; a motion recognition module for recognizing the participant's motion; and a control module for receiving input commands from the participant, which is held by the participant. According to the present invention, since a virtual character is provided by synchronizing it with the user's physical characteristics through the user's dynamic video, the character itself not only has a sense of identity with the user, but also has the effect of providing a high synchronization rate between the user's dynamic movements and the movements of the virtual character synchronized therewith.

Inventors

전복기
임혜린
장관종
김형규
김대희
김세윤
박지언
양지연

Assignees

주식회사 디캐릭

Dates

Publication Date: 20260508
Application Date: 20241029

Claims (13)

A participant device that provides a generated XR video to the participant and recognizes the user's motion; A service providing server comprising: a service providing server that creates a virtual metaverse space, creates a virtual character (meta-human) synchronized with the physical characteristics of each participant through information collected from the participant device, and creates an XR video including dynamic images of the characters and provides it to the participant device; The above-mentioned participant device is, A Head Mounted Display (HMD) module for providing XR images to a participant, which is worn by the participant; A motion recognition module for recognizing the motion of a participant; and A universal XR platform for building a user-adaptive metaverse, characterized by comprising a control module for receiving input commands from a participant, which is grasped by the participant.
In Article 1, The above motion recognition module is, A treadmill module that recognizes the walking and movement of a participant on a support plate; A tracking module attached to the participant's body to detect movement of the participant's body parts; and A universal XR platform for building a user-adaptive metaverse, characterized by comprising an optical sensor module that acquires an image of a participant's body and recognizes the movement of the participant's body.
In Article 2, The above HMD module is, A universal XR platform for building a user-adaptive metaverse, characterized by being equipped with a speech recognition function for recognizing a participant's voice and a text conversion function for converting the recognized voice into text.
In Paragraph 3, The above service providing server is, A metaverse support module that creates a virtual character matched to each participant and reflects the participant's dynamic motion state acquired from the motion recognition module to the character to implement a metaverse space; A universal XR platform for constructing a user-adaptive metaverse, characterized by comprising: a customized XR image generation unit that generates a customized XR image, which is a metaverse space image for each character according to the position and viewpoint of each character, and provides the customized XR image to a participant device corresponding to each character.
In Article 4, The above metaverse support module is, Through the dynamic movement image of the participant acquired from the above motion recognition module, the physical characteristics of the participant are analyzed, and A universal XR platform for building a user-adaptive metaverse, characterized by synchronizing and adjusting a generated virtual character to correspond to the physical characteristics of the participant.
In Article 5, The above physical characteristics are, A universal XR platform for building a user-adaptive metaverse, characterized by being composed including body shape and limb proportions.
In Paragraph 3, The above service providing server is, A universal XR platform for building a user-adaptive metaverse, characterized by further including a participant management module that manages participants in each group when multiple participants are grouped to conduct an experience or game.
In Article 7, The above experience or game is, A universal XR platform for building a user-adaptive metaverse characterized as an individual experience or record game in which the dynamic movement state of a participant included in a group does not affect the dynamic movement state of another participant.
In Article 8, The above participant management module is, A universal XR platform for building a user-adaptive metaverse, characterized in that each participant selects a participant to be included in their respective group to match the groups, and if there are multiple selections of the participant by other participants, duplicate assignment is allowed so that the participant is assigned to multiple groups.
In Article 9, Participant characters participating in multiple groups, The participant's exercise status acquired from the participant's device is reflected identically, A universal XR platform for building a user-adaptive metaverse characterized by the application of the same dynamic movement within multiple participating groups.
In Article 10, The above customized XR video is, If the above participant is included in multiple groups, A universal XR platform for building a user-adaptive metaverse, characterized by being generated from a metaverse environment within a group selected by the participant.
In Article 11, The above service providing server is, It is further configured to include a communication controller that creates and manages communication channels so that voice information and text information are exchanged between the group participants; The above communication controller is, A universal XR platform for building a user-adaptive metaverse, characterized by creating a communication channel for exchanging voice or text information between participants within a group, and for participants who have not selected the group, establishing a communication channel with a conversational generative AI provider that generates a response to a question.
In Article 12, If the above participant terminal requests a group change, A universal XR platform for constructing a user-adaptive metaverse, characterized by allowing a participant to change groups within a group where the participant is set as a group participant, wherein after the group change, the transmission and reception of voice information or text information regarding characters within the existing group is performed through the conversation-generating AI provider and the established communication channel.

Description

Universal XR Platform Designed to Build User Adaptive Metaverse Space The present invention relates to an XR platform for providing a metaverse environment that enables participants to engage in various cultural exchanges using avatars whose body shape and movements are synchronized with those of actual participants in a virtual space. It concerns a result produced while carrying out the project 'Development of Universal XR Platform Technology for Building a Metaverse Supporting Digital Cultural Inclusion' (Project No.: RS-2023-00270006), which is part of the Cultural Technology R&D - Technology Development Project for the Diffusion of Cultural Services managed by the Korea Content Agency under the Ministry of Culture, Sports and Tourism. The term "Metaverse" is a compound word formed from "meta," meaning virtual or transcendent, and "universe," meaning world or universe, and refers to a three-dimensional virtual world linked to reality. Recently, as the global COVID-19 pandemic has become prolonged, contact and movement between people have been restricted, and as 5G communication networks capable of transmitting large amounts of information at high speeds have been expanded, various forms of metaverse services supporting lifestyle or gaming virtual worlds are emerging. These metaverse services provide users with a metaverse environment where they can use avatars, thereby offering features that allow users to engage in personal activities such as education and shopping through their avatars, or to apply various digital items to their avatars. By utilizing these features, users can obtain fun and satisfaction by engaging in desired activities or applying various digital items to their avatars within the metaverse environment without physical limitations. In this way, metaverse technology is breaking down the limitations of physical distance in providing interaction between people from various countries and regions. However, the current situation is that there is a lack of content that allows people to interact with diverse people in various sports, leisure, and cultural activities within the metaverse environment, as well as low user satisfaction due to the inability to provide immersive experiences. Meanwhile, XR (eXtended Reality) is a concept that encompasses VR (Virtual Reality), AR (Augmented Reality), and MR (Mixed Reality). It is an advanced technology that enables the experience of various senses within a virtual space and creates a realistic experience through elements such as 360-degree views, spatial sound, and posture tracking. Accordingly, the present invention aims to provide a platform that applies XR (eXtended Reality) technology to a metaverse environment, enabling users to interact with diverse people and cultures in a realistic virtual world without physical constraints. FIG. 1 is an exemplary diagram illustrating an example of a participant device applied to an XR platform according to the present invention. FIG. 2 is a block diagram illustrating the main configuration of an XR platform for constructing a metaverse according to the present invention. FIG. 3 is an exemplary diagram illustrating an example of a virtual character being generated on a metaverse according to the present invention. FIG. 4 is an exemplary diagram illustrating an example of a process in which a virtual character according to the present invention is synchronized through a user's motion. FIG. 5 is an exemplary diagram illustrating an example of a process in which a virtual character according to the present invention is synchronized through a user's motion. FIG. 6 is an exemplary diagram illustrating an example of a process in which a virtual character according to the present invention is synchronized through a user's motion. FIG. 7 is an exemplary diagram illustrating an example of a group match in which duplicate assignment of participants is allowed in an XR platform for constructing a metaverse according to the present invention. FIG. 8 is an exemplary diagram illustrating an example of a participant setting up a participation group in an XR platform for constructing a metaverse according to the present invention. FIG. 9 is an exemplary diagram illustrating examples of customized XR video and communication channels generated by group in an XR platform for constructing a metaverse according to the present invention. FIG. 10 is an exemplary diagram illustrating an example of a participant group change in an XR platform for constructing a metaverse according to the present invention. FIG. 11 is an example diagram illustrating the result of a participant's group change in an XR platform for constructing a metaverse according to the present invention. Hereinafter, with reference to the attached drawings, we will examine an XR platform for constructing a user-adaptive metaverse according to a specific embodiment of the present invention. Before proceeding with the explanation, the effects, features, and methods for