Search

EP-4740166-A1 - ELECTRONIC DEVICE AND METHOD FOR MANAGING IOT DEVICES IN A METAVERSE ENVIRONMENT

EP4740166A1EP 4740166 A1EP4740166 A1EP 4740166A1EP-4740166-A1

Abstract

A method for managing one or more Internet of Things (IoT) devices in a metaverse environment is provided. The method includes detecting that a user is engaged in the metaverse environment, monitoring, upon detecting that the user is engaged in the metaverse environment, an operating state of each of the one or more IoT devices in a real-world environment, determining at least one IoT device from the one or more IoT devices requiring user's attention based on the monitored operating state of each of the one or more IoT, and generating, within the metaverse environment, an interactable avatar of the determined at least one IoT device requiring user's attention, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.

Inventors

  • SUBRAMANI, Karthikeyan
  • GOVINDARAJ, Gokul

Assignees

  • Samsung Electronics Co., Ltd.

Dates

Publication Date
20260513
Application Date
20240531

Claims (14)

  1. A method for managing one or more internet of things, IoT, devices (201) by an electronic device (202) in a metaverse environment, the method comprising: detecting (602) that a user is engaged in the metaverse environment; monitoring (604), upon detecting that the user is engaged in the metaverse environment, an operating state of each of the one or more IoT devices (201) in a real-world environment; determining (606) at least one IoT device from the one or more IoT devices (201) requiring user's attention based on the monitored operating state of each of the one or more IoT devices (201); and generating (608), within the metaverse environment, an interactable avatar of the determined at least one IoT device requiring user's attention, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.
  2. The method of claim 1, further comprising: receiving (610), within the metaverse environment, one or more inputs from the user in a form of real-time interactions with the generated interactable avatar; and updating (612) the operating state of the at least one IoT device in the real-world environment based on the received one or more inputs.
  3. The method of claim 2, wherein the receiving the one or more inputs from the user in the form of real-time interactions with the generated interactable avatar comprises: monitoring one or more avatar movements and one or more avatar actions of the generated interactable avatar in the metaverse environment; and monitoring one or more user movements and one or more user actions in the metaverse environment, wherein the one or more user actions correspond to multi-modal actions.
  4. The method of claim 3, wherein the receiving the one or more inputs from the user in the form of real-time interactions with the generated interactable avatar comprises: identifying, by using a gesture detection-based artificial intelligence, AI, model, one or more gestures of the user by correlating the one or more avatar movements, the one or more avatar actions, the one or more user movements and the one or more user actions; and detecting one or more IoT commands by correlating the identified one or more gestures with a predefined IoT command library.
  5. The method of claim 4, wherein the updating the operating state of the at least one IoT device comprises: transmitting the detected one or more IoT commands to each of the at least one IoT device, wherein the one or more IoT commands are executed by the at least one IoT device to update the operating state.
  6. The method of claim 1, wherein the detecting that the user is engaged in the metaverse environment comprises: determining if a user action is required to change the operating state of the one or more IoT devices based on the determined operating state; and detecting, upon determining that the user action is required, that the user is engaged in the metaverse environment.
  7. The method of claim 1, further comprising: determining, upon detecting that the user is engaged in the metaverse environment, if a current task that the user is performing in the metaverse environment is one of a critical task or a non-critical task by analyzing one or more metaverse tasks; and determining one or more required user actions for changing the operating state of the at least one IoT device upon determining that the current task is the non-critical task.
  8. The method of claim 7, further comprising: generating a compatibility score associated with each of the one or more required user actions based on a predefined priority list and the monitored operating state, wherein the compatibility score represents a priority of performing the one or more user required actions with respect to a criticality of the current task; determining if the generated compatibility score is greater than a predefined threshold score; and initiating, upon determining that the generated compatibility score is greater than the predefined threshold score, a metaverse session for changing the operating state of the at least one IoT device.
  9. The method of claim 1, wherein generating the interactable avatar of the determined at least one IoT device requiring user's attention, the method comprises: determining one or more device parameters associated with each of the at least one IoT device; and generating, by using a virtual generation-based artificial intelligence, AI, model, the interactable avatar of at least one IoT device based on the determined one or more device parameters, required one or more actions, a predefined three-dimension, 3D, model library, and a predefined gesture library.
  10. The method of claim 9, further comprising: generating, by using the virtual generation-based AI model, a metaverse representation of the operating state in the metaverse environment based on the determined one or more device parameters, the required one or more actions, the predefined 3D model library, and the predefined gesture library, wherein the operating state represents one or more actions to be performed by each of the at least one IoT device in the metaverse environment; correlating the generated interactable avatar and the generated metaverse representation of the operating state; and displaying the generated interactable avatar and the metaverse representation of the operating state upon correlation.
  11. An electronic device (202) for managing one or more internet of things, IoT, devices (201) in a metaverse environment, the electronic device comprising: memory (210) storing instructions; one or more processors (204) communicably coupled to the memory (210), wherein the instructions, when executed by the one or more processors (204), cause the electronic device (202) to perform operations, the operations comprising: detecting that a user is engaged in the metaverse environment, monitoring, upon detecting that the user is engaged in the metaverse environment, an operating state of each of the one or more IoT devices (201) in a real-world environment, determining at least one IoT device from the one or more IoT devices (201) requiring user's attention based on the monitored operating state of each of the one or more IoT devices (201), and generating, within the metaverse environment, an interactable avatar of the determined at least one IoT device requiring user's attention, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.
  12. The electronic device of claim 11, wherein the operations further comprises at least one operation according to a method in one of claims 2 to 10.
  13. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors (204) of an electronic device (202), cause the electronic device (202) to perform operations, the operations comprising: detecting that a user is engaged in a metaverse environment; monitoring, upon detecting that the user is engaged in the metaverse environment, an operating state of each of one or more internet of things, IoT, devices (201) in a real-world environment; determining at least one IoT device from the one or more IoT devices (201) requiring user's attention based on the monitored operating state of each of the one or more IoT devices (201); and generating, within the metaverse environment, an interactable avatar of the determined at least one IoT device requiring user's attention, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.
  14. The one or more non-transitory computer-readable storage media of claim 13, wherein the operations further comprises at least one operation according to a method in one of claims 2 to 10.

Description

ELECTRONIC DEVICE AND METHOD FOR MANAGING IOT DEVICES IN A METAVERSE ENVIRONMENT The disclosure relates to metaverse environment. More particularly, the disclosure relates to an electronic device and a method for managing one or more Internet of Things (IoT) devices in a metaverse environment. With the advancements in technology, users use a metaverse environment to interact with each other and digital objects in a seamless manner. The metaverse environment is a virtual world shared by the users in real-time. Further, the metaverse environment represents a convergence of physical and virtual realities. For example, the metaverse environment may have a wide range of applications, such as education and training, social interaction, environment, sports and fitness, commerce and detail, and the like. Conventionally, when a user is immersed in a metaverse session, the user is required to exit the metaverse session in case a user action is required to change an operating state of one or more IoT devices, such as vacuum cleaner, air-conditioner, and the like. FIGS. 1A, 1B, and 1C illustrate pictorial depictions for showing one or more existing scenarios associated with a metaverse environment, according to the related art. In the scenario illustrated in FIG. 1A, the user is shopping in a metaverse environment at 102.At 104, an IoT system determines that a fridge is frosting-up inside and generates a notification associated with the frosting. The generated notification is shared with the user on a smartphone to defrost the fridge. At 106, the user exists the metaverse session. At 108, the user defrosts the fridge. In the scenario illustrated in FIG. 1B, the user is reading books in the metaverse environment at 110. At 112, the air-conditioner has been turned off due to an error code. The user exits the metaverse session due to discomfort at 114. At 116, the user pays attention to the air-conditioner. In the scenario illustrated in FIG. 1C, the user is playing a game in the metaverse environment at 118. At 120, the vacuum cleaner starts cleaning the house at a scheduled time. At 122, the user is disturbed due to the house cleaning and exits the metaverse session. Accordingly, in systems of the related art, the user is required to exit the metaverse session when the one or more IoT devices require the user attention. As a result, the user is not able to finish one or more ongoing tasks in the metaverse session. Accordingly, there is a need for a technique to overcome the above-identified problems. The above information is presented as background information only to assist with an understanding of the disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the disclosure. The above and other aspects, features, and advantages of certain embodiments of the disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which: FIGS. 1A, 1B, and 1C illustrate pictorial depictions for showing one or more existing scenarios associated with a metaverse environment, according to the related art; FIG. 2 illustrates a block diagram of a system for managing one or more Internet of Things (IoT) devices in a metaverse environment, according to an embodiment of the disclosure; FIG. 3 illustrates a block diagram of a plurality of modules of the system for managing the one or more IoT devices in the metaverse environment, according to an embodiment of the disclosure; FIGS. 4A and 4B illustrate a block diagram of an operation of the system for managing the one or more IoT devices in the metaverse environment, according to various embodiments of the disclosure; FIGS. 5A and 5B illustrate pictorial depictions of use-case scenarios for managing the one or more IoT devices in the metaverse environment, according to various embodiments of the disclosure; and FIG. 6 illustrates a process flow depicting a method for managing the one or more IoT devices in the metaverse environment, according to an embodiment of the disclosure. Throughout the drawings, like reference numerals will be understood to refer to like parts, components, and structures. The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope and spirit of the disclosure. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness. The terms and words used in the following description and claims are not limited to the bibliogra