US-20260128924-A1 - METHOD AND SYSTEM FOR TIME BASED PERSONALIZATION MANAGEMENT IN MULTI-DEVICE ENVIRONMENT

US20260128924A1US 20260128924 A1US20260128924 A1US 20260128924A1US-20260128924-A1

Abstract

A method performed by a user device of time based personalization management in a multi-device environment is provided. identifying, by the user device based on a first user input, at least one smart device among a plurality of smart devices for performing a first action corresponding to the first user input determining, by the user device in response to the first user input, one or more context information associated with a user corresponding to the user input, the multi-device environment, and the at least one smart device, predicting, by the user device using a prediction model, a relevant time span for the identified at least one smart device until which a context of the first user input is required to be preserved, and integrating, by the user device, the predicted relevant time span with the identified at least one smart device.

Inventors

SOURABH TIWARI
Bhiman Kumar Baghel
Jalaj SHARMA
Manish Chauhan
Boddu Venkata Krishna VINAY
Syed Khaja MOINUDDIN

Assignees

SAMSUNG ELECTRONICS CO., LTD.

Dates

Publication Date: 20260507
Application Date: 20251229
Priority Date: 20231122

Claims (20)

1 . A method performed by a user device of time based personalization management in a multi-device environment, the method comprising: identifying, by the user device based on a first user input, at least one smart device among a plurality of smart devices in the multi-device environment for performing a first action corresponding to the first user input; determining, by the user device in response to the first user input, one or more context information associated with a user corresponding to the first user input, the multi-device environment, and the identified at least one smart device; predicting, by the user device using a prediction model based on the determined one or more context information, a relevant time span for the identified at least one smart device until which a context of the first user input is required to be preserved; and integrating, by the user device, the predicted relevant time span with the identified at least one smart device for performing the first action corresponding to the first user input.
2 . The method of claim 1 , further comprising: determining whether a second user input is received subsequently after the first user input within the predicted relevant time span; and controlling, based on a determination that the second user input is received subsequently after the first user input within the predicted relevant time span, the identified at least one smart device to perform a second action.
3 . The method of claim 1 , wherein identifying the at least one smart device among the plurality of smart devices comprises: determining whether the first user input is an ambiguous user input for performing the first action by the at least one smart device; and identifying the at least one smart device in the multi-device environment based on a determination that the first user input is the ambiguous user input.
4 . The method of claim 1 , wherein determining the one or more context information comprises: determining a context of the user, a context of environment in the multi-device environment, and an operational context of the identified at least one smart device, wherein the context of the user is determined based on historical user interactions with the plurality of smart devices in the multi-device environment; and determining the one or more context information based on the context of the user, the context of environment in the multi-device environment, and the operational context of the identified at least one smart device.
5 . The method of claim 4 , further comprising assigning a dynamic weightage to each of the determined context of the user, the context of the multi-device environment, and the operational context of the identified at least one smart device.
6 . The method of claim 1 , wherein the prediction model corresponds to a rule-based model for predicting the relevant time span based on the first user input.
7 . The method of claim 1 , wherein the prediction model corresponds to an artificial intelligence (AI) model for predicting the relevant time based on the first user input, and wherein the AI model is trained to predict the relevant time span for the identified at least one smart device based on the determined one or more context information.
8 . The method of claim 1 , wherein the multi-device environment corresponds to one of a smart home environment or an internet of things (IoT) environment, and wherein the at least one smart device has same functionality with respect to a set of smart devices among the plurality of smart devices.
9 . The method of claim 2 , wherein the first user input corresponds to any one of a voice input of a user, a text input, a graphical user interface (GUI) input, a remote-control input, or a gesture input, and wherein the second user input corresponds to any one of the voice input of the user, the text input, or the gesture input that causes disambiguation.
10 . A multi-device system for time based personalization management in a multi-device environment, the multi-device system comprising: a plurality of smart devices configured to communicate with each other in the multi-device environment; and a user device including: memory, comprising one or more storage media, storing instructions, and at least one processor and configured with a virtual assistant, the user device is communicatively coupled with each of the plurality of smart devices via the virtual assistant, and the memory, wherein the instructions, when executed by the at least one processor individually or collectively, cause the user device to: identify, based on a first user input, at least one smart device among the plurality of smart devices in the multi-device environment for performing a first action corresponding to the first user input, determine, in response to the first user input, one or more context information associated with a user corresponding to the first user input, the multi-device environment, and the identified at least one smart device, predict, using a prediction model based on the determined one or more context information, a relevant time span for the identified at least one smart device until which a context of the first user input is required to be preserved, and integrate the predicted relevant time span with the identified at least one smart device for performing the first action corresponding to the first user input.
11 . The multi-device system of claim 10 , wherein the instructions when executed by at least one processor individually or collectively further cause the user device to: determine whether a second user input is received subsequently after the first user input within the predicted relevant time span; and control, based on a determination that the second user input is received subsequently after the first user input within the predicted relevant time span, the identified at least one smart device to perform a second action.
12 . The multi-device system of claim 10 , wherein to identify the at least one smart device among the plurality of smart devices, the instructions when executed by at least one processor individually or collectively further cause the user device to: determine whether the first user input is an ambiguous user input for performing the first action by the at least one smart device; and identify the at least one smart device in the multi-device environment based on a determination that the first user input is the ambiguous user input.
13 . The multi-device system of claim 10 , wherein to determine the one or more context information, the instructions when executed by at least one processor individually or collectively further cause the user device to: determine a context of the user, a context of environment in the multi-device environment, and an operational context of the identified at least one smart device, wherein the context of the user is determined based on historical user interactions with the plurality of smart devices in the multi-device environment; and determine the one or more context information based on the context of the user, the context of environment in the multi-device environment, and the operational context of the identified at least one smart device.
14 . The multi-device system of claim 13 , wherein the instructions when executed by at least one processor individually or collectively further cause the user device to assign a dynamic weightage to each of the determined context of the user, the context of the multi-device environment, and the operational context of the identified at least one smart device.
15 . The multi-device system of claim 13 , wherein, based on the user device having not received any user input for a given period of time, the operational context of the identified at least one smart device is set to a dominant state based on the assigned dynamic weightage of the operational context of the identified at least one smart device.
16 . The multi-device system of claim 15 , wherein, when the user has recently provided the user input a given smart device, the context of the user and the operational context of the identified at least one smart device is set to the dominant state.
17 . One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of a user device in a multi-device environment individually or collectively, cause the user device to perform operations, the operations comprising: identifying, by the user device based on a first user input, at least one smart device among a plurality of smart devices in the multi-device environment for performing a first action corresponding to the first user input; determining, by the user device in response to the first user input, one or more context information associated with a user corresponding to the first user input, the multi-device environment, and the identified at least one smart device; predicting, by the user device using a prediction model based on the determined one or more context information, a relevant time span for the identified at least one smart device until which a context of the first user input is required to be preserved; and integrating, by the user device, the predicted relevant time span with the identified at least one smart device for performing the first action corresponding to the first user input.
18 . The one or more non-transitory computer-readable storage media of claim 17 , the operations further comprising: determining whether a second user input is received subsequently after the first user input within the predicted relevant time span; and controlling, based on a determination that the second user input is received subsequently after the first user input within the predicted relevant time span, the identified at least one smart device to perform a second action.
19 . The one or more non-transitory computer-readable storage media of claim 17 , wherein identifying the at least one smart device among the plurality of smart devices comprises: determining whether the first user input is an ambiguous user input for performing the first action by the at least one smart device; and identifying the at least one smart device in the multi-device environment based on a determination that the first user input is the ambiguous user input.
20 . The one or more non-transitory computer-readable storage media of claim 17 , wherein determining the one or more context information comprises: determining a context of the user, a context of environment in the multi-device environment, and an operational context of the identified at least one smart device, wherein the context of the user is determined based on historical user interactions with the plurality of smart devices in the multi-device environment; and determining the one or more context information based on the context of the user, the context of environment in the multi-device environment, and the operational context of the identified at least one smart device.

Description

CROSS-REFERENCE TO RELATED APPLICATION(S) This application is a continuation application, claiming priority under 35 U.S.C. § 365 (c), of an International application No. PCT/KR2024/007261, filed on May 28, 2024, which is based on and claims the benefit of an Indian Provisional patent application No. 202341048111, filed on Jul. 17, 2023, in the Indian Intellectual Property Office, and of an Indian Complete patent application No. 202341048111, filed on Nov. 22, 2023, in the Indian Intellectual Property Office, the disclosure of each of which is incorporated by reference herein in its entirety. BACKGROUND 1. Field The disclosure relates to a field of Internet of Things (IoT). More particularly, the disclosure relates to a method and system for time based personalization management in a multi-device environment. 2. Description of Related Art In past years, development of wireless communication technologies such as Bluetooth and wireless fidelity (Wi-Fi) laid groundwork for an expansion of Internet of Things (IoT). These technologies enabled seamless connectivity between devices and opened up new possibilities for IoT applications. Further, with increasing use of smartphones and accessibility of fast mobile data networks, the IoT gained traction in recent years. This allowed users to remotely control and monitor their devices through mobile apps, giving rise to a concept of multi-device IoT environments such as smart homes. In the IoT, the multi-device environment refers to a network of interconnected devices in which the multi-device environment facilitates automation, intelligence, and control of the interconnected devices to provide an immersive experience to the users. In a non-limiting example, the interconnected devices may correspond, but are not limited, to smartphones, tablets, laptops, desktop computers, smartwatches, televisions (TVs), Air Conditioners (ACs), lights, curtains, remotes, and other connected devices. In a conventional multi-device environment, a user may require one or more identical devices among the interconnected devices in different rooms of a smart home to fulfil his/her requirement. In a non-limiting example, the user may require the AC in a bedroom and a living room of the smart home. In another non-limiting example, the user may require the TV in the bedroom as well as in the living room. Thus, if the user provides ambiguous user input to a virtual assistant to control operations on any of the one or more identical devices, then the virtual assistant is unable to take action on an intended device within the smart home. Thus, the virtual assistant may require follow-up queries to overcome ambiguity on the user input. Subsequently, the user may provide another ambiguous user input to control different operations of the intended device. In this scenario, the virtual assistant may again be required to follow up with the user to overcome the ambiguity in another ambiguous user input. Thus, such conventional multi-device environment faces challenges in processing ambiguous user inputs and hence not compatible with handling the above-mentioned problem scenario. FIG. 1 illustrates an example scenario of a conventional multi-device environment, according to the related art. Referring to FIG. 1, a user 102 provides a user input to the virtual assistant of a user device 104 to control an intended device in the multi-device environment. A precondition for the scenario corresponds to the multi-device environment comprising two TVs, in which a first TV is installed in the bedroom and a second TV is installed in the living room. Further, operations 106 to 120 of FIG. 1 in combination illustrates the problem of subsequent follow-up queries with the user in the multi-device environment. In operation 106, the user provides user input to the virtual assistant (i.e., Bixby) to turn on the TV. As two identical devices are installed at home, the virtual assistant of the user device 104 is unable to recognize the intended TV to turn on. Thus, to overcome the ambiguity, in operation 108, the virtual assistant provides a follow-up query, i.e., “which TV would you like to turn on?”. In operation 110, the user provides the user input to turn on the living room TV. In response, the user device 104 facilitates the multi-device environment to turn on the living room TV and provides feedback to the user in operation 112. Subsequently, in operation 114, the user provides another user input for raising the TV volume. As the user provides a subsequent input command to raise the TV volume followed by an input command to turn on the living room TV, then in this scenario, the virtual assistant of the user device 104 may relate the subsequent input command to the living room TV. This happens because the virtual assistant of the user device 104 does not consider historical context while processing the subsequent input command. According to the state-of-the-art solution, there is a challenge to store the historical co