US-12625598-B2 - Method for controlling household appliances using augmented reality

US12625598B2US 12625598 B2US12625598 B2US 12625598B2US-12625598-B2

Abstract

A method of controlling a household appliance includes setting, within an augmented reality note, control commands for the household appliance. The method also included receiving, on a remote user interface device, the augmented reality note. The method further includes activating the household appliance based on the control commands set within the received augmented reality note.

Inventors

JaeHyo Lee
Hang IL Ahn

Assignees

HAIER US APPLIANCE SOLUTIONS, INC.

Dates

Publication Date: 20260512
Application Date: 20230615

Claims (16)

1 . A method of controlling a household appliance, the method comprising: obtaining, on a first remote user interface device, an image; creating, on the first remote user interface device, an augmented reality note; setting, within the augmented reality note, control commands for the household appliance; receiving, on a second remote user interface device, the augmented reality note, wherein receiving, on the second remote user interface device, the augmented reality note comprises receiving a push notification on the second remote user interface device, wherein the push notification comprises a text element containing the control commands; and activating, by the second remote user interface device, the household appliance based on the control commands set within the received augmented reality note.
2 . The method of claim 1 , further comprising: creating an augmented reality space, wherein creating the augmented reality space comprises scanning, with a camera of the first remote user interface device, a physical space.
3 . The method of claim 2 , wherein the augmented reality space comprises spatial location information of the physical space.
4 . The method of claim 2 , wherein creating an augmented reality space further comprises uploading the augmented reality space to a network.
5 . The method of claim 1 , wherein the image obtained on the first remote user interface device is a live image.
6 . The method of claim 1 , wherein creating, on the first remote user interface device, the augmented reality note comprises superimposing the augmented reality note onto the image.
7 . The method of claim 1 , wherein the augmented reality note comprises anchor data, creating, on the first remote user interface device, the augmented reality note further comprises uploading the augmented reality note and the anchor data to a network.
8 . The method of claim 1 , wherein receiving, on the second remote user interface device, the augmented reality note comprises displaying, on the second remote user interface device, an image with the augmented reality note superimposed therein, wherein the image displayed on the second remote user interface device is a live image.
9 . The method of claim 8 , wherein displaying, on the second remote user interface device, the image with the augmented reality note superimposed therein further comprises presetting the household appliance based on the control commands within the received augmented reality note.
10 . A method of controlling a household appliance, the method comprising: setting, within an augmented reality note, control commands for the household appliance; receiving, on a remote user interface device, the augmented reality note, wherein receiving, on the remote user interface device, the augmented reality note comprises receiving a push notification, wherein the push notification comprises a text element containing the control commands; and activating the household appliance based on the control commands set within the received augmented reality note.
11 . The method of claim 10 , further comprising: obtaining, by the remote user interface device, an image, wherein the augmented reality note is superimposed onto the image.
12 . The method of claim 10 , wherein receiving, on the remote user interface device, the augmented reality note comprises displaying, on the remote user interface device, an image with the augmented reality note superimposed onto the image.
13 . The method of claim 10 , wherein augmented reality note comprises a reference and wherein the household appliance is activated based on the control commands in response to the reference being selected.
14 . The method of claim 10 , wherein the remote user interface device is a second remote user interface device, further comprising obtaining on, a first remote user interface device, an image, and further comprising creating, on the first remote user interface device, the augmented reality note.
15 . The method of claim 14 , wherein creating, on the first remote user interface device, the augmented reality note comprises superimposing the augmented reality note onto the image.
16 . The method of claim 15 , wherein creating, on the first remote user interface device, the augmented reality note comprises uploading the augmented reality note to a network.

Description

FIELD The present subject matter relates generally to household appliances, and more particularly to methods for controlling household appliances using augmented reality. BACKGROUND Household appliances may include appliances that may be found in a household, such as, but not limited to, laundry appliances, kitchen appliances, and room air conditioners. Such household appliances may generally be utilized for a variety of tasks and may, for example, be used by one or more users. Often household appliances require one or more control commands to operate. In some cases, a user may wish to preset, or communicate, desired control commands of the household appliance for another user. For example, a first user may wish to preset, or communicate, the desired control commands for an oven appliance to a second user. In such cases, effective communication of the control commands between users may be imperative to properly control the household appliance. Accordingly, there exists a need for systems and methods that makes communication between users, specifically with respect to the control commands of the household appliance, easier and more convenient. Particularly, a method for controlling the household appliance using augmented reality would be useful. BRIEF DESCRIPTION Aspects and advantages of the invention will be set forth in part in the following description, or may be apparent from the description, or may be learned through practice of the invention. In one exemplary embodiment, a method of controlling a household appliance is provided. The method may include a step of obtaining, on a first remote user interface device, an image. The method also may include a step of creating, on the first remote user interface device, an augmented reality note. The method may further include a step of setting, within the augmented reality note, control commands for the household appliance. The method may also include a step of receiving, on the second remote user interface device, the augmented reality note. The method may further include a step of activating, by the second remote user interface device, the household appliance based on the control commands set within the received augmented reality note. In another exemplary embodiment, a method of controlling a household appliance is provided. The method may include a step of setting within an augmented reality note control commands for the household appliance. The method may also include a step of receiving, on a remote user interface device, the augmented reality note. The method may further include a step of activating the household appliance based on the control commands set within the received augmented reality note. These and other features, aspects and advantages of the present invention will become better understood with reference to the following description and appended claims. The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. BRIEF DESCRIPTION OF THE DRAWINGS A full and enabling disclosure of the present invention, including the best mode thereof, directed to one of ordinary skill in the art, is set forth in the specification, which makes reference to the appended figures. FIG. 1 provides a front view of a refrigerator appliance according to one or more exemplary embodiments of the present subject matter. FIG. 2 provides a perspective view of the refrigerator appliance of FIG. 1. FIG. 3 provides a front view of the refrigerator appliance of FIG. 1 with the doors in an open position. FIG. 4 provides a perspective view of a microwave oven appliance according to one or more exemplary embodiments of the present subject matter. FIG. 5 provides a diagrammatic illustration of a remote computing device in communication with a household appliance and with one or more remote user interface devices according to one or more exemplary embodiments of the present subject matter. FIG. 6 provides an illustration of a first remote user interface device according to one or more exemplary embodiments of the present subject matter. FIG. 7 provides an additional illustration of the first remote user interface device according to one or more exemplary embodiments of the present subject matter. FIG. 8 provides yet another additional illustration of the first remote user interface device according to one or more exemplary embodiments of the present subject matter. FIG. 9 provides an illustration of a second remote user interface device according to one or more exemplary embodiments of the present subject matter. FIG. 10 provides an additional illustration of the second remote user interface device according to one or more exemplary embodiments of the present subject matter. FIG. 11 provides yet another additional illustration of the second remote user interface device according to one or more exemplary embodiments of