KR-20260065334-A - INTELLIGENT MANAGEMENT AND MONITORING METHOD FOR REFRIGERATOR, AND WEARABLE APPARATUS AND TAG APPARATUS FOR USE IN THEREIN

KR20260065334AKR 20260065334 AKR20260065334 AKR 20260065334AKR-20260065334-A

Abstract

The present disclosure includes a smart management and monitoring method for a refrigerator, and a wearable device and a tag device used therein. In one embodiment, a wearable device worn by a user for the smart management and monitoring method for a refrigerator may include a receiving electrode for human body communication, a human body communication receiver that receives a signal from a tag device attached to an item via the user's body and the receiving electrode, a signal control and processing device that processes the signal received by the human body communication receiver and generates data based on the processed signal, and a communicator that transmits the data generated by the signal control and processing device to a server. The data generated by the signal control and processing device may include information regarding the item and list information of items used by the user.

Inventors

박미정
박형일
이재진

Assignees

한국전자통신연구원

Dates

Publication Date: 20260508
Application Date: 20241101

Claims (20)

In a wearable device worn by a user for a smart management and monitoring method of a refrigerator, Receiving electrode for human body communication; A human body communication receiver that receives a signal from a tag device attached to an item via the user's body and the receiving electrode; A signal control and processing device that processes a signal received by the human body communication receiver and generates data based on the processed signal; and It includes a communicator that transmits the data generated by the signal control and processing device to a server, A wearable device in which data generated by the signal control and processing device includes information regarding the item and list information of items used by the user.
In Article 1, The above-mentioned communication device receives analysis result data from the above-mentioned server, The above analysis result data is a wearable device derived by the server based on information regarding the above item and list information of items used by the above user.
In Article 1, The above-described communication device is a wearable device that receives updated refrigerator item holding status data from the server based on whether the item has been taken out of the refrigerator by the user or whether the item has been put into the refrigerator by the user.
In Article 1, When the user takes an item out of the above refrigerator: The above human body communication receiver receives, based on human body communication, ID information stored in the tag device of the item being taken out of the refrigerator via the user's body and the receiving electrode, and The above signal control and processing device generates or updates list information of items retrieved by the user, and, A wearable device that transmits list information of items removed from the refrigerator by the user to the server, and receives from the server, second analysis result data generated through analysis based on the list information of items removed from the refrigerator by the user and second refrigerator item holding status data.
In Article 1, The wearable device further includes a power source that supplies power to the signal control and processing device, and A wearable device in which the supplied power is also supplied to the human body communication receiver and the communicator via the signal control and processing device.
In a tag device attached to an item for a smart management and monitoring method of a refrigerator, Transmitting electrode and receiving electrode for human body communication; A human body communication receiver that receives a signal transmitted through an electric field formed from a transmitting electrode of each section of a refrigerator to a tag receiving electrode; A signal control and processing device configured to determine whether to transmit a response signal to the refrigerator based on the received signal; and Based on the determination that the response signal is transmitted to the refrigerator by the signal control and processing device, the human body communication transmitter for transmitting a signal through an electric field formed from a tag transmitting electrode to a receiving electrode of each section of the refrigerator is included. The above tag device further includes an input device that detects a user's touch, and The above human body communication transmitter is a tag device that transmits ID information stored in the tag device to a wearable device worn by the user, via the user's body and the transmitting electrode, based on the user's touch.
In Article 6, The signal received from the refrigerator by the human body communication receiver includes a preamble, The above preamble is: Source address information including information regarding the sections of the above refrigerator; and A tag device including destination address information including tag ID information.
In Article 7, The above signal control and processing device determines whether to transmit the response signal to the refrigerator, whether the tag ID information included in the destination address information matches the ID information stored in the tag device, and A tag device that determines to transmit the response signal to the refrigerator based on the determination that the tag ID information included in the destination address information matches the ID information stored in the tag device.
In Article 8, The above tag device further includes a power source that supplies power to the signal control and processing device, and A tag device in which the supplied power is also supplied to the human body communication receiver and the human body communication transmitter via the signal control and processing device.
In a refrigerator for storing items received by a user, An input device that detects the voice command of the above user; A signal control and processing device that derives information regarding the item based on the above voice command and generates or updates list information of the items stored in the refrigerator based on information regarding the items stored in the refrigerator; A communication device that transmits the above list information to a server and receives first analysis result data and first refrigerator item holding status data from the server; and The output display device includes at least one piece of information included in the first analysis result data and the first refrigerator item holding status data received from the server, The above first analysis result data and the above first refrigerator item holding status data are generated by the above server through analysis based on the above list information, and The above refrigerator is: Transmitting electrodes and receiving electrodes for human body communication in each section; A human body communication receiver that receives a signal transmitted to a receiving electrode of each section through an electric field formed from a transmitting electrode of a tag device; A refrigerator characterized by further including a human body communication transmitter that transmits a signal to the receiving electrode of the tag device through an electric field formed at the transmitting electrode of each section.
In Article 10, The above signal control and processing device is: Information regarding items entered into the refrigerator by the above user is mapped to ID information stored in the tag device of the items, and Based on ID information stored in tag devices of items stored in the refrigerator, monitoring whether the items are stored in which session within the refrigerator, and A refrigerator characterized by generating or updating list information of items stored in the refrigerator based on information regarding items stored in the refrigerator, ID information of tag devices of the items, and monitored results.
In Article 10, When the door of the refrigerator is closed after the user has removed an item from the refrigerator: The above signal control and processing device updates list information of items stored in the refrigerator based on information regarding items stored in the refrigerator and ID information of tag devices of the items, and The above-mentioned communication device transmits the above-mentioned updated list information to the server and receives the second analysis result data and the second refrigerator item holding status data received from the server, wherein the second analysis result data and the second refrigerator item holding status data are generated by the server through analysis based on the above-mentioned updated list information, and, A refrigerator characterized in that the output display device outputs at least one piece of information included in the second analysis result data and the second refrigerator item holding status data.
In Article 14, The refrigerator further includes a switch configured to select one of the transmitting electrodes for transmission and one of the receiving electrodes for reception. A refrigerator characterized in that the signal control and processing device is further configured to control the switch to select the one transmitting electrode and to select the one receiving electrode.
In Article 13, The above signal control and processing device generates a signal for verifying whether the above item is stored in the refrigerator, The above human body communication transmitter transmits the signal to the tag device of the above item, The above signal includes a preamble, and The above preamble is: Source address information including information regarding the sections of the above refrigerator; and A refrigerator characterized by including destination address information including tag ID information.
In Article 13, The human body communication receiver receives a response signal transmitted by a tag device of the article as a response to the signal including the preamble, and A refrigerator characterized by the above signal control and processing device determining that the above item is stored in the refrigerator based on the received response signal.
A smart refrigerator management and monitoring method comprising a signal control and processing device, an input device, and an output display device, A step of detecting a user's voice command by the input device of the refrigerator; A step of deriving information regarding an item being entered into the refrigerator by the user based on the voice command by the signal control and processing device of the refrigerator, and mapping the information regarding the entered item to ID information stored in the tag device of the entered item; A step of monitoring whether the items are stored in which session within the refrigerator based on ID information stored in tag devices of the items stored in the refrigerator, by the signal control and processing device of the refrigerator; A step of generating or updating list information of items stored in the refrigerator based on information regarding items stored in the refrigerator, ID information of tag devices of the items, and monitored results, by the signal control and processing device of the refrigerator; A step of transmitting the above list information to a server; A step of generating first analysis result data and first refrigerator item holding status data through analysis based on the list information by the above server; A step of transmitting the first analysis result data and the first refrigerator item holding status data to the refrigerator by the above server; A step of outputting at least one piece of information included in the first analysis result data transmitted from the server to the refrigerator and the first refrigerator item holding status data by the output display device of the refrigerator; and A refrigerator smart management and monitoring method comprising the step of transmitting the first analysis result data and the first refrigerator item holding status data to the user's wearable device by the server.
In Article 16, A refrigerator smart management and monitoring method characterized in that information regarding items stored in the refrigerator includes information regarding the names of the items and information regarding the date the items were received in the refrigerator.
In Article 16, A refrigerator smart management and monitoring method comprising the information included in the first analysis result data and the first refrigerator item holding status data, which includes the current food holding status information of the refrigerator, location information of each food, and notification information for food nearing expiration date.
In Article 16, When the user takes an item out of the above refrigerator: A step of detecting contact with the user by means of an input device of the tag device; A step of receiving ID information stored in a tag device of an item being taken out of the refrigerator, via a receiving electrode of the wearable device and the user's body, based on human body communication by the user's wearable device; A step of generating or updating list information of items taken out of the refrigerator by the user by the user's wearable device; A step of transmitting list information of items removed from the refrigerator by the user to the server by means of the user's wearable device; A step of generating second analysis result data and second refrigerator item holding status data through analysis based on list information of items removed from the refrigerator by the user by the server; and A refrigerator smart management and monitoring method comprising the step of transmitting the second analysis result data and the second refrigerator item holding status data to the wearable device by the server.
In Article 19, When the door of the refrigerator is closed after the user has removed an item from the refrigerator: A step of updating list information of items stored in the refrigerator based on information regarding items stored in the refrigerator and ID information of tag devices of the items, by the signal control and processing device of the refrigerator; A step of transmitting the updated list information to the server via the communication device of the refrigerator; A step of generating third analysis result data and third refrigerator item holding status data through analysis based on the updated list information by the above server; A step of transmitting the third analysis result data and the third refrigerator item holding status data to the refrigerator by the server above; A step of outputting at least one piece of information included in the third analysis result data transmitted from the server to the refrigerator and the third refrigerator item holding status data by the output display device of the refrigerator; and A refrigerator smart management and monitoring method comprising the step of transmitting the third analysis result data and the third refrigerator item holding status data to the wearable device by the server.

Description

Smart management and monitoring method for a refrigerator, and a wearable device and tag device used therein The present disclosure relates to a smart management and monitoring method, and more specifically, to a smart management and monitoring method for a refrigerator, and a wearable device and a tag device used therein. Human body communication is a technology that transmits data using the human body as a communication channel, allowing various devices located close to the human body to transmit and receive data through it. When a fixed communication device attached to an object and a user's mobile communication device transmit and receive data via human body communication, a situation may arise where mobile communication devices belonging to other users who are near or in contact with the user receive data from the fixed communication device. In particular, a home appliance may be one of the fixed communication devices, and a mobile communication device worn by a user may communicate with the home appliance to facilitate the user's use of the home appliance and receive and provide information or data regarding the use of the home appliance. According to this, human body communication provides more efficient and advanced convenience in using home appliances, and related research is actively underway. FIG. 1 is a block diagram illustrating a refrigerator smart management and monitoring system according to one embodiment of the present disclosure. FIG. 2 illustrates a refrigerator smart management and monitoring method according to one embodiment of the present disclosure. FIG. 3 is a block diagram illustrating a wearable device and a tag device according to one embodiment of the present disclosure. FIG. 4 is a block diagram illustrating a tag device and a refrigerator according to one embodiment of the present disclosure. FIG. 5 illustrates the communication process between a user's wearable device, a refrigerator, and a server when a user places items into a refrigerator according to some embodiments of the present disclosure. FIG. 6 is a flowchart illustrating a process according to an embodiment of the present disclosure related to the process of FIG. 5. FIG. 7 illustrates the communication process between a user's wearable device, a refrigerator, and a server when a user takes an item out of a refrigerator according to some embodiments of the present disclosure. FIG. 8 is a flowchart illustrating a process according to an embodiment of the present disclosure related to the process of FIG. 7. FIG. 9 illustrates the communication process between a tag device, a user's wearable device, and a server when a user takes an item out of a refrigerator according to some embodiments of the present disclosure. FIG. 10 is a flowchart illustrating a process according to an embodiment of the present disclosure related to the process of FIG. 9. FIG. 11 is a block diagram illustrating an apparatus according to an embodiment of the present disclosure. In the following, embodiments of the present disclosure will be described clearly and in detail so that a person skilled in the art can easily practice the present disclosure. Terms such as "unit" and "module" used below, or functional blocks illustrated in the drawings, may be implemented in the form of software configurations, hardware configurations, or combinations thereof. In order to clearly explain the technical concept of the present invention, detailed descriptions of redundant components are omitted below. “Or” as used in the present specification, including in claims, indicates a comprehensive list when used in a list of items (e.g., a list of items preceded by phrases such as “at least one,” “one or more,” or “one or both”), for example, a list of at least one of A, B, or C means A or B or C or AB or AC or BC or ABC (i.e., A, B, and C). This document relates to a smart monitoring method and device utilizing edge AI semiconductors. The disclosure of this document concerns a method and device capable of recognizing various food ingredients, such as fresh food, cooked food, and container-packaged ingredients, stored in a refrigerator by applying human body communication technology capable of object recognition and the construction of individual unit networks, and artificial intelligence technology capable of situational awareness, and capable of providing storage location information of the refrigerator ingredients and customized information for each user. Recently, there has been a trend of introducing intelligent home appliances that utilize artificial intelligence (AI) technology to learn autonomously and analyze users' lifestyles and habits for more efficient use. A prime example is a refrigerator equipped with AI technology. Technology has been announced that automatically captures food items entering and leaving the refrigerator via an internal camera to create a list. Utilizing "Vision AI" technology trained on approximately one million food photos, it rec