KR-20260067261-A - ELECTRONIC DEVICE AND METHOD FOR RECOMMENDING FOOD IN THE ELECTRONIC DEVICE

KR20260067261AKR 20260067261 AKR20260067261 AKR 20260067261AKR-20260067261-A

Abstract

An electronic device according to one embodiment includes a camera, a communication circuit, a display, a memory for storing commands, and at least one processor, wherein when the commands are executed individually and/or collectively by the at least one processor, the electronic device may acquire images through the camera, receive sensor values detected by at least one external sensor through the communication circuit, identify food image regions included in the images, identify a user's gesture for eating food based on the food image regions and the sensor values, identify foods corresponding to the food image regions and sugar content values corresponding to the foods based on the identification of the user's gesture for eating food, identify priorities of the foods using the sugar content values corresponding to the foods, and display information indicating the order of eating the foods through the display based on the priorities of the foods, and may include other embodiments.

Inventors

김진희
배한주
안진완
유상아
이상빈
천우형

Assignees

삼성전자주식회사

Dates

Publication Date: 20260512
Application Date: 20241206
Priority Date: 20241105

Claims (20)

In the electronic device (101, 200, 400), Camera(180, 411, 412, 413); Communication circuit (190, 470); Display (160, 450); Memory for storing instructions (130, 440); and It includes at least one processor (120, 420), When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, Images are acquired through the above camera, and Sensor values detected by at least one external sensor are received through the above communication circuit, and Identify food image regions included in the above images, and Identifying a user's gesture for food intake based on the above food image regions and the above sensor values, and Based on the identification of the user's gesture for consuming the food, the foods corresponding to the food image regions and the sugar content values corresponding to the foods are identified, and Identifying the priorities of the foods using the sugar content values corresponding to the foods, and An electronic device configured to display information indicating the order of consumption of the foods through the display based on the priorities of the foods.
In paragraph 1, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, Identifying at least one food among the foods consumed by the user based on the above images and the user's gesture, and Obtaining the value of the amount of each of the at least one food consumed by the above user, A value of the amount of sugar consumed by the user is obtained by using the value of the sugar content corresponding to each of the at least one food and the value of the amount of each of the at least one food consumed by the user, and Obtaining a sugar threshold value associated with the blood glucose elevation rate of the above user, and An electronic device that displays information to lower the user's blood sugar rise rate value when the value of the sugar consumed by the user through the above display exceeds the sugar threshold value.
In paragraph 1 or 2, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, Identifying whether a first sugar content value corresponding to a first food consumed by the user exists from a database containing multiple sugar content values corresponding to each of multiple foods, and If a first sugar content value corresponding to the first food exists in the above database: Obtaining a first sugar content value corresponding to the first food from the above database, and If a first sugar content value corresponding to the first food does not exist in the above database: After a designated amount of the first food is consumed by the user, a first blood glucose elevation rate value is obtained for the user, and Obtain a second salt content value corresponding to the second food associated with the first food from the above database, and Obtaining a second blood sugar increase rate value measured for the user after a specified amount of the second food is consumed by the user from the above database, and Calculate a first sugar content value corresponding to the first food using the first blood sugar increase rate value, the second sugar content value, and the second blood sugar increase rate value, and An electronic device that updates the database to include the first sugar content value corresponding to the first food.
In any one of paragraphs 1 through 3, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that displays information indicating that the user's consumed sugar value exceeds the consumed sugar threshold value through the display when the sugar value consumed by the user exceeds the sugar threshold value.
In any one of paragraphs 1 through 4, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that displays information recommending food to be consumed by the user among the foods through the display when the user's intake amount value exceeds the intake threshold value.
In any one of paragraphs 1 through 5, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that displays information indicating foods among the foods that are not recommended for consumption by the user through the display when the user's intake amount value exceeds the intake threshold value.
In any one of paragraphs 1 through 6, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that displays information through the display to guide the user to reduce the speed of consumption of the foods when the user's intake amount exceeds the intake threshold value.
In any one of paragraphs 1 through 7, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that displays information through the display instructing the user to consume a combination of at least two of the foods when the user's intake amount exceeds the intake threshold value.
In any one of paragraphs 1 through 8, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, If the user's sugar intake value exceeds the sugar threshold, information recommending exercise is displayed through the display, and The information recommending the above exercise is an electronic device including the type of exercise, exercise intensity, and/or exercise time.
In any one of paragraphs 1 through 9, When the above commands are executed individually and/or collectively by the at least one processor, the electronic device, An electronic device that, when the above types of exercise include running or walking, identifies a route to be recommended for running or walking based on the user's location and displays the recommended route to be recommended for running or walking through the display.
In a food recommendation method in an electronic device (101, 200, 400), The operation of acquiring images through the cameras (180, 411, 412, 413) of the electronic device; The operation of receiving sensor values detected by at least one external sensor through the communication circuit (190, 470) of the electronic device; An operation to identify food image regions included in the above images; An action of identifying a user's gesture for food intake based on the above food image regions and the above sensor values; An operation of identifying foods corresponding to the food image regions and sugar content values corresponding to the foods based on the identification of the user's gesture for consuming the food; The operation of identifying priorities of the foods using the sugar content values corresponding to the foods; and A method including the operation of displaying information indicating the order of consuming the foods through the display (160, 450) of the electronic device based on the priorities of the foods.
In Paragraph 11, An action of identifying at least one food among the foods consumed by the user based on the above images and the user's gesture; The operation of obtaining the value of the amount of each of the at least one food consumed by the above user; The operation of obtaining a sugar amount value consumed by the user by using a sugar content value corresponding to each of the at least one food and a value of the amount of each of the at least one food consumed by the user; The operation of obtaining a sugar threshold value associated with the blood glucose rise rate of the above user; and A method including an operation to display information to lower the user's blood sugar rise rate value when the sugar amount value consumed by the user through the above display exceeds the sugar amount threshold value.
In Article 11 or Article 12, An operation of identifying whether a first sugar content value corresponding to a first food consumed by the user exists from a database containing multiple sugar content values corresponding to each of multiple foods; If a first sugar content value corresponding to the first food exists in the database, the operation of obtaining the first sugar content value corresponding to the first food from the database; and A method comprising the operation of, if a first sugar content value corresponding to the first food does not exist in the database, obtaining a first blood sugar increase rate value measured for the user after a designated amount of the first food is consumed by the user, obtaining a second sugar content value corresponding to the second food associated with the first food from the database, obtaining a second blood sugar increase rate value measured for the user after a designated amount of the second food is consumed by the user from the database, calculating a first sugar content value corresponding to the first food using the first blood sugar increase rate value, the second sugar content value, and the second blood sugar increase rate value, and updating the database to include the first sugar content value corresponding to the first food.
In any one of paragraphs 11 through 13, A method comprising the operation of displaying information through the display indicating that the user's consumed sugar value exceeds the consumed sugar threshold value when the sugar value consumed by the user exceeds the sugar threshold value.
In any one of paragraphs 11 through 14, A method including the operation of displaying information recommending food to be consumed by the user among the foods through the display when the user's intake amount value exceeds the intake amount threshold value.
In any one of paragraphs 11 through 15, A method including the operation of displaying information through the display indicating foods among the foods that are not recommended for consumption by the user when the user's intake amount value exceeds the intake threshold value.
In any one of paragraphs 11 through 16, A method including the operation of displaying information through the display to guide the user to reduce the speed of consumption of the foods when the user's intake amount value exceeds the intake threshold value.
In any one of paragraphs 11 through 17, A method including the operation of displaying information through the display to guide the user to consume a combination of at least two of the foods when the user's intake amount value exceeds the intake amount threshold value.
In any one of paragraphs 11 through 18, It includes an operation to display information recommending exercise through the display when the user's sugar intake value exceeds the sugar threshold value, Information recommending the above exercise includes a method of including the type of exercise, exercise intensity, and/or exercise time.
In a non-transient storage medium storing commands, said commands are configured such that when executed by an electronic device (101, 200, 400), said electronic device performs at least one operation, said at least one operation being, The operation of acquiring images through the cameras (180, 411, 412, 413) of the electronic device; The operation of receiving sensor values detected by at least one external sensor through the communication circuit (190, 470) of the electronic device; An operation to identify food image regions included in the above images; An action of identifying a user's gesture for food intake based on the above food image regions and the above sensor values; An operation of identifying foods corresponding to the food image regions and sugar content values corresponding to the foods based on the identification of the user's gesture for consuming the food; The operation of identifying priorities of the foods using the sugar content values corresponding to the foods; and A storage medium comprising an operation of displaying information indicating the order of consumption of the foods through the display (160, 450) of the electronic device based on the priorities of the foods.

Description

Electronic Device and Method for Recommending Food in the Electronic Device Various embodiments of the present disclosure relate to an electronic device and a method for recommending food in an electronic device. Various services and additional functions provided through electronic devices, such as smartphones and wearable devices, are gradually increasing. To enhance the utility value of these electronic devices and satisfy the needs of diverse users, telecommunications service providers and electronic device manufacturers are competitively developing devices to offer various functions and differentiate themselves from competitors. Consequently, the functions provided through electronic devices are also becoming increasingly sophisticated. Recently, there has been an increasing number of people who are interested in health and want information on what foods to eat for their health, and electronic devices may provide a function that offers information about foods that are good for the user's body. FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment. FIG. 2a is a drawing showing an electronic device according to one embodiment. FIG. 2b is a diagram showing the structure of a display and an eye-tracking camera of an electronic device according to one embodiment. FIG. 3 is a diagram showing an example of a case where a user is eating while an electronic device according to one embodiment is being worn by the user. FIG. 4 is a block diagram of an electronic device according to one embodiment. FIG. 5 is a flowchart illustrating the operation of providing a user with the order of consumption of foods in an electronic device according to one embodiment. FIG. 6 is a flowchart illustrating an operation to provide information to lower a user's blood glucose rise rate value in an electronic device according to one embodiment. FIG. 7 is a flowchart illustrating the operation of obtaining a sugar content value and a blood glucose rise rate value corresponding to a new food in an electronic device according to one embodiment and updating a database. FIG. 8 is a diagram showing an example of displaying the order of consumption of foods while the foods are displayed to the user through an electronic device according to one embodiment. FIG. 9 is a diagram showing an example indicating that the amount of sugar consumed by a user through an electronic device according to one embodiment exceeds a specified amount of sugar intake. FIG. 10 is a diagram showing an example of displaying information recommending food to be consumed by a user through an electronic device according to one embodiment. FIG. 11 is a diagram showing an example of displaying information about food that is not recommended for consumption by a user through an electronic device according to one embodiment. FIG. 12 is a diagram showing an example of displaying information that guides a user to reduce the speed of consuming food through an electronic device according to one embodiment. FIG. 13a is a diagram showing an example of a first exercise path recommended based on the user's location in an electronic device according to one embodiment. FIG. 13b is a diagram showing an example of a second exercise path recommended based on the user's location in an electronic device according to one embodiment. FIG. 14 is a diagram showing an example of eating while an electronic device according to one embodiment is worn by a user. FIG. 15 is a diagram showing an example of a screen displaying the user's intake of nutrients and recommendation information according to one embodiment. FIG. 16 is a diagram showing an example of a screen displaying the user's intake of nutrients, whether insufficient, appropriate, or excessive, according to one embodiment. FIG. 17a is a diagram illustrating an example of recommending food when a user's carbohydrate intake is identified through an electronic device as exceeding a specified amount of carbohydrate intake while a menu is being displayed to the user according to one embodiment. FIG. 17b is a diagram illustrating an example of recommending food through an electronic device when the intake of nutritional components of a user satisfies the intake range of specified image components while a menu is displayed to the user according to one embodiment. Hereinafter, electronic devices according to various embodiments will be examined with reference to the attached drawings. In the various embodiments, the term "user" may refer to a person using the electronic device or a device using the electronic device (e.g., an artificial intelligence electronic device). The terms used in this document are used merely to describe specific embodiments and are not intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. All terms used herein, including technical or scientific terms, may have the same meaning as