US-12626149-B2 - Electronic device and method for recognizing usage of body part and state of user using knowledge graph

US12626149B2US 12626149 B2US12626149 B2US 12626149B2US-12626149-B2

Abstract

A method of an electronic device is provided. The method includes obtaining, from a memory of the electronic device, information indicating a usage relationship between distinct states of a user of the electronic device and at least one body part, identifying a first state of the user corresponding to a first function among a plurality of functions executable by the electronic device, identifying an event for executing a second function different from the first function, comparing, in response to identifying the event, a first body part used by the user associated with the first state and a second body part used by the user associated with a second state corresponding to the second function, based on the obtained information, and executing, in response to the identified event, a third function indicated in the information as being associated with the second function, based on a result of the comparing.

Inventors

Jinhe JUNG
Gibeom PARK
Sungmok SEO
Chaeseung LIM
Myunghee Han

Assignees

SAMSUNG ELECTRONICS CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20220418
Priority Date: 20210630

Claims (15)

1 . A method of an electronic device, comprising: obtaining, from a memory of the electronic device, information indicating a usage relationship between distinct states of a user of the electronic device and at least one body part; identifying a state of the user; based on identifying a first state of the user, identifying a first body part that is indicated by the information as being used by the user in the first state; identifying an event for executing a first function among a plurality of functions executable by the electronic device; identifying, based on the event, a body part that is indicated by the information as being used by the user with respect to the first function; and based on the identified body part corresponding to the first body part, executing a second function among the plurality of functions that is indicated by the information as being associated with the first function, wherein the second function is indicated by the information as being associated with a second body part different from the first body part and is executed as a replacement of the first function while the first state is maintained, and wherein the identifying the body part that is indicated by the information as being used by the user with respect to the first function further comprises: identifying, based on the obtained information, a first node corresponding to the first state and a second node corresponding to a second state corresponding to the first function; identifying, based on the obtained information, one or more nodes coupled to each of the first node and the second node; and identifying, in response to identifying a node that is commonly coupled to the first node and the second node, among the identified one or more nodes, whether the body part corresponds to the first body part.
2 . The method of claim 1 , wherein the information obtained from the memory indicates at least one knowledge graph indicating a usage of the at least one body part in each of the distinct states, based on a connection between nodes respectively corresponding to the distinct states and the at least one body part.
3 . The method of claim 2 , wherein the usage corresponds to one of a first usage type indicating exclusive use of a body part by the user or a second usage type indicating partial use of a body part by the user.
4 . The method of claim 1 , wherein the identifying the first state further comprises identifying a first node, based on the obtained information indicating a sequential connection between nodes respectively corresponding to the distinct states of the user, corresponding to the first state, and wherein the identifying the first body part further comprises identifying the first body part, based on the obtained information, by extracting one or more nodes connected to the identified first node.
5 . The method of claim 1 , wherein the identifying the event further comprises identifying an occurrence of the event, in response to receiving a signal indicating at least one of an incoming call, an electronic mail or a text message, from an external electronic device distinct from the electronic device via a communication circuitry of the electronic device.
6 . The method of claim 1 , wherein the executing the second function further comprises: identifying, based on the identified body part corresponding to the first body part, one or more other nodes included in a hierarchy corresponding to the second node, based on a hierarchical connection of nodes respectively corresponding to the distinct states in the information; identifying, in response to identifying the one or more other nodes, a third node independent of the first body part among the identified one or more other nodes; and executing, in response to identifying of the third node, the second function corresponding to the third node.
7 . The method of claim 1 , further comprising executing the first function as a response to the identified event, based on the identified body part different from the first body part.
8 . The method of claim 1 , further comprising executing a third function for adjusting the first function that has been executed by the user, based on the identified body part.
9 . The method of claim 8 , wherein the executing the third function further comprises executing the third function, based on the identified body part corresponding to the first body part, and identifying that a priority of the third function indicated by the information is higher than a priority of the second function indicated by the information.
10 . An electronic device, comprising: memory including one or more storage media storing instructions; and at least one processor including processing circuitry, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: obtain, from the memory, information indicating a usage relationship between distinct states of a user of the electronic device and at least one body part; identify a state of the user; based on identifying a first state of the user, identify a first body part that is indicated by the information as being used by the user in the first state; identify an event for executing a first function among a plurality of functions executable by the electronic device; identify, based on the event, a body part that is indicated by the information as being used by the user with respect to the first function; and based on the identified body part corresponding to the first body part, execute a second function among the plurality of functions that is indicated by the information as being associated with the first function, wherein the second function is indicated by the information as being associated with a second body part different from the first body part and is executed as a replacement of the first function while the first state is maintained, and wherein the identifying the body part that is indicated by the information as being used by the user with respect to the first function further comprises: identifying, based on the obtained information, a first node corresponding to the first state and a second node corresponding to a second state corresponding to the first function; identifying, based on the obtained information, one or more nodes coupled to each of the first node and the second node; and identifying, in response to identifying a node that is commonly coupled to the first node and the second node, among the identified one or more nodes, whether the body part corresponds to the first body part.
11 . The electronic device of claim 10 , wherein the information obtained from the memory indicates a knowledge graph indicating a usage of the at least one body part in each of the distinct states, based on a connection between nodes respectively corresponding to the distinct states and the at least one body part.
12 . The electronic device of claim 11 , wherein the usage corresponds to one of a first usage type indicating exclusive use of a body part by the user or a second usage type indicating partial use of a body part by the user.
13 . The electronic device of claim 10 , wherein the memory includes the one or more instructions that further cause, when executed by the at least one processor, the at least one processor to: identify a first node corresponding to the first state, based on the obtained information indicating a sequential connection between nodes respectively corresponding to the distinct states of the user; and identify the first body part, based on the obtained information, by extracting one or more nodes connected to the identified first node.
14 . The electronic device of claim 10 , wherein the one or more instructions, when executed by the at least one processor, further cause the at least one processor to: identify, based on the identified body part corresponding to the first body part, one or more other nodes included in a hierarchy corresponding to the second node, based on a hierarchical connection of nodes respectively corresponding to the distinct states in the information; identify, in response to the identifying of the one or more other nodes, a third node independent of the first body part among the identified one or more other nodes; and execute, in response to identifying the third node, the second function corresponding to the third node.
15 . The electronic device of claim 10 , wherein the one or more instructions, when executed by the at least one processor, further cause the at least one processor to: execute a third function, based on the identified body part, to adjust the first function that has been executed by the user.

Description

CROSS-REFERENCE TO RELATED APPLICATION(S) This application is a continuation of PCT International Application No. PCT/KR2022/004902, which was filed on Apr. 5, 2022, and claims priority to Korean Patent Application No. 10-2021-0085517, filed on Jun. 30, 2021, in the Korean Intellectual Property Office, the disclosure of which are incorporated by reference herein their entirety. BACKGROUND Technical Field Embodiments of the disclosure relate to an electronic device and method for recognizing usage of one or more body parts and state of a user using a knowledge graph. Description of Related Art Various technological developments related to an electronic device equipped with artificial intelligence (AI) technology are in progress. An electronic device to which artificial intelligence technology is applied may learn and determine a surrounding situation by itself, independently of updating instructions by external signals. As the electronic device, to which the artificial intelligence technology is applied, learns and determines a surrounding situation in an active manner, it is possible to automatically respond to any situation requiring a human determination based on the electronic device. Artificial intelligence technology may encompass machine learning technology, reasoning technology, searching technology, planning technology, knowledge representation technology and so on. The machine learning technology may include, after an electronic device changes a set of parameters such as, e.g., a neural network by itself, based on learning data, to learn result data corresponding to the learning data, a technology that causes the result data corresponding to other data distinct from the learning data to be output. The reasoning technology may include a technique that causes an electronic device to obtain rules and/or facts from data. The searching technology may include a technique that allows an electronic device to search for a space including a possible solution to obtain an optimal solution to address a problem. The planning technique may include a technique that causes an electronic device to create, by itself, a sequence of functions to be executed in order to achieve a certain goal. The knowledge representation technology may include a technique that makes an electronic device automatically process human thoughts and/or knowledge. SUMMARY As a variety of electronic devices are personalized for a respective specific user, a demand may be made on a method for causing the electronic device to operate based on a result of recognizing and/or predicting the behavior of a specific user. As an electronic device provides multiple functions, a demand may be made on a method of selectively executing at least one function among the multiple functions, based on a result of recognizing the user's action by the electronic device. The technical problem to be achieved in this document is not limited to those described above, and other technical problems not mentioned herein will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the following description. A method of an electronic device, according to an embodiment, includes obtaining, from a memory of the electronic device, information indicating a usage relationship between distinct states of a user of the electronic device and at least one body part; identifying a first state of the user corresponding to a first function among multiple functions executable by the electronic device; identifying an event for executing a second function different from the first function; comparing, in response to identifying the event, a first body part used by the user associated with the first state and a second body part used by the user associated with a second state corresponding to the second function, based on the obtained information; and executing, in response to the identified event, a third function that is indicated in the information as being associated with the second function, based on a result of the comparing. An electronic device, according to an embodiment, includes a memory, and at least one processor operably coupled to the memory, where the memory stores one or more instructions that cause, when executed by the at least one processor, the at least one processor to obtain, from the memory, information indicating a usage relationship between distinct states of a user of the electronic device and at least one body part; identify a first state of the user corresponding to a first function among multiple functions executable by the electronic device; identify an event for executing a second function different from the first function; compare, in response to identification of the event, a first body part used by the user associated with the first state and a second body part used by the user associated with a second state corresponding to the second function based on the obtained information; and execute, in response to th