KR-20260065442-A - ELECTRONIC DEVICE AND METHOD FOR PROCESSING EXTERNAL CONNECTION INFORMATION INCLUDED IN MESSAGE IN THE ELECTRONIC DEVICE

KR20260065442AKR 20260065442 AKR20260065442 AKR 20260065442AKR-20260065442-A

Abstract

An electronic device according to one embodiment includes a communication circuit, a display, an audio output circuit, at least one processor, and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the electronic device may, upon confirming the reception of a first message containing external connection information, obtain first summary information related to a first content that can be provided through the external connection information, identify at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device, generate a second message containing a second text related to the first summary information and the first text based on the first summary information related to the first content and the first text using a first artificial intelligence model, and output audio data representing the first summary information and the second text related to the first text through the audio output circuit. Other embodiments may be included.

Inventors

손동일
방채림
이상현
정서로
지은혜
최보근

Assignees

삼성전자주식회사

Dates

Publication Date: 20260508
Application Date: 20241127
Priority Date: 20241101

Claims (19)

In an electronic device (101 of FIG. 1; 201 of FIG. 2a to 2b), Communication circuit (190 in FIG. 1; 290 in FIG. 2a); Display (160 in FIG. 1; 260 in FIG. 2a); Audio output circuit (155 in FIG. 1; 255 in FIG. 2); At least one processor (120 of FIG. 1; 220 of FIG. 2a to 2b); and It includes a memory for storing instructions (130 in FIG. 1; 230 in FIG. 2a), and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the reception of a first message containing external connection information, first summary information related to a first content that can be provided through the external connection information is obtained, and Identifying at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device, and Using a first artificial intelligence model, a second message is generated including a second text related to the first summary information and the first text based on the first summary information related to the first content and the first text, and An electronic device configured to output audio data representing the first summary information and the second text associated with the first text through the above audio output circuit.
In Article 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the meta tag information included in the above external connection information, the above first content is verified, and When the above-mentioned first content is identified as the third text, the above-mentioned second message is generated by synthesizing the above-mentioned first text and the above-mentioned third text using the above-mentioned first artificial intelligence model, and An electronic device configured to verify a fourth text summarizing the image using a second artificial intelligence model when the first content is verified as an image, and to generate a second message by synthesizing the first text and the fourth text using the first artificial intelligence model.
In any one of paragraphs 1 to 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When the first content is identified as a fifth text summarizing the text included in the web page corresponding to the external connection information using the third artificial intelligence model, the second message is generated by synthesizing the first text and the fifth text using the first artificial intelligence model, and An electronic device configured to use a third artificial intelligence model to identify the first content as an image included in a web page corresponding to the external connection information, and using a second artificial intelligence model to identify a sixth text summarizing the image, and then using a first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.
In any one of paragraphs 1 to 3, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, After outputting the second message as audio data through the audio output circuit, if a first gesture requesting the regeneration of the second message based on user input of the electronic device is confirmed, a third message is generated including second summary information related to the first content available through the external connection information and seventh text related to the first text. Audio data representing the seventh text is output through the above audio output circuit, and The second summary information related to the first content above is an electronic device including brief information of the first summary information or detailed information of the first summary information,
In any one of paragraphs 1 to 4, The first text related to the first content is an electronic device including text included in the first message,
In any one of paragraphs 1 to 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying as the first text the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device, and An electronic device configured to generate a second message including the first summary information and the second text related to the text included in the at least one message received within the specified time using the first artificial intelligence model.
In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When confirming the reception of the first message, if it is confirmed that the electronic device is connected to an external electronic device for outputting audio data, the second message is generated, and An electronic device configured to transmit audio data corresponding to the text of the second message to the external electronic device through the communication circuit.
In any one of paragraphs 1 through 7, If the above electronic device is a wearable electronic device configured to be worn by a part of a user, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the receipt of the first message, check whether the wearable electronic device is worn by a user, and When the above-mentioned wearable electronic device is worn by the user, if the setting for audio data output for a message is checked, the second message is generated, and An electronic device configured to output the second text of the second message as audio data through the above audio output circuit.
In any one of paragraphs 1 through 8, If the above electronic device is a wearable electronic device configured to be worn by a part of a user, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Upon confirming the receipt of the first message, check whether the wearable electronic device is worn by a user, and When the wearable electronic device is worn by the user, if it is confirmed using the camera of the wearable electronic device that the user is not looking at the display of the wearable electronic device, the second message is generated, and An electronic device configured to output the text of the second message as audio data through the above audio output circuit.
A method for processing external connection information included in a message in an electronic device, An operation of obtaining first summary information related to a first content that can be provided through said external connection information upon confirming the reception of a first message including external connection information; An operation to identify at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device; The operation of generating a second message including a second text related to the first summary information and the first text based on the first summary information and the first text using a first artificial intelligence model; and A method comprising the operation of outputting audio data representing the first summary information and the second text related to the first text through the above audio output circuit.
In Article 10, An operation to verify the first content based on meta tag information included in the external connection information; When the above-mentioned first content is identified as the third text, the operation of generating the above-mentioned second message by synthesizing the above-mentioned first text and the above-mentioned third text using the above-mentioned first artificial intelligence model; and A method further comprising the operation of verifying the first content as an image, verifying a fourth text summarizing the image using a second artificial intelligence model, and generating the second message by synthesizing the first text and the fourth text using the first artificial intelligence model.
In any one of paragraphs 10 to 11, When the first content is identified as a fifth text summarizing the text included in the web page corresponding to the external connection information using the third artificial intelligence model, the operation of generating the second message by synthesizing the first text and the fifth text using the first artificial intelligence model; and A method further comprising the operation of using a third artificial intelligence model to identify the first content as an image included in a web page corresponding to the external connection information, using a second artificial intelligence model to identify a sixth text summarizing the image, and using the first artificial intelligence model to generate the second message by synthesizing the first text and the sixth text.
In any one of paragraphs 10 to 12, After outputting the second message as audio data through the audio output circuit, if a first gesture requesting the regeneration of the second message based on user input of the electronic device is confirmed, an operation to generate a third message including second summary information related to the first content available through the external connection information and seventh text related to the first text; and It further includes the operation of outputting audio data representing the seventh text through the above audio output circuit, and A method comprising: second summary information related to the first content, including brief information of the first summary information or detailed information of the first summary information.
In any one of paragraphs 10 to 13, The first text related to the first content above includes a method comprising text included in the first message,
In any one of paragraphs 10 to 14, An operation of identifying as the first text the text included in at least one message received within a specified time after receiving the first message among the messages received from an external electronic device of an external user who transmitted the first message stored in the memory of the electronic device; and A method further comprising the operation of generating a second message including a second text related to the text included in the first summary information and the at least one message received within the specified time using the first artificial intelligence model.
In any one of paragraphs 10 to 15, When confirming the reception of the first message, if it is confirmed that the electronic device is connected to an external electronic device for outputting audio data, the operation of generating the second message; and A method further comprising the operation of transmitting audio data corresponding to the text of the second message to the external electronic device through the communication circuit.
In any one of paragraphs 10 through 16, When the above electronic device is a wearable electronic device configured to be worn by a part of a user, upon confirming the reception of the first message, an operation to check whether the wearable electronic device is in a state of being worn by a user; An operation to generate the second message when the setting of audio data output for a message is confirmed while the wearable electronic device is worn by the user; and A method further comprising the operation of outputting the second text of the second message as audio data through the above audio output circuit.
In any one of paragraphs 10 through 17, When the above electronic device is a wearable electronic device configured to be worn by a part of a user, upon confirming the reception of the first message, an operation to check whether the wearable electronic device is in a state of being worn by a user; An operation to generate the second message when, while the wearable electronic device is being worn by the user, it is confirmed using the camera of the wearable electronic device that the user is not looking at the display of the wearable electronic device; and A method further comprising the operation of outputting the text of the second message as audio data through the above audio output circuit.
In a non-volatile storage medium storing instructions, the instructions are configured to cause the wearable electronic device to perform at least one operation when executed by the wearable electronic device, wherein the at least one operation is, An operation of obtaining first summary information related to a first content that can be provided through said external connection information upon confirming the reception of a first message including external connection information; An operation of confirming at least one message containing a first text related to the first content among messages received from an external electronic device of an external user that transmitted the first message stored in the memory of the electronic device; The operation of generating a second message including first summary information and second text related to the first text based on first summary information related to the first content and first text using a first artificial intelligence model; and A storage medium comprising the operation of outputting audio data representing the first summary information and the second text related to the first text through the above audio output circuit.

Description

ELECTRONIC DEVICE AND METHOD FOR PROCESSING EXTERNAL CONNECTION INFORMATION INCLUDED IN MESSAGE IN THE ELECTRONIC DEVICE The present disclosure relates to an electronic device and a method for processing external connection information included in a message in the electronic device. The electronic device can display the contents of the received message through a display or output it as audio data. If the settings of the function for outputting the content of a message as audio data based on the user input of the electronic device are checked, the content of the received message can be output as audio data. FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment. FIG. 2a is a block diagram of an electronic device according to one embodiment. FIG. 2b is a block diagram illustrating the configuration of a processor and an AI model according to one embodiment. FIG. 2c is a block diagram illustrating the configuration of a message processing unit according to one embodiment. FIG. 3 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 4 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 5 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 6 is a diagram illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 7a is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 7b is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 8 is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 9 is a flowchart illustrating the operation of processing external connection information included in a message in an electronic device according to one embodiment. FIG. 10 is a drawing for explaining a generative artificial intelligence system according to one embodiment. FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through the server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)). The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) i