KR-102963854-B1 - A METHOD, DEVICE, AND SYSTEM FOR SELECTIVELY USING A PLURALITY OF VOICE DATA RECEPTION DEVICES FOR AN INTELLIGENT SERVICE

KR102963854B1KR 102963854 B1KR102963854 B1KR 102963854B1KR-102963854-B1

Abstract

According to various embodiments, the electronic device comprises a user interface, at least one communication module, a microphone, at least one speaker, at least one processor operatively connected to the user interface, the at least one communication module, the microphone, and the at least one speaker, and at least one memory electrically connected to the at least one processor, wherein, at execution, the at least one memory controls the at least one processor to broadcast identification information of the electronic device after receiving a portion of a wake-up utterance calling a voice-based intelligent assistant service through the microphone while the electronic device is wired or wirelessly connected to an access point (AP) connected to at least one external electronic device through the communication module, and receives the broadcasted identification information from the at least one external electronic device, and after receiving the entire wake-up utterance through the microphone, transmits first information related to the wake-up utterance received through the microphone individually to the at least one external electronic device, and from the at least one external electronic device individually by the at least one external electronic device Instructions can be stored to receive second information related to the received wake-up utterance, and to determine whether to transmit voice information received after the wake-up utterance to an external server based on at least part of the first information and the second information. Various other embodiments are possible.

Inventors

장성운
강정환
강상기

Assignees

삼성전자주식회사

Dates

Publication Date: 20260513
Application Date: 20190228
Priority Date: 20180827

Claims (20)

In electronic devices, display; At least one communication module; mike; At least one speaker; At least one processor; and Includes memory, The above memory, when executed individually or collectively by the at least one processor, causes the electronic device, While the above electronic device is connected via wired or wireless connection to an access point (AP) connected to a plurality of external electronic devices through the communication module, Based on the fact that the speech recognition score for the speech information received through the microphone is below a first threshold value, which is a numerical value representing part of a wake-up utterance, the speech information is continuously received, and At a first time, based on confirming that the portion of the wake-up utterance calling the voice-based intelligent assistant service is received as the voice recognition score for the voice information received through the microphone exceeds the first threshold value representing the portion of the wake-up utterance, the first identification information of the electronic device is broadcast, and at least one second identification information broadcast from at least one external electronic device among the plurality of external electronic devices is received, wherein the at least one second identification information is broadcast from the at least one external electronic device based on the receipt of the portion of the wake-up utterance by the at least one external electronic device. Based on receiving the entire wake-up utterance through the microphone at a second time point after the first time point, first information related to the wake-up utterance received through the microphone is individually transmitted to the at least one external electronic device based on the at least one second identification information, and second information related to the wake-up utterance received by the at least one external electronic device is individually received from the at least one external electronic device based on the first identification information. An electronic device storing instructions for determining whether to transmit voice information received after the wake-up utterance to an external server, based at least in part on the first information and the second information.
An electronic device according to claim 1, wherein the first information and the second information comprise at least one of the signal-to-noise ratio (SNR) of the wake-up utterance, audio quality, volume, sound pressure, or confidence score for the wake-up utterance.
In Article 2, An electronic device in which the reliability of the first wake-up utterance included in the first information is a value indicating the degree of agreement between the information regarding the wake-up utterance stored in the memory and the wake-up utterance received through the microphone.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, If the first value included in the first information is greater than the second value included in the second information, voice information received after the wake-up utterance is transmitted to the external server, and An electronic device that prevents voice information received after the wake-up utterance from being transmitted to the external server if the first value is smaller than the second value.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, Requesting the second information from at least one external electronic device among the at least one external electronic device that has not received the second information related to the wake-up firing, and An electronic device that receives the second information from at least one external electronic device that requested the second information.
In Article 1, The first information further includes state information of the electronic device, and the second information further includes state information of at least one external electronic device, and The above-mentioned status information is an electronic device comprising at least one of type information, information of a running application, distance information to a user, or priority information.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, An electronic device that transmits the first information individually to the at least one external electronic device through UDP (user datagram protocol) communication based on identification information of the at least one external electronic device.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, An electronic device that performs user authentication based on the wake-up utterance received through the microphone, indicating whether the wake-up utterance is the utterance of at least one registered user.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, An electronic device that, when deciding to transmit voice information received after the above wake-up utterance to an external server, transmits reader information indicating that the electronic device is a reader device to the external server.
In claim 9, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, Receive a leader selection from the above external server in response to the above leader information, and An electronic device that receives voice information and transmits it to an external server based on the received reader selection.
In claim 9, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, Receive a leader change command from the above external server in response to the above leader information, and An electronic device that refrains from transmitting the voice information to the external server based on the received reader change command.
In claim 1, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, An electronic device that outputs a response corresponding to the wake-up utterance through at least one of the at least one speaker or the at least one of the display when deciding to transmit voice information received after the wake-up utterance to the external server.
In claim 12, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, Through the above microphone, a voice command indicating a leader change command is received, and An electronic device that refrains from transmitting the voice information to the external server, at least based on the processing result of a voice command indicating the above-mentioned reader change command.
In electronic devices, Communication module; mike; speaker; At least one processor; and Includes memory, The above memory, when executed individually or collectively by the at least one processor, causes the electronic device, Based on the fact that the speech recognition score for the speech information received through the microphone is below a first threshold value, which is a numerical value representing part of a wake-up utterance, the speech information is continuously received, and At a first time point, based on confirming that the portion of the wake-up utterance calling the voice-based intelligent assistant service is received as the voice recognition score for the voice information received through the microphone exceeds the first threshold value representing the portion of the wake-up utterance, it is determined whether the state is connected to an access point (AP) through the communication module, and Based on the state of being connected to the above AP, Through the communication module above, a first identification information of the electronic device is broadcast, and at least one second identification information broadcast from at least one external electronic device among a plurality of external electronic devices connected to the AP is received, wherein the at least one second identification information is broadcast from the at least one external electronic device based on the reception of the part of the wake-up utterance by the at least one external electronic device, and Based on receiving the entirety of the wake-up utterance through the microphone at a second time point after the first time point, first information regarding the wake-up utterance is transmitted to each of the at least one external electronic device based on the at least one second identification information, and at least one second information regarding the wake-up utterance is received from each of the at least one external electronic device based on the first identification information. Based on the first information and at least one second information, it is determined whether the electronic device is a reader device, and Based on the fact that it is not connected to the above AP, An electronic device that stores instructions for receiving all of the wake-up utterances through the microphone, transmitting the first information of the wake-up utterances to an external server, and receiving reader information obtained from the external server based on the first information and at least one second information.
An electronic device according to claim 14, wherein the first information and the second information comprise at least one of the signal-to-noise ratio (SNR), audio quality, sound pressure, or confidence score of the wake-up utterance.
◈Claim 16 was waived upon payment of the establishment registration fee.◈ In Article 15, An electronic device in which the reliability of the first wake-up utterance included in the first information is a value indicating the degree of agreement between the information regarding the wake-up utterance stored in the memory and the wake-up utterance received through the microphone.
In Article 14, The first information above includes a first value representing the intensity of a wake-up utterance received through the microphone, and The above at least one second information includes a second value indicating the intensity of the wake-up ignition received by the at least one external electronic device, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the first value is greater than the second value, the electronic device is determined to be the reader device, and An electronic device that prevents the electronic device from being determined as the reader device if the first value is smaller than the second value.
In Article 14, The first information above includes a third value indicating the reliability of the wake-up utterance received through the microphone, and The above at least one second piece of information includes a fourth value indicating the reliability of the wake-up ignition received from the above at least one external electronic device, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, If the above third value is greater than the above fourth value, the electronic device is determined to be the reader device, and An electronic device that prevents the electronic device from being determined as the reader device if the third value is smaller than the fourth value.
In claim 14, the instructions, when executed individually or collectively by the at least one processor, cause the electronic device, Based on the received at least one second information, it is determined whether there is an external electronic device among the at least one external electronic device that has not transmitted the second information, and If there is an external electronic device that has not transmitted the second information, request the external electronic device to transmit the second information, and An electronic device that determines whether the electronic device is a reader device based on the first information and at least one second information when there is no external electronic device that has not transmitted the second information.
delete

Description

A method, device, and system for selectively using a plurality of voice data receiving devices for an intelligent service The present disclosure relates to intelligent services, and in particular, to a method, apparatus, and system for selecting a voice receiving device among a plurality of voice receiving devices. Recently, many electronic devices are being implemented to provide intelligent assistant services that perform various tasks in response to user voice input. For example, various electronic devices such as smart TVs, smartphones, air conditioners, refrigerators, and speakers are being implemented to offer intelligent assistant services. These services focus on understanding user intent and providing appropriate responses by utilizing natural language processing (NLP), speech signal processing, and machine learning algorithms. When providing intelligent assistant services using various electronic devices, there is a high possibility that unnecessary processing resources will be wasted as multiple devices simultaneously receive the user's voice input. delete FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2a is a system diagram of an intelligent assistant service system according to various embodiments. FIGS. 2B and FIGS. 2C are flowcharts illustrating a method for determining a reader device according to various embodiments. FIG. 3 is a diagram illustrating the operation of receiving part of a wake-up utterance to receive identification information of at least one external electronic device according to various embodiments. FIGS. 4a and FIGS. 4b are drawings for explaining the operation of receiving identification information of at least one external electronic device according to various embodiments. FIG. 5 is a diagram illustrating the operation of receiving identification information of at least one external electronic device according to various embodiments. FIGS. 6a and 6b are drawings for explaining the operation of transmitting information about a wake-up utterance according to various embodiments. FIG. 7 is a diagram illustrating the operation of transmitting information about a wake-up utterance according to various embodiments. FIGS. 8A and FIGS. 8B are drawings for explaining the operation of receiving information about a wake-up utterance according to various embodiments. FIGS. 9a, FIGS. 9b, and FIGS. 9c are drawings for explaining the operation of determining whether to transmit voice information to an external server according to various embodiments. FIG. 10 is a diagram illustrating the operation of receiving voice information according to various embodiments and transmitting it to an external server. FIG. 11 is a flowchart illustrating voice information transmission operations according to the selection of a reader device according to various embodiments. FIGS. 12a, 12b, and 12c are drawings for explaining voice information transmission operations according to the selection of a reader device according to various embodiments. FIG. 13 is a diagram illustrating a method for changing a reader device according to various embodiments. FIGS. 14a and FIGS. 14b are flowcharts illustrating a method for determining a reader device according to various embodiments. FIG. 15 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 16 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 17 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 18 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 19 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIG. 20 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIG. 21 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 22 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIG. 23 is a flowchart illustrating a method for determining a reader device according to various embodiments. FIG. 24 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIG. 25 is a flowchart illustrating the operation of determining a reader device according to various embodiments. FIG. 26 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIG. 27 is a flowchart illustrating the operation of determining a reader device according to various embodiments. FIG. 28 is a diagram illustrating the operation of determining a reader device according to various embodiments. FIGS. 29a and 29b are sequence diagrams for explaining the operation of determining a reader device according to various