EP-4738851-A2 - VOICE RECOGNITION SYSTEM, SERVER, DISPLAY APPARATUS AND CONTROL METHODS THEREOF

EP4738851A2EP 4738851 A2EP4738851 A2EP 4738851A2EP-4738851-A2

Abstract

A voice recognition system includes a server storing a plurality of manuals and a display apparatus transmitting, when a spoken voice of a user is recognized, characteristic information and a spoken voice signal corresponding to the spoken voice to the server, the characteristic information is characteristic information of the display apparatus, the server transmits a response signal to the spoken voice signal to the display apparatus based on a manual corresponding to the characteristic information among the plurality of manuals, and the display apparatus processes an operation corresponding to the received response signal; as a result, user convenience increases.

Inventors

CHAE, JI-EUN

Assignees

Samsung Electronics Co., Ltd.

Dates

Publication Date: 20260506
Application Date: 20151116

Claims (15)

A display apparatus comprising: a display; a voice input receiver; and a processor configured to: receive a user voice input through the voice input receiver, based on the user voice input being a voice input corresponding to a function control of the display apparatus, perform a function of the display apparatus based on the user voice input, based on the user voice input being a voice input corresponding to a function inquiry rather than the function control, control the display to output a UI according to the function inquiry based on a manual of the display apparatus and the user voice input, and based on the user voice input being a voice input corresponding to a state of the display apparatus rather than the function control, control the display to output a UI corresponding to confirmation of a state of the display apparatus based on state information of the display apparatus and the user voice input.
The apparatus as claimed in claim 1, wherein the processor is configured to, based on the user voice input is a voice input corresponding to the function control and corresponding to an external device connectable to the display apparatus through a communicator of the display apparatus, control the display to output a UI based on a connection state of the external device and the user voice input.
The apparatus as claimed in claim 2, wherein the UI based on the connection state of the external device and the user voice input includes information guiding a connection corresponding to a disconnection of the external device.
The apparatus as claimed in claim 1, wherein the processor is configured to, based on the user voice input being a voice input corresponding to the function inquiry, control the display to output information corresponding to the function inquiry according to the user voice input, obtained from a manual stored in at least one of the display apparatus or a server.
The apparatus as claimed in claim 4, wherein the UI according to the function inquiry includes information related to resolution of the function inquiry.
The apparatus as claimed in claim 1, wherein the state information of the display apparatus includes at least one of volume information or channel information.
The apparatus as claimed in claim 6, wherein the processor is configured to receive, from the server, response information based on state information of the display apparatus, transmitted to a server through a communicator of the display apparatus, and the user voice input, and control the display to output a UI corresponding to the received response information.
The apparatus as claimed in claim 1, wherein the user voice input corresponding to the state of the display apparatus is a voice input corresponding to a malfunction of a function performed in the display apparatus.
The apparatus as claimed in claim 1, wherein the processor is configured to, based on the user voice input being a voice input corresponding to the state of the display apparatus, control the display to output different UIs according to state information of the display apparatus at a time when the user voice input is received.
The apparatus as claimed in claim 1, wherein the processor is configured to, based on a user voice input being received from an external device wirelessly connected to the display apparatus, perform the same function as a function corresponding to the user voice input received through the voice input receiver.
A controlling method of a display apparatus comprising: receiving a user voice input; based on the user voice input being a voice input corresponding to a function control of the display apparatus, performing a function of the display apparatus based on the user voice input; based on the user voice input being a voice input corresponding to a function inquiry rather than the function control, outputting a UI according to the function inquiry based on a manual of the display apparatus and the user voice input; and based on the user voice input being a voice input corresponding to a state of the display apparatus rather than the function control, outputting a UI corresponding to confirmation of a state of the display apparatus based on state information of the display apparatus and the user voice input.
The method as claimed in claim 11, further comprising: based on the user voice input is a voice input corresponding to the function control and corresponding to an external device connectable to the display apparatus, outputting a UI based on a connection state of the external device and the user voice input.
The method as claimed in claim 12, wherein the UI based on the connection state of the external device and the user voice input includes information guiding a connection corresponding to a disconnection of the external device.
The method as claimed in claim 11, further comprising: based on the user voice input being a voice input corresponding to the function inquiry, outputting information corresponding to the function inquiry according to the user voice input, obtained from a manual stored in at least one of the display apparatus or a server.
The method as claimed in claim 14, wherein the UI according to the function inquiry includes information related to resolution of the function inquiry.

Description

Apparatuses and methods consistent with the embodiments relate to a voice recognition system, a server, a display apparatus, and control methods thereof, and more particularly, to a voice recognition system, a server, a display apparatus, and control methods thereof which processes a corresponding operation according to a response signal generated by recognizing a spoken voice. Electronic apparatuses that recognize voices spoken by users and perform functions corresponding thereto have been increasingly used. In general, a display apparatus capable of recognizing the voice collects the voice spoken by the user and transmits a spoken voice signal corresponding to the collected spoken voice to a server connected through a network. The server that receives the spoken voice signal analyzes the spoken voice signal to determine an intention of the user, and generates the resulting response signal and transmits the generated response signal to the display apparatus. As a result, the display apparatus can execute the function corresponding to the spoken voice of the user or provide information based on the response signal received from the server. However, the display apparatus capable of recognizing the voice in the related art has a limitation in analyzing the spoken voice of the user and determining the intention of the user based on a result of the analysis. For example, in the case of a simple function such as "channel-up", the server analyzes the spoken voice signal to correctly determine the intention of the user and generates the resulting response signal to transmit the generated signal to the display apparatus. Accordingly, the display apparatus can display a channel requested by the user based on the response signal. However, when the spoken voice is unclearly recognized or when user's interaction is required, providing the simple function in the related art is not sufficient. If the user speaks "Tell me a recording method.", there is a problem in that a matter to be checked or an operation of the user for recording cannot be instructed to the user for each step and only the recording method is just displayed. Further, when a spoken voice such as "The screen is abnormal" is recognized, hardware performance of the display apparatus is not checked and there may be no response to the spoken voice. That is, when an executable response signal is not generated from the spoken voice, there is a problem in that an incorrect operation is performed or there is no response. In addition, although accuracy of a response to a complicated spoken voice is improved by using the server, there is also a problem in that the response signal is generated without reflecting characteristics of respective display apparatuses. Exemplary embodiments overcome the above disadvantages and other disadvantages not described above. Also, the embodiments are not required to overcome the disadvantages described above, and an exemplary embodiment may not overcome any of the problems described above. The embodiments provide a voice recognition system, a server, a display apparatus, and control methods thereof which generate a response signal to a spoken voice of a user based on a prestored manual and process an operation corresponding thereto. According to an aspect, a voice recognition system includes: a server storing a plurality of manuals and a display apparatus transmitting, when a spoken voice of a user is recognized, characteristic information and a spoken voice signal corresponding to the spoken voice to the server, the characteristic information is characteristic information of the display apparatus, the server transmits a response signal to the spoken voice signal to the display apparatus based on a manual corresponding to the characteristic information among the plurality of manuals, and the display apparatus processes an operation corresponding to the received response signal. The display apparatus may display, when the response signal includes a guide message or a diagnosis result, the guide message or the diagnosis result. The display apparatus may process, when the response signal is a control signal to process an operation required for diagnosing the display apparatus, an operation according to the control signal and transmit a state of the operation to the server, and the server may diagnose the display apparatus based on the operational state and transmit a result of the diagnosis to the display apparatus. According to another aspect, a server includes: at least one processor communicatable with a plurality of devices; and a storage unit storing a plurality of manuals, and at least one processor receives a spoken voice signal corresponding to a spoken voice recognized by one device among the plurality of devices and characteristic information of the device, generates a response signal to the spoken voice signal based on a manual corresponding to the characteristic information among the plurality of manuals of the storage u