CN-119960636-B - Man-machine interaction method and electronic equipment

CN119960636BCN 119960636 BCN119960636 BCN 119960636BCN-119960636-B

Abstract

The embodiment of the application provides a man-machine interaction method, which comprises the steps of responding to an operation of selecting an interaction area on a first interface of electronic equipment by a user, acquiring first interaction content associated with the interaction area by the electronic equipment, acquiring a first voice instruction by the electronic equipment, and executing a first operation by the electronic equipment according to the first voice instruction and the first interaction content. By the method, the interactive content can be selected on the display screen of the electronic equipment, and based on the application related to the interactive content on the electronic equipment, the convenient voice interaction between the electronic equipment and the user based on the interactive content is realized, and a man-machine interaction mode convenient to operate is provided for the user.

Inventors

HU JING
XU JIE
LIU QI
XU NUO
QIN HAIFENG

Assignees

华为技术有限公司

Dates

Publication Date: 20260508
Application Date: 20240726

Claims (10)

1. A method of human-machine interaction, the method comprising: Responding to the operation of selecting an interaction area on a first interface of electronic equipment by a user, and acquiring first interaction content associated with the interaction area by the electronic equipment; After the operation of selecting the interaction area occurs, the electronic equipment enters a first state; The voice instruction acquired by the electronic equipment based on voice detection in the first state is not independently used for determining the subsequent operation of the electronic equipment, and is used for carrying out multi-mode fusion with the first interactive content to determine the subsequent operation; in the first state, the electronic equipment acquires a first voice instruction based on voice detection; The electronic equipment executes a first operation according to the first voice instruction and the first interactive content, wherein the first operation is used for providing recommended interactive service, and the recommended interactive service has correlation with the first interactive content; After the operation of selecting the interaction area occurs, the electronic device enters a first state, including: the electronic device is triggered to enter the first state in response to the operation of selecting the interaction region, or Responding to the operation of selecting the interaction area, triggering and displaying a second interface by the electronic equipment, wherein the second interface comprises a first control, and the first control is used for triggering the electronic equipment to enter the first state; responding to the operation of a user on the first control, and triggering the electronic equipment to enter the first state; Wherein the recommended interaction service has a correlation with the first interaction content, and the method comprises the following steps: When the first interactive content comprises pictures, the recommended interactive service comprises one or more of picture recognition service, sharing service and storage service, or When the first interactive content comprises a chat log, the recommended interactive service comprises one or more of a replication service, a sharing service, a saving service, an editing service, or When the first interactive content comprises text content, the recommended interactive service comprises one or more of a copying service, a reading service, a saving service, an editing service, or When the first interactive contents include account information, the recommended interactive service includes a recording service and/or a transfer service, or When the first interactive content comprises website information, the recommended interactive service comprises one or more of recording service, sharing service, opening website service, and viewing website abstract service, or When the first interactive content comprises address information, the recommended interactive service comprises one or more of a distance checking service, a navigation service and a taxi taking service, or When the first interactive content includes flight information, the recommended interactive service includes one or more of a reservation ticket service, a flight inquiry service, an add schedule service, or When the first interactive content includes the information of the time of the doctor, the recommended interactive service includes adding a schedule service and/or a recording service, or When the first interactive contents include tables, the recommended interactive service includes one or more of adding a save service, a copy service, and a share service.
2. The method according to claim 1, wherein the method further comprises: the electronic equipment displays a third interface, wherein the third interface comprises a first recommended interaction service; In response to detecting a user clicking on a first recommended interaction service, the electronic device executes the first recommended interaction service, or The electronic device executing the first recommended interactive service in response to detecting a second voice instruction of the user, the second voice instruction being for indicating selection of the first recommended interactive service, or In response to detecting a user dragging the first interactive content to the first recommended interactive service, the electronic device executes the first recommended interactive service, one or more recommended interactive services including the first recommended interactive service.
3. The method of claim 1, wherein the electronic device performs a first operation according to the first voice instruction and the first interactive content, comprising: and the electronic equipment executes the first operation according to the first voice instruction, the first interactive content and the first display content, wherein the first display content is the content except the first interactive content on the first interface.
4. The method according to claim 1, wherein the method further comprises: and the electronic equipment displays a fourth interface, wherein the fourth interface is an interface for executing the recommended interaction service.
5. The method according to claim 1, wherein the method further comprises: responding to the electronic equipment to finish the first operation, triggering the electronic equipment to detect a third voice instruction for carrying out multi-mode fusion with the first interactive content again; and the electronic equipment executes a second objective operation according to the result of the first operation, the third voice instruction and the first interactive content.
6. The method of claim 1, wherein the electronic device obtaining the first interactive content associated with the interactive region in response to a user selecting the interactive region on a first interface of the electronic device comprises: the electronic device obtains the first interactive content in response to detecting the operation of the user to select the interactive region on the first interface, or The electronic device obtains the first interactive content in response to detecting the operation of the user to select the interactive region on the first interface, or In response to detecting the operation of the user to press the interaction area on the first interface for a long time or double-click the interaction area, the electronic equipment acquires the first interaction content or And responding to the detection of the operation of dragging the interaction area on the first interface by a user, and acquiring the first interaction content by the electronic equipment.
7. An electronic device, comprising: One or more processors; One or more memories; And one or more computer programs, wherein the one or more computer programs are stored in the one or more memories, the one or more computer programs comprising instructions, which when executed by the one or more processors, cause the electronic device to perform the method of any of claims 1-6.
8. A computer readable storage medium, characterized in that the storage medium has stored therein a program or instructions which, when executed, implement the method of any of claims 1 to 6.
9. A chip having instructions stored therein which, when executed, implement the method of any one of claims 1 to 6.
10. A computer program product, characterized in that it has stored therein a program or instructions which, when executed, implement the method according to any of claims 1 to 6.

Description

Man-machine interaction method and electronic equipment The present application is a divisional application, the application number of the original application is 202411025317.0, the original application date is 2024, 7 and 26, and the whole content of the original application is incorporated by reference. Technical Field The embodiment of the application relates to the field of man-machine interaction, and in particular relates to a man-machine interaction method and electronic equipment. Background With the increasing popularity of intelligent devices and the increasing richness of functions of intelligent devices, people are increasingly dependent on intelligent devices in life and work, and users need to interact with content on a screen in more and more scenes, so that the need of people for convenience of interaction with the screen content of the intelligent devices is higher and higher. Disclosure of Invention The application provides a man-machine interaction method and electronic equipment, through the method and the electronic equipment, interaction content can be selected on a display screen of the electronic equipment, and based on application related to the interaction content on the electronic equipment, convenient voice interaction between the electronic equipment and a user based on the interaction content is realized, so that a man-machine interaction mode convenient to operate is provided for the user. In a first aspect, a human-computer interaction method is provided, and the method comprises the steps that in response to operation of selecting an interaction area on a first interface of electronic equipment by a user, the electronic equipment obtains first interaction content associated with the interaction area, the electronic equipment obtains a first voice instruction, and the electronic equipment executes first operation according to the first voice instruction and the first interaction content. According to the embodiment of the application, the interactive content can be selected on the display screen of the electronic equipment, and based on the application related to the interactive content on the electronic equipment, the convenient voice interaction between the electronic equipment and the user based on the interactive content is realized, so that a man-machine interaction mode convenient to operate is provided for the user. In addition, in the method provided by the embodiment of the application, before the target interaction object is selected, the screen of the electronic equipment is not required to be switched to the state to be selected, and the selection of the interaction content is directly performed based on the current display screen of the electronic equipment, so that the convenience of interaction between the user and the electronic equipment is further improved. In addition, the electronic equipment can adaptively adjust the selection range and determine the interactive content according to the content in the selection range of the user, so that the accurate selection of the interactive content can be realized, and the user does not need to manually adjust the interactive area frequently. With reference to the first aspect, in a possible implementation manner, the electronic device acquiring the first voice instruction includes triggering the electronic device to detect the first voice instruction for multi-modal fusion with the first interactive content in response to the electronic device acquiring the first interactive content. It can be understood that, in the embodiment of the present application, after the interactive content is selected, the state of detecting the first voice command, which is triggered by the electronic device, is different from the state of detecting the voice command by the electronic device triggered under the condition that the interactive content is not selected, specifically, after the interactive content is selected, the state of detecting the first voice command, which is triggered by the electronic device, is not independently used for determining what operation is performed subsequently, but is determined what operation is performed subsequently based on multi-modal fusion with the selected interactive content. In the embodiment of the application, after the user selects the interactive content on the screen of the electronic equipment, the electronic equipment enters a state of detecting the voice command related to the interactive content, and the user does not need to additionally execute operation to trigger the electronic equipment to detect the voice command, so that the convenience of voice interaction between the user and the electronic equipment based on the interactive content is further improved. With reference to the first aspect, in a possible implementation manner, the electronic device acquiring the first voice instruction includes responding to the electronic device acquiring the first interactive content, and d