US-12619348-B2 - Interaction method of a terminal device for a user with visual impairment

Abstract

An interaction method and a terminal device. The terminal device receives a first location signal through a screen. An interface displayed on the screen includes an operation area and a display area, the operation area includes a first target area, and a page displayed in the display area includes a first target function. The terminal device determines, based on the first location signal, that a location of a touch point is in the first target area, and then the terminal device provides a first feedback used to introduce the first target function.

Inventors

• Ke Sun
• Jie Xu
• Jiayu Long

Assignees

• HUAWEI TECHNOLOGIES CO., LTD.

Dates

Publication Date

20260505

Application Date

20211011

Priority Date

20201031

Claims (20)

1. 1 . An interaction method comprising: receiving, by a terminal device, a first location signal through a screen, wherein an interface displayed on the screen comprises an operation area and a display area, the first location signal is used to indicate a location of a touch point between a finger of a user and the operation area, the operation area comprises a first target area, and a page displayed in the display area comprises a first target function; determining, by the terminal device, an instruction of the user when the terminal device broadcasts the first target function in a voice broadcast manner, the instruction of the user representing a user contact within the first target area; binding the first target area to the first target function based on the instruction of the user; determining, by the terminal device and based on the first location signal, that the location of the touch point is in the first target area; and providing, by the terminal device, a first feedback, wherein the first feedback is used to introduce the first target function, wherein the first target area is bound to the first target function by the terminal device based on the instruction of the user by: traversing, by the terminal device in the voice broadcast manner, all functions displayed in the display area; indicating, by the terminal device, a selection success by a voice indication or a vibration feedback in response to touching, by the finger of the user, any point in the display area when the terminal device broadcasts a respective target function that a user wants to bind to a respective first tarte area of a plurality of first target areas in the operation area that are not bound to any target function; and binding the respective target function to the respective first target area in response to releasing the finger after moving it to the respective first target area without leaving the screen.
2. 2 . The interaction method according to claim 1 , wherein the method further comprises: receiving, by the terminal device, a first instruction through the screen; and enabling, by the terminal device, the first target function based on the first instruction.
3. 3 . The interaction method according to claim 2 , wherein the first instruction comprises touching and holding the first target area, double tapping the first target area, or pressing the first target area.
4. 4 . The interaction method according to claim 1 , wherein the operation area further comprises a second target area, and the method further comprises: determining, by the terminal device based on the first location signal, that the location of the touch point is in the second target area; and providing, by the terminal device, a second feedback, wherein the second feedback is used to introduce a second target function, and the page displayed in the display area does not comprise the second target function.
5. 5 . The interaction method according to claim 1 , wherein the method further comprises: receiving, by the terminal device, a second instruction through the screen; and enabling, by the terminal device, a second target function based on the second instruction.
6. 6 . The interaction method according to claim 5 , wherein the second instruction comprises touching and holding a second target area, double tapping the second target area, or pressing the second target area.
7. 7 . The interaction method according to claim 1 , wherein the first feedback comprises a sound feedback or a vibration feedback.
8. 8 . The interaction method according to claim 4 , wherein the second feedback comprises a sound feedback or a vibration feedback.
9. 9 . The interaction method according to claim 1 , wherein the operation area comprises at least one of an upper top edge, a left side edge, a lower bottom edge, or a right side edge of the interface displayed on the screen.
10. 10 . A terminal device comprising: a screen; a processor; and a memory; wherein the processor is coupled to the memory, the memory is configured to store a program or instructions, and the processor is configured to execute the program or the instructions in the memory, which, upon execution of the program or the instructions causes the terminal device to: receive a first location signal through the screen, wherein an interface displayed on the screen comprises an operation area and a display area, the first location signal is used to indicate a location of a touch point between a finger of a user and the operation area, the operation area comprises a first target area, and a page displayed in the display area comprises a first target function; determine an instruction of the user when the terminal device broadcasts the first target function in a voice broadcast manner, the instruction of the user representing a user contact within the first target area; bind the first target area to the first target function based on the instruction of the user; determine, based on the first location signal, that the location of the touch point is in the first target area; and provide a first feedback, wherein the first feedback is used to introduce the first target function, wherein the first target area is bound to the first target function by the terminal device based on the instruction of the user by: traversing, in the voice broadcast manner, all functions displayed in the display area; indicating a selection success by a voice indication or a vibration feedback in response to touching, by the finger of the user, any point in the display area when the terminal device broadcasts a respective target function that a user wants to bind to a respective first tarte area of a plurality of first target areas in the operation area that are not bound to any target function; and binding the respective target function to the respective first target area in response to releasing the finger after moving it to the respective first target area without leaving the screen.
11. 11 . The terminal device according to claim 10 , wherein the terminal device is further caused to: receive a first instruction through the screen; and enable the first target function based on the first instruction.
12. 12 . The terminal device according to claim 11 , wherein the first instruction comprises touching and holding the first target area, double tapping the first target area, or pressing the first target area.
13. 13 . The terminal device according to claim 10 , wherein the operation area further comprises a second target area, and the terminal device is further caused to: determine, based on the first location signal, that the location of the touch point is in the second target area; and provide a second feedback, wherein the second feedback is used to introduce a second target function, and the page displayed in the display area does not comprise the second target function.
14. 14 . The terminal device according to claim 10 , wherein the terminal device is further caused to: receive a second instruction through the screen; and enable a second target function based on the second instruction.
15. 15 . The terminal device according to claim 14 , wherein the second instruction comprises touching and holding a second target area, double tapping the second target area, or pressing the second target area.
16. 16 . The terminal device according to claim 10 , wherein the first feedback comprises a sound feedback or a vibration feedback.
17. 17 . The terminal device according to claim 13 , wherein the second feedback comprises a sound feedback or a vibration feedback.
18. 18 . The terminal device according to claim 10 , wherein the operation area comprises at least one of an upper top edge, a left side edge, a lower bottom edge, or a right side edge of the interface displayed on the screen.
19. 19 . A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor of a terminal device, cause the terminal device to perform a method, the method comprising: receiving a first location signal through a screen, wherein an interface displayed on the screen comprises an operation area and a display area, the first location signal is used to indicate a location of a touch point between a finger of a user and the operation area, the operation area comprises a first target area, and a page displayed in the display area comprises a first target function; determining an instruction of the user when the terminal device broadcasts the first target function in a voice broadcast manner, the instruction of the user representing a user contact within the first target area; binding the first target area to the first target function based on the instruction of the user; determining, based on the first location signal, that the location of the touch point is in the first target area; and providing a first feedback, wherein the first feedback is used to introduce the first target function, wherein the first target area is bound to the first target function by the terminal device based on the instruction of the user by: traversing, in the voice broadcast manner, all functions displayed in the display area; indicating a selection success by a voice indication or a vibration feedback in response to touching, by the finger of the user, any point in the display area when the terminal device broadcasts a respective target function that a user wants to bind to a respective first tarte area of a plurality of first target areas in the operation area that are not bound to any target function; and binding the respective target function to the respective first target area in response to releasing the finger after moving it to the respective first target area without leaving the screen.
20. 20 . The non-transitory machine-readable medium according to claim 19 , wherein the method further comprises: receiving a first instruction through the screen; and enabling the first target function based on the first instruction.

Description

This application is a national stage of International Application No. PCT/CN2021/122977, filed on Oct. 11, 2021, which claims priority to Chinese Patent Application No. 202011196093.1, filed. Both of the aforementioned applications are incorporated herein by reference in their entireties. TECHNICAL FIELD Embodiments of this application relate to the communication field, and in particular, to an interaction method and a terminal device. BACKGROUND Different from a common user with sound vision, a user with visual impairment cannot see content displayed on a screen, and cannot accurately tap a location on the screen. Therefore, currently, the user with visual impairment mainly relies on a screen reading service to operate a mobile phone. In a screen reading process, an area that is being read by a terminal device is referred to as a focus. When the user with visual impairment needs to browse content on a page, the focus can traverse all content and functions on the page displayed on the screen. When the focus moves to an interactive object, the device may read a text label of the object. For example, a page of a mobile payment website includes a plurality of functions. When the focus moves to a “payment” button on a page displayed on a screen, if the function is a function desired by the user with visual impairment, a specified operation may be performed at any location on the screen to select the button, so as to implement a function corresponding to the button. If the function is not the one that the user wants, the focus continues to be slid to move to a next button until the user with visual impairment selects a desired function or the focus traverses the entire page. An existing website page usually has various content, and all functions on the page are traversed to select a function that the user with visual impairment wants to execute. Such an interaction manner has low efficiency. SUMMARY Embodiments of this application provide an interaction method and a terminal device. The terminal device determines, based on a first location signal, that a location of a touch point is in a first target area, and then the terminal device provides a first feedback used to introduce a first target function. A user may learn, in this manner, of a function included in a display area, thereby improving efficiency of interaction between the user and the terminal device. A first aspect of embodiments of this application provides an interaction method. A terminal device receives a first location signal through a screen. An interface displayed on the screen includes an operation area and a display area, the first location signal is used to indicate a location of a touch point between a finger of a user and the operation area, the operation area includes a first target area, and a page displayed in the display area includes a first target function. The terminal device determines, based on the first location signal, that the location of the touch point is in the first target area. The terminal device provides a first feedback. The first feedback is used to introduce the first target function. In this application, the terminal device receives the first location signal through the screen. The interface displayed on the screen includes the operation area and the display area, the operation area includes the first target area, and the page displayed in the display area includes the first target function. The terminal device determines, based on the first location signal, that the location of the touch point is in the first target area, and then the terminal device provides the first feedback used to introduce the first target function. The user may learn, in this manner, of a function included in the display area, thereby improving efficiency of interaction between the user and the terminal device. In a possible implementation of the first aspect, the method further includes: The terminal device receives a first instruction through the screen. The terminal device enables the first target function based on the first instruction. In this possible implementation, different first target functions may be enabled by using first instructions in various forms. For example, if the finger of the user is lifted from the first target area, a tapping operation of an object bound to the current first target area is performed, or the first target function bound to the first target area is performed. If the finger of the user touches and holds, a touching and holding operation of the object bound to the current first target area is performed. If the finger of the user slides towards the inside of the screen in the first target area, a cancellation operation is performed. If the finger of the user presses in the first target area, a voice label of the object or function bound to the first target area is broadcast. There may also be a plurality of other implementations. The terminal device enables the first target function based on the first instr