CN-121979436-A - Method for operating electronic device, and computer-readable storage medium

Abstract

The embodiment of the application provides an operation method of electronic equipment, the electronic equipment and a computer readable storage medium, wherein in the operation method of the electronic equipment, the electronic equipment detects human eye gaze point tracking performed by a user to obtain the gaze point position of the user, and then the electronic equipment can execute the operation corresponding to the operation of the user according to the gaze point position of the user and the obtained operation of the user, so that the electronic equipment can perform corresponding operation according to the content identification result of the gaze area of the user and the operation of the user.

Inventors

• XIAO DONG

Assignees

• 华为终端有限公司

Dates

Publication Date

20260505

Application Date

20241031

Claims (19)

1. 1. A method of operating an electronic device, comprising: the electronic equipment detects the eye gaze point of a user to obtain the gaze point position of the user; And executing an operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user.
2. 2. The method of claim 1, wherein the detecting the gaze point of the user's eye, prior to obtaining the gaze point location of the user, further comprises: The method comprises the steps of obtaining operation of a user, wherein the operation of the user comprises triggering operation of the user on a touch pen, the touch pen is connected with the electronic equipment, and the operation of the user is sent to the electronic equipment after the touch pen detects the operation.
3. 3. The method of claim 2, wherein the electronic device detecting a gaze point of a user's human eye, obtaining a gaze point location of the user comprises: And responding to the triggering operation of the user on the touch pen, detecting the eye gaze point of the user by the electronic equipment, and obtaining the gaze point position of the user.
4. 4. The method of claim 2, wherein the user-activated operation of the stylus comprises a user double-click operation of a body of the stylus; The executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises: According to the gaze point position of the user, obtaining an icon gazed at by the user in a current display interface of the electronic equipment, wherein the current display interface comprises a display interface of a target application currently operated by the electronic equipment, and the target application comprises an image-text editing application; And when the distance between the icon watched by the user and the gazing point position is smaller than or equal to a preset distance threshold value, transmitting the function corresponding to the icon watched by the user to the touch pen so that the touch pen can be switched from the current function to the function corresponding to the icon watched by the user.
5. 5. The method of claim 2, wherein the user-initiated operation of the stylus comprises a user-actuated operation of a body of the stylus; the executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises the following steps: According to the gaze point position of the user, acquiring an icon gazed by the user in a current display interface of the electronic equipment; And when the distance between the icon watched by the user and the gazing point position is smaller than or equal to a preset distance threshold value, displaying an interface corresponding to the icon watched by the user according to the light pinching operation of the stylus body by the user.
6. 6. The method of claim 2, wherein the user-initiated operation of the stylus comprises a user-actuated operation of a body of the stylus; the executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises the following steps: acquiring a page watched by the user in a current display interface of the electronic equipment according to the gaze point position of the user, wherein the current display interface of the electronic equipment is a video browsing interface or a moving picture browsing interface; and playing the content corresponding to the page in the page watched by the user according to the operation of the user on the stylus body of the stylus so as to preview the content corresponding to the page by the user.
7. 7. The method of claim 2, wherein the user-initiated operation of the stylus comprises a user sliding operation on a stylus body; the executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises the following steps: acquiring an interface currently watched by the user according to the watching point position of the user; and according to the sliding operation of the user on the stylus body, the interface currently watched by the user is displayed in a sliding mode.
8. 8. The method of claim 2, wherein the user-initiated operation of the stylus comprises a user sliding operation on a stylus body; the executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises the following steps: According to the gaze point position of the user, acquiring an icon gazed by the user in a current display interface of the electronic equipment; And when the distance between the icon watched by the user and the gazing point position is smaller than or equal to a preset distance threshold value, performing progress type adjustment on the icon watched by the user according to the sliding operation performed by the user on the stylus body of the touch control pen.
9. 9. The method according to claim 1, wherein before the operation corresponding to the operation of the user is performed according to the gaze point position of the user and the acquired operation of the user, further comprising: and acquiring the operation of the user, wherein the operation of the user comprises gesture operation of the user.
10. 10. The method according to claim 9, wherein the performing an operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises: according to the gaze point position of the user, acquiring a message popup window watched by the user in a current display interface of the electronic equipment; And displaying the message popup watched by the user according to the first gesture operation of the user after determining that the message popup watched by the user is in the selected state, or hiding the message popup watched by the user according to the second gesture operation of the user after determining that the message popup watched by the user is in the selected state.
11. 11. The method of claim 10, wherein the determining that the message popup at which the user gazes is in the selected state comprises: detecting the time length of the user gazing at the message popup window; and when the duration of the user gazing at the message popup window is greater than or equal to a preset duration threshold value, determining that the message popup window gazed at by the user is in a selected state.
12. 12. The method of claim 10, wherein the first gesture operation is a sliding of the user's finger up and down on the screen of the electronic device and the second gesture operation is a sliding of the user's finger left and right on the screen of the electronic device.
13. 13. The method according to claim 9, wherein the performing an operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises: According to the gaze point position of the user, acquiring the content gazed by the user in the current display interface of the electronic equipment; And carrying out corresponding operation on the content watched by the user according to the gesture operation of the user, wherein the gesture operation of the user comprises gesture operation carried out by the user in the perception range of the camera of the electronic equipment.
14. 14. The method of claim 13, wherein the user gesture operation comprises a two-finger pinch or a two-finger stretch operation; the corresponding operation on the content watched by the user according to the gesture operation of the user comprises the following steps: And when the gesture operation of the user is a double-finger stretching operation, the content watched by the user is amplified.
15. 15. The method of claim 13, wherein the user's gesture operation comprises a double-pointing up-swipe or a double-pointing down-swipe; the corresponding operation on the content watched by the user according to the gesture operation of the user comprises the following steps: and when the gesture operation of the user is bidirectional sliding, the content watched by the user is displayed in a downward sliding mode.
16. 16. The method of claim 13, wherein the gesture operation of the user comprises a rotation gesture; the corresponding operation on the content watched by the user according to the gesture operation of the user comprises the following steps: and according to the rotation direction of the gesture of the user, performing corresponding rotation operation on the content watched by the user.
17. 17. The method of any of claims 1-16, wherein the electronic device comprises one of at least two electronic devices connected to each other; the executing the operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user comprises the following steps: And when the electronic equipment determines that the gaze point position of the user is in the screen range of the electronic equipment, executing an operation corresponding to the operation of the user according to the gaze point position of the user and the acquired operation of the user.
18. 18. An electronic device, comprising: The apparatus of any of claims 1-17, wherein the one or more computer programs are stored in the memory, the one or more computer programs comprising instructions that, when executed by the electronic device, cause the electronic device to perform the method of any of claims 1-17.
19. 19. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program which, when run on a computer, causes the computer to perform the method according to any of claims 1-17.

Description

Method for operating electronic device, and computer-readable storage medium Technical Field The embodiment of the application relates to the technical field of intelligent terminals, in particular to an operation method of electronic equipment, the electronic equipment and a computer readable storage medium. Background The stylus body interaction is a trend of stylus development due to the fact that the operation convenience of the stylus body interaction is more and more increasing, and the stylus body interaction currently mainly comprises two modes, namely (1) function switching through double-click of the stylus body, and (2) secondary menu calling-out, namely secondary menu bar calling-out through pinching of the stylus body. However, the function is switched by double clicking the pen body, which two functions are required to be switched in advance, the operation is complex, the set functions can be switched only, the functions are single, and the two-level menu bar under one-level tool can be called only by pinching the pen body, and the functions are single. In addition, the mobile phone has larger and larger screen, including the appearance of folding screen and other forms, which causes the operation of a user with one hand to be inconvenient and quick, and the user can only perform the page turning operation up and down at present when performing remote space-free gesture operation. Disclosure of Invention The embodiment of the application provides an operation method of electronic equipment, the electronic equipment and a computer readable storage medium, so as to realize corresponding operation of the electronic equipment according to a content identification result of a user gazing area and in combination with operation of the user. In a first aspect, an embodiment of the present application provides an operation method of an electronic device, where the electronic device detects a gaze point of a human eye of a user to obtain a gaze point position of the user, and executes an operation corresponding to the operation of the user according to the gaze point position of the user and the obtained operation of the user. In one possible implementation manner, before the eye gaze point of the user is detected and the gaze point position of the user is obtained, the method further comprises the step of obtaining user operation, wherein the user operation comprises triggering operation of a touch pen by the user, the touch pen is connected with the electronic equipment, and the user operation is sent to the electronic equipment after the touch pen detects the gaze point. In one possible implementation manner, the electronic device detects a human eye gaze point of a user, and obtaining the gaze point position of the user includes, in response to a triggering operation of the stylus by the user, detecting the human eye gaze point of the user by the electronic device, and obtaining the gaze point position of the user. In one possible implementation manner, the triggering operation of the user on the touch pen comprises double-click operation of the user on the touch pen body, and the operation corresponding to the operation of the user is performed according to the gaze point position of the user and the obtained operation of the user, wherein the obtaining of the icon watched by the user in the current display interface of the electronic device according to the gaze point position of the user comprises the display interface of a target application currently operated by the electronic device, the target application comprises an image-text editing application, and when the distance between the icon watched by the user and the gaze point position is smaller than or equal to a preset distance threshold, the function corresponding to the icon watched by the user is sent to the touch pen so that the touch pen can be switched from the current function to the function corresponding to the icon watched by the user. In one possible implementation manner, the triggering operation of the user on the touch pen comprises a light-pinching operation of the user on the touch pen body, and the operation corresponding to the operation of the user is performed according to the gaze point position of the user and the obtained operation of the user, wherein the operation comprises the steps of obtaining an icon watched by the user in a current display interface of the electronic device according to the gaze point position of the user, and displaying the interface corresponding to the icon watched by the user according to the light-pinching operation of the user on the touch pen body when the distance between the icon watched by the user and the gaze point position is smaller than or equal to a preset distance threshold. In one possible implementation manner, the triggering operation of the user on the touch pen comprises a light-pinching operation of the user on the touch pen body, and the operation corresponding to the op