CN-122018741-A - Cursor positioning method and electronic equipment

CN122018741ACN 122018741 ACN122018741 ACN 122018741ACN-122018741-A

Abstract

The application discloses a cursor positioning method and electronic equipment, wherein the method comprises the following steps of tracking the sight of a user; the method comprises the steps of responding to the condition that the user sight meets the change condition, determining position point information of a gaze point of the user sight in a three-dimensional scene output by a naked eye three-dimensional display device, roughly positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, and positioning and adjusting the initial position point of the cursor based on input operation of the user to obtain a target position point of the cursor.

Inventors

WANG YUNTAO
TIAN XINGJIAN
SHI YUANCHUN
ZHANG ZHENZHOU

Assignees

联想(北京)有限公司
清华大学

Dates

Publication Date: 20260512
Application Date: 20260130

Claims (10)

1. A cursor positioning method, comprising: tracking a user's gaze; Determining position point information of a gaze point of the user gaze in a three-dimensional scene output by a naked eye three-dimensional display device in response to the user gaze meeting a change condition; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor; and positioning and adjusting the initial position point of the cursor based on the input operation of the user to obtain the target position point of the cursor.
2. The cursor positioning method according to claim 1, wherein the determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by the naked eye three-dimensional display device includes: determining a three-dimensional coordinate range of a gaze point of the user's gaze in a three-dimensional scene output by a naked eye three-dimensional display device; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, wherein the initial position point comprises; The three-dimensional coordinate range is taken as a rough positioning area of a cursor, the cursor in the three-dimensional scene is moved into the rough positioning area, and an initial position point of the cursor is obtained; Or alternatively The determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by the naked eye three-dimensional display device includes: Determining target three-dimensional coordinates of a gaze point of a user's gaze in a three-dimensional scene output by the naked eye three-dimensional display device; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, wherein the coarse positioning comprises the following steps: and moving a cursor in the three-dimensional scene to a position point corresponding to the target three-dimensional coordinate to obtain an initial position point of the cursor.
3. The cursor positioning method according to claim 2, wherein the positioning adjustment of the initial position point of the cursor based on the input operation of the user includes at least one of: adjusting the position of the cursor based on the input operation and the initial position point of the cursor; Adjusting the position of the cursor in the rough positioning area based on the input operation and the initial position point of the cursor; and adjusting the position of the cursor in the setting range of the target three-dimensional coordinate based on the input operation and the initial position point of the cursor.
4. The cursor positioning method according to claim 1, the tracking user's line of sight comprising: tracking a user's line of sight while the electronic device is in a first positioning state; Detecting that the operation action of the user meets a switching condition, and switching the positioning state of the electronic equipment from a first positioning state to a second positioning state; the positioning adjustment of the initial position point of the cursor based on the input operation of the user comprises the following steps: and in the second positioning state of the electronic equipment, positioning and adjusting the initial position point of the cursor based on the input operation of the user.
5. The cursor positioning method according to claim 4, wherein the operation action satisfies a switching condition, and the method comprises the steps that the operation amplitude of the operation action is larger than a set threshold value and/or the duration of the operation action exceeds a duration threshold value; The cursor positioning method further comprises the step of switching the positioning state of the electronic equipment from the second positioning state to the first positioning state if the input operation of the user is not detected within a continuous appointed time period when the electronic equipment is in the second positioning state.
6. The cursor positioning method according to claim 2, wherein the determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by the naked eye three-dimensional display device includes: determining two-dimensional coordinates of a gaze point of a user's gaze on a naked eye three-dimensional display device; Determining a target three-dimensional mapping function based on the three-dimensional mapping function corresponding to at least one depth coordinate interval; And determining the position point information of the gaze point of the user's vision in the three-dimensional scene output by the naked eye three-dimensional display device by utilizing a target three-dimensional mapping function based on the two-dimensional coordinates.
7. The cursor positioning method according to claim 6, wherein the determining the target three-dimensional mapping function based on the three-dimensional mapping function corresponding to the at least one depth coordinate interval includes: Determining a target three-dimensional mapping function serving as an available mapping function currently from three-dimensional mapping functions corresponding to at least one depth coordinate interval; the cursor positioning method further comprises the following steps: If the depth value in the three-dimensional coordinate of the target or the depth range in the three-dimensional coordinate range exceeds a target depth coordinate interval corresponding to the three-dimensional mapping function of the target, determining a target interval boundary closest to the three-dimensional coordinate or the three-dimensional coordinate range in the target depth coordinate interval, and adding one to the out-of-limit frequency of the target interval boundary; If the out-of-range frequency of the target interval boundary exceeds a set frequency threshold, determining a candidate depth coordinate interval which is outside the target depth coordinate interval and is close to the target interval boundary; and determining the three-dimensional mapping function corresponding to the candidate depth coordinate interval as a current available mapping function.
8. The cursor positioning method of claim 6, further comprising: Calibrating the position point information of the gaze point by using a calibration function to obtain calibrated position point information, wherein the calibration function is a function fitted based on at least one calibration coordinate pair, and the calibration coordinate pair comprises a historical three-dimensional coordinate corresponding to the historical gaze point of the user line of sight and a cursor three-dimensional coordinate corresponding to the historical three-dimensional coordinate, and the cursor three-dimensional coordinate is a historical target position point of the cursor corresponding to the historical gaze point; The cursor positioning method further comprises the following steps: Responding to the existence of a target event at a target position point of the cursor, and obtaining at least one calibration coordinate pair, wherein the target event is used for representing that a user confirms that the positioning of the target position point of the cursor is accurate; And fitting a calibration function for converting the historical three-dimensional coordinates in the calibration coordinate pair into the three-dimensional coordinates of the cursor based on at least one calibration coordinate pair obtained in the latest set time period.
9. The cursor positioning method according to claim 8, the obtaining at least one calibration coordinate pair in response to a target event occurring at a target position point of the cursor, comprising: A first coordinate sequence and a second coordinate sequence are obtained in response to the existence of a target event at a target position point of the cursor, wherein the first coordinate sequence comprises at least one three-dimensional coordinate of a gaze point, and the second coordinate sequence comprises cursor three-dimensional coordinates respectively corresponding to the at least one three-dimensional coordinate of the gaze point, wherein the at least one three-dimensional coordinate of the gaze point is the three-dimensional coordinate of at least one historical gaze point of the user's sight line in the three-dimensional scene in a target duration range corresponding to the current moment; determining the track similarity between a first coordinate track corresponding to the first coordinate sequence and a second coordinate track corresponding to the second coordinate sequence; Determining a track conversion function for converting the first coordinate track into a corresponding second coordinate track in response to the track similarity exceeding a first threshold; Converting the three-dimensional coordinate of the fixation point by using the track conversion function to obtain a reference three-dimensional coordinate corresponding to the three-dimensional coordinate of the fixation point; And if the distance between the reference three-dimensional coordinate corresponding to the three-dimensional coordinate of the point of regard and the cursor three-dimensional coordinate corresponding to the three-dimensional coordinate of the point of regard is smaller than a second threshold value, taking the three-dimensional coordinate of the point of regard as a historical three-dimensional coordinate, and forming a calibration coordinate pair with the cursor three-dimensional coordinate corresponding to the three-dimensional coordinate of the point of regard.
10. An electronic device comprises a naked eye three-dimensional display device, an acquisition device and a processor; the acquisition device is used for tracking the sight of a user; The processor is used for responding to the condition that the user sight meets the change condition, determining position point information of the gaze point of the user sight in a three-dimensional scene output by the naked eye three-dimensional display device, coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, and positioning and adjusting the initial position point of the cursor based on input operation of a user to obtain a target position point of the cursor.

Description

Cursor positioning method and electronic equipment Technical Field The present application relates to the field of display control technologies, and in particular, to a cursor positioning method and an electronic device. Background In the case of displaying a three-dimensional scene through a naked-eye three-dimensional display device, a user can directly view a three-dimensional stereoscopic image without wearing polarizers or other auxiliary equipment by the user. However, it is currently difficult to accurately determine the three-dimensional coordinate points to be located in the three-dimensional scene by means of a mouse. Disclosure of Invention In one aspect, the present application provides a cursor positioning method, including: tracking a user's gaze; Determining position point information of a gaze point of the user gaze in a three-dimensional scene output by a naked eye three-dimensional display device in response to the user gaze meeting a change condition; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor; and positioning and adjusting the initial position point of the cursor based on the input operation of the user to obtain the target position point of the cursor. In a possible implementation manner, the determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by the naked eye three-dimensional display device includes: determining a three-dimensional coordinate range of a gaze point of the user's gaze in a three-dimensional scene output by a naked eye three-dimensional display device; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, wherein the initial position point comprises; The three-dimensional coordinate range is taken as a rough positioning area of a cursor, the cursor in the three-dimensional scene is moved into the rough positioning area, and an initial position point of the cursor is obtained; Or alternatively The determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by the naked eye three-dimensional display device includes: Determining target three-dimensional coordinates of a gaze point of a user's gaze in a three-dimensional scene output by the naked eye three-dimensional display device; Coarsely positioning a cursor in the three-dimensional scene based on the position point information to obtain an initial position point of the cursor, wherein the coarse positioning comprises the following steps: and moving a cursor in the three-dimensional scene to a position point corresponding to the target three-dimensional coordinate to obtain an initial position point of the cursor. In yet another possible implementation manner, the positioning adjustment of the initial position point of the cursor based on the input operation of the user includes at least one of the following: adjusting the position of the cursor based on the input operation and the initial position point of the cursor; Adjusting the position of the cursor in the rough positioning area based on the input operation and the initial position point of the cursor; and adjusting the position of the cursor in the setting range of the target three-dimensional coordinate based on the input operation and the initial position point of the cursor. In yet another possible implementation, the tracking the user line of sight includes: tracking a user's line of sight while the electronic device is in a first positioning state; Detecting that the operation action of the user meets a switching condition, and switching the positioning state of the electronic equipment from a first positioning state to a second positioning state; the positioning adjustment of the initial position point of the cursor based on the input operation of the user comprises the following steps: and in the second positioning state of the electronic equipment, positioning and adjusting the initial position point of the cursor based on the input operation of the user. In a further possible implementation manner, the operation action meets a switching condition, including that the operation amplitude of the operation action is larger than a set threshold value and/or the duration of the operation action exceeds a duration threshold value; The cursor positioning method further comprises the step of switching the positioning state of the electronic equipment from the second positioning state to the first positioning state if the input operation of the user is not detected within a continuous appointed time period when the electronic equipment is in the second positioning state. In yet another possible implementation manner, the determining the position point information of the gaze point of the user's gaze in the three-dimensional scene output by