Search

CN-122018673-A - Picture adjustment method, device and equipment of head-mounted display equipment and storage medium

CN122018673ACN 122018673 ACN122018673 ACN 122018673ACN-122018673-A

Abstract

The embodiment of the invention provides a picture adjusting method, device and equipment of head-mounted display equipment and a storage medium, and belongs to the field of head-mounted display equipment. The method comprises the steps of obtaining a periocular electromyographic signal of a user wearing the head-mounted display device, identifying and processing the watching intention of the user based on the characteristic quantity of the periocular electromyographic signal to obtain a target watching intention of the user, and adjusting the display position of a virtual picture in the head-mounted display device according to the target watching intention. The embodiment of the invention can improve the accuracy, convenience and efficiency of the adjustment of the virtual picture display position in the head-mounted display equipment, lighten the operation burden of a user and improve the intelligent level of the head-mounted display equipment in the aspect of man-machine interaction.

Inventors

  • HU SHAOJIA

Assignees

  • 珠海莫界科技有限公司

Dates

Publication Date
20260512
Application Date
20251222

Claims (10)

  1. 1. A picture adjustment method of a head-mounted display device, comprising: acquiring periocular electromyographic signals of a user wearing the head-mounted display device; identifying the watching intention of the user based on the characteristic quantity of the periocular electromyographic signals to obtain the target watching intention of the user; and adjusting the display position of the virtual picture in the head-mounted display device according to the target viewing intention.
  2. 2. The screen adjustment method according to claim 1, wherein the identifying the viewing intention of the user based on the feature quantity of the periocular electromyographic signal to obtain the target viewing intention of the user includes: Acquiring a preset electromyographic signal characteristic quantity threshold value and a preset effective electromyographic delay; And judging the watching intention of the user according to the characteristic quantity, the electromyographic signal characteristic quantity threshold value and the effective electromyographic time delay to obtain the target watching intention.
  3. 3. The picture adjustment method according to claim 2, wherein the determining the viewing intention of the user according to the feature quantity, the electromyographic signal feature quantity threshold value, and the effective electromyographic delay to obtain the target viewing intention includes: Comparing the characteristic quantity with the electromyographic signal characteristic quantity threshold value; Determining a first duration for which the feature is greater than the electromyographic signal feature threshold, if the feature is greater than the electromyographic signal feature threshold, and determining that the target viewing intent of the user is close-range focusing, if the first duration is greater than the effective electromyographic delay; And determining a second duration in which the feature quantity is smaller than the electromyographic signal feature quantity threshold value in the case in which the feature quantity is smaller than the electromyographic signal feature quantity threshold value, and determining that the target viewing intention of the user is far relaxed in the case in which the second duration is larger than the effective electromyographic time delay.
  4. 4. The screen adjustment method according to claim 3, wherein adjusting the display position of the virtual screen in the head-mounted display device according to the target viewing intention includes: Performing adjustment parameter matching processing on the target viewing intention to obtain a requirement adjustment parameter of the target viewing intention; and adjusting the display position of the virtual picture according to the demand adjustment parameter.
  5. 5. The picture adjustment method according to claim 4, wherein adjusting the display position of the virtual picture according to the demand adjustment parameter includes: And adjusting the virtual picture to a display position meeting the demand adjustment parameters according to a preset step length.
  6. 6. The screen adjustment method according to claim 5, wherein in a case where the target viewing intention is close-range focusing, the demand adjustment parameter includes at least one of a first focal plane distance, a first imaging position, and a first size, and the adjusting the virtual screen to a display position satisfying the demand adjustment parameter includes at least one of: Performing reduction treatment on the current focal plane distance of the virtual picture until the current focal plane distance is reduced to the first focal plane distance; performing proximity adjustment processing on the current imaging position of the virtual picture until the current imaging position is close to the first imaging position; And increasing the current size of the virtual picture until the current size is increased to the first size, so as to adjust the display position of the virtual picture to display a zooming-in effect in the user visual field space.
  7. 7. The screen adjustment method according to claim 5, wherein in a case where the target viewing intention is far relaxed, the demand adjustment parameter includes at least one of a second focal plane distance, a second imaging position, and a second size, and the adjusting the virtual screen to a display position satisfying the demand adjustment parameter includes at least one of: performing adjustment processing on the current focal plane distance of the virtual picture until the current focal plane distance is adjusted to the second focal plane distance; performing distance adjustment processing on the current imaging position of the virtual picture until the current imaging position is adjusted to the second imaging position; And reducing the current size of the virtual picture until the current size is reduced to the second size, so as to adjust the display position of the virtual picture to display a remote adjusting effect in the user visual field space.
  8. 8. A picture adjustment apparatus of a head-mounted display device, comprising: The signal acquisition module is used for acquiring periocular electromyographic signals of a user wearing the head-mounted display device; The intention recognition module is used for recognizing the watching intention of the user based on the characteristic quantity of the periocular electromyographic signals to obtain the target watching intention of the user; and the position adjustment module is used for adjusting the display position of the virtual picture in the head-mounted display device according to the target viewing intention.
  9. 9. A head mounted display device comprising a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for enabling a connection communication between the processor and the memory, wherein the computer program, when executed by the processor, implements the steps of the picture adjustment method of a head mounted display device as claimed in any one of claims 1 to 7.
  10. 10. A storage medium for computer-readable storage, wherein the storage medium stores one or more programs executable by one or more processors to implement the steps of the method of picture adjustment of a head mounted display device of any of claims 1 to 7.

Description

Picture adjustment method, device and equipment of head-mounted display equipment and storage medium Technical Field The present invention relates to the field of head-mounted display devices, and in particular, to a method, an apparatus, a device, and a storage medium for adjusting a picture of a head-mounted display device. Background With the rapid development of augmented reality (Augmented Reality, AR) technology, AR devices have been widely used as a head-mounted display device in various fields of education and training, industrial assistance, medical treatment, entertainment, and the like. By superposing the virtual pictures in the field of view of the user, the head-mounted display device realizes virtual-real fusion immersive interaction experience. In order to ensure a precise adaptation of the virtual picture to the user's gaze location, the head-mounted display device needs to adjust the display position of the virtual picture. Currently, the position adjustment of the virtual screen is still dependent on manual operation by the user, for example, control by means of a handle, a button, etc. However, this manual adjustment has significant limitations. In a scene where the hands of a user are occupied or the attention is highly concentrated, such as work maintenance, medical operation and the like, manual adjustment is not only not convenient enough, but also can increase the operation burden of the user, influence the immersion of the user, and influence the intelligent level of the head-mounted display device in the aspect of man-machine interaction. Disclosure of Invention The embodiment of the invention provides a picture adjusting method, device, equipment and storage medium of head-mounted display equipment, aiming at solving the technical problems of low convenience, increased user operation burden and low intelligent level in a mode of manually adjusting the position of a virtual picture in the head-mounted display equipment. Acquiring periocular electromyographic signals of a user wearing the head-mounted display device; performing feature extraction processing on the periocular electromyographic signals to obtain feature quantities of the periocular electromyographic signals; identifying the watching intention of the user based on the characteristic quantity of the periocular electromyographic signals to obtain the target watching intention of the user; and adjusting the display position of the virtual picture in the head-mounted display device according to the target viewing intention. In a second aspect, an embodiment of the present invention further provides a picture adjustment apparatus of a head-mounted display device, including: The signal acquisition module is used for acquiring periocular electromyographic signals of a user wearing the head-mounted display device; The characteristic extraction module is used for carrying out characteristic extraction processing on the periocular electromyographic signals to obtain characteristic quantities of the periocular electromyographic signals; The intention recognition module is used for recognizing the watching intention of the user based on the characteristic quantity of the periocular electromyographic signals to obtain the target watching intention of the user; and the position adjustment module is used for adjusting the display position of the virtual picture in the head-mounted display device according to the target viewing intention. In a third aspect, an embodiment of the present invention further provides a head-mounted display device, where the head-mounted display device includes a processor, a memory, a computer program stored on the memory and executable by the processor, and a data bus for implementing connection communication between the processor and the memory, where the computer program, when executed by the processor, implements the method for adjusting a picture of the head-mounted display device according to the first aspect. In a fourth aspect, an embodiment of the present invention further provides a storage medium, configured to store one or more programs, where the one or more programs are executable by one or more processors, to implement the method for adjusting a screen of the head-mounted display device according to the first aspect. The embodiment of the invention provides a picture adjusting method, device, equipment and storage medium of head-mounted display equipment, which are used for accurately capturing periocular electromyographic signals reflecting the eye muscle activity of a user so as to accurately identify the target watching intention of the user based on the extracted key characteristic quantity effectively reflecting the eye muscle activity state of the user, and define the watching requirement of the user, thereby adaptively adjusting the display position of a virtual picture in the head-mounted display equipment according to the watching requirement of the user in time without manual opera