CN-115373818-B - Suspended window application method and device based on head-mounted equipment and medium thereof

CN115373818BCN 115373818 BCN115373818 BCN 115373818BCN-115373818-B

Abstract

The application discloses a floating window application method, a device and a medium thereof based on head-mounted equipment, relates to the technical field of head-mounted equipment, and aims to solve the problem that the current AR/VR product cannot view or operate another application while opening one application, and provides a floating window application method based on head-mounted equipment, wherein the method determines operation behaviors corresponding to different user instructions according to a preset instruction set, so that when the user instructions acquired by an AR/VR product through a built-in instruction acquisition module are floating window calling instructions, background applications are displayed in a current window in a form of floating windows, the size of the floating windows is smaller than that of the current window, and further, the other application can be viewed or operated while opening the current application, and the operation experience of a user using the AR/VR product is further improved.

Inventors

ZHANG JINJIN
ZHANG FANGFANG

Assignees

歌尔科技有限公司
歌尔科技有限公司

Dates

Publication Date: 20260421
Application Date: 20220824
Priority Date: 20220824

Claims (5)

1. A floating window application method based on a head-mounted device is characterized by being applied to the head-mounted device, wherein the head-mounted device comprises an AR device and a VR device, and the method comprises the following steps: The method comprises the steps of obtaining a user instruction and determining whether the user instruction is an instruction in a preset instruction set, wherein the preset instruction set comprises a floating window calling instruction, a floating window exiting instruction, an authority selecting instruction, an authority switching instruction, an application switching instruction and a floating window scaling instruction; Displaying an image to be displayed by a background application in a current window in the form of a floating window when the user command is the command for the floating window, wherein the size and the position of the floating window are preset sizes and positions, the preset positions comprise a non-shielding area of a real object or a user fixation area, when other windows exist in the user fixation area, the size of the floating window is smaller than that of the user fixation area, when other windows exist in the user fixation area and the windows do not cover the complete user fixation area, the floating window is displayed in the position which is not covered by the windows in the user fixation area, when a plurality of background applications exist in the background application, the displaying the image to be displayed by the background application in the current window in the form of the floating window comprises determining a unique target application in the background application according to the application selection command, displaying the image of the target application in the current window in the form of the floating window, and capturing data of the real application in the current window in the form of the AR device when the AR device and the plurality of the cloud application exist in the current window; closing the floating window when the user instruction is the floating window exit instruction; When the user instruction is the permission selection instruction, displaying an image to be displayed by the background application in a current window in a form of a floating window corresponding to the permission according to the permission selection instruction, wherein the permission comprises a viewing permission and an operation permission; when the user instruction is the permission switching instruction, switching the permission of the current floating window to the other permission; when the user instruction is the application switching instruction, re-determining an image to be displayed by a background application according to the application switching instruction, and displaying the image in the floating window; and when the user instruction is the floating window scaling instruction, adjusting the size of the floating window according to the floating window scaling instruction.
2. The head-mounted device based floating window application method of claim 1, wherein the obtaining user instructions comprises: And acquiring the user instruction through a gesture recognition module, wherein the corresponding user instruction is a gesture instruction.
3. A floating window application apparatus based on a head-mounted device, characterized in that the apparatus is applied to the head-mounted device, the head-mounted device comprises an AR device and a VR device, the apparatus comprises: The device comprises an instruction acquisition module, a background application and a control module, wherein the instruction acquisition module is used for acquiring a user instruction and determining whether the user instruction is an instruction in a preset instruction set, the preset instruction set comprises a floating window calling instruction, a floating window exiting instruction, an application switching instruction and a floating window scaling instruction, and the preset instruction set further comprises an application selection instruction when a plurality of background applications exist; The floating window arousing module is used for displaying an image to be displayed by a background application in a current window in a floating window mode when the user instruction is the floating window arousing instruction, wherein the size and the position of the floating window are preset sizes and positions, the preset positions comprise a non-shielding area of a real object or a user fixation area, the size of the floating window is smaller than that of the user fixation area when other windows exist in the user fixation area, the floating window is displayed in a position which cannot be covered by the window in the user fixation area when other windows exist in the user fixation area and the window does not cover the complete user fixation area, and for the AR equipment and a plurality of AR equipment, the displaying of the image to be displayed by the background application in the current window in the floating window mode comprises the steps of downloading cloud data to project floating window content, wherein the cloud data is scene real scene information acquired and uploaded by any AR equipment; The floating window exit module is used for closing the floating window when the user instruction is the floating window exit instruction; the application selection module is used for determining a unique target application in the background application according to the application selection instruction when the user instruction is the application selection instruction; The permission selecting module is used for displaying the image to be displayed by the background application in a current window in a form of a suspension window of corresponding permission according to the permission selecting instruction when the user instruction is the permission selecting instruction, wherein the permission comprises a viewing permission and an operation permission; The application switching module is used for determining the image to be displayed of the background application again according to the application switching instruction when the user instruction is the application switching instruction, and displaying the image in the floating window; the permission switching module is used for switching the permission of the current suspension window to the other permission when the user instruction is the permission switching instruction; and the floating window scaling module is used for adjusting the size of the floating window according to the floating window scaling instruction when the user instruction is the floating window scaling instruction.
4. A suspended window application device based on a head-mounted device, comprising: a memory for storing a computer program; a processor for implementing the steps of the head-mounted device based floating window application method of claim 1 or 2 when executing the computer program.
5. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the head-mounted based floating window application method according to claim 1 or 2.

Description

Suspended window application method and device based on head-mounted equipment and medium thereof Technical Field The application relates to the technical field of head-mounted equipment, in particular to a method and a device for applying a suspended window based on head-mounted equipment and a medium thereof. Background With the development of head-mounted devices, especially augmented Reality (Augmented Reality, AR)/Virtual Reality (VR) products, multiple applications can be supported simultaneously, typically one application is displayed at the front end, and the rest of the applications continue to run in the background as background applications, but the applications running in the background are not perceived by the user. The user can not view or operate another application on the premise of opening a certain application, so that the use experience of the user is affected. Therefore, there is a need in the art for a method of floating window application based on a head-mounted device that solves the problem that current head-mounted device products cannot view or operate one application while another application is being opened. Disclosure of Invention The application aims to provide a floating window application method, a device and a medium thereof based on head-mounted equipment, and provides a floating window application method suitable for head-mounted equipment products. In order to solve the technical problems, the application provides a suspended window application method based on a head-mounted device, which comprises the following steps: acquiring a user instruction and determining whether the user instruction is an instruction in a preset instruction set, wherein the preset instruction set comprises a floating window calling instruction and a floating window exiting instruction; when the user instruction is a floating window calling instruction, displaying an image to be displayed by the background application in a current window in a floating window form, wherein the size and the position of the floating window are preset; and closing the floating window when the user command is a floating window exit command. Preferably, when a plurality of background applications exist, the preset instruction set further comprises an application selection instruction; correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window comprises: when the user instruction is an application selection instruction, determining a unique target application in the background application according to the application selection instruction; And displaying the image of the target application as an image to be displayed in the form of a floating window in the current window. Preferably, the preset instruction set further comprises an authority selection instruction; correspondingly, displaying the image to be displayed by the background application in the current window in the form of a floating window comprises: When the user instruction is an authority selection instruction, displaying the image to be displayed by the background application in the current window in a floating window form corresponding to the authority according to the authority selection instruction, wherein the authority comprises a viewing authority and an operation authority. Preferably, the preset instruction set further comprises an application switching instruction; Correspondingly, the method also comprises the following steps: And when the user instruction is an application switching instruction, the image to be displayed by the background application is redetermined according to the application switching instruction and is displayed in the floating window. Preferably, the preset instruction set further comprises an authority switching instruction; Correspondingly, the method also comprises the following steps: when the user instruction is an authority switching instruction, switching the authority of the current floating window to be the other authority. Preferably, the preset instruction set further comprises a floating window scaling instruction; Correspondingly, the method also comprises the following steps: when the user instruction is a floating window scaling instruction, the size of the floating window is adjusted according to the floating window scaling instruction. Preferably, obtaining the user instruction includes: and acquiring a user instruction through the gesture recognition module, wherein the corresponding user instruction is a gesture instruction. In order to solve the technical problem, the application further provides a suspended window application device based on the head-mounted equipment, which comprises: the instruction acquisition module is used for acquiring a user instruction and determining whether the user instruction is an instruction in a preset instruction set, wherein the preset instruction set comprises a floating window calling instr