EP-4737984-A1 - HEAD-MOUNTED DISPLAY DEVICE AND CONTROL METHOD THEREFOR, AND STORAGE MEDIUM

EP4737984A1EP 4737984 A1EP4737984 A1EP 4737984A1EP-4737984-A1

Abstract

The present application discloses a head-mounted display device, a control method, and a storage medium. The head-mounted display device includes a first display component and a second display component. The first display component is seen by at least a wearer, and the second display component is seen by at least a non-wearer. The control method for the head-mounted display device includes: obtaining a display mode of the head-mounted display device; and controlling a display state of the first display component and/or the second display component based on the display mode, where the types of the display mode include at least: a first display mode when the user does not wear the device, or a second display mode when the user wears the device. In this way, on the basis of additionally providing an outer screen display (that is, the second display component) on the head-mounted display device, the display state of the first display component and/or the second display component can be controlled based on the obtained display mode, which can enrich the display effects of the head-mounted display device based on human-computer interaction, thereby improving user experience.

Inventors

LI, JIAYING
WEN, HAIBO
XIONG, GANG
ZHU, Junrong

Assignees

Arashi Vision Inc.
Antigravity (SZ) Technology Co., Ltd

Dates

Publication Date: 20260506
Application Date: 20240905

Claims (20)

A method for controlling a head-mounted display device, wherein the head-mounted display device comprises a first display component and a second display component, the first display component is seen by at least a wearer, and the second display component is seen by at least a non-wearer, and the method comprises: obtaining a display mode of the head-mounted display device; and controlling a display state of the first display component and/or the second display component based on the display mode, wherein the display mode comprises at least one of: a first display mode when a user does not wear the head-mounted display device, or a second display mode when the user wears the head-mounted display device.
The method according to claim 1, wherein the obtaining the display mode of the head-mounted display device comprises: obtaining a detection result indicating whether the head-mounted display device is worn; in response to determining, based on the detection result, that the head-mounted display device is not worn, determining that the display mode is the first display mode; or in response to determining, based on the detection result, that the head-mounted display device is worn, determining that the display mode is the second display mode.
The method according to claim 1, wherein the controlling the display state of the first display component and/or the second display component based on the display mode comprises: in the first display mode, controlling the second display component to be in a wallpaper display state, a parameter display state, a query display state, or an image transmission display state, and/or controlling the first display component to be in a screen-off display state.
The method according to claim 3, wherein the head-mounted display device supports establishing a communication connection with an aircraft, and the controlling the display state of the first display component and/or the second display component based on the display mode comprises: when the head-mounted display device is in communication connection with the aircraft, controlling the second display component to be in the image transmission display state; and when the head-mounted display device is disconnected from the communication connection with the aircraft, controlling the second display component to be in the wallpaper display state, the parameter display state, or the query display state, and/or controlling the first display component to be in the screen-off display state.
The method according to claim 4, wherein the controlling the second display component to be in the image transmission display state comprises: controlling the second display component to display a captured image transmitted by the aircraft, or controlling the second display component to display an image in a forward-looking view of the aircraft.
The method according to claim 3, wherein the controlling the second display component to be in the wallpaper display state comprises: controlling the second display component to display a preconfigured picture, animated picture or video.
The method according to claim 3, wherein the controlling the second display component to be in the parameter display state comprises: controlling the second display component to display at least one of a power supply, a communication state, a position, an actuator state, or environment information of the head-mounted display device and/or an associated external device.
The method according to claim 3, wherein the controlling the second display component to be in the query display state comprises: controlling the second display component to display stored historical image data.
The method according to claim 1, wherein the controlling the display state of the first display component and/or the second display component based on the display mode comprises: in the second display mode, controlling the first display component to be in a screen-on display state, and controlling the second display component to be in a set display state, wherein the set display state comprises one of the following: a wallpaper display state, a parameter display state, or an associated display state of associating a display screen of the first display component.
The method according to claim 1, wherein the head-mounted display device supports establishing a communication connection with an aircraft, and the method further comprises: receiving a captured image transmitted by the aircraft; and in the second display mode, controlling the first display component to display a real-time image, wherein the real-time image is an image corresponding to a current viewing angle of the user, and the real-time image is part of the captured image, and controlling the second display component to display an image in a forward-looking view of the aircraft.
The method according to claim 9, wherein when the first display component is in the screen-on display state, the method further comprises: configuring display parameters of the wallpaper display state, the parameter display state and/or the associated display state based on a human-computer interaction instruction.
The method according to claim 9, wherein when the first display component is in the screen-on display state, the method further comprises: switching a current display state of the second display component based on a human-computer interaction instruction.
The method according to claim 9, wherein the head-mounted display device comprises a main processor, a converter and a slave processor, the main processor is connected to the converter and the slave processor, the converter is configured to perform first conversion processing on display information output by the main processor and then transmit the display information to the first display component for display, the slave processor is connected to the second display component, and when the second display component is in the associated display state, the method further comprises: the converter performs second conversion processing on the display information and then transmits the display information to the slave processor, and the slave processor drives the second display component to display a display screen synchronized with the first display component.
The method according to claim 1, wherein the head-mounted display device supports establishing a communication connection with an aircraft, and the method further comprises: starting a navigation mode for finding the aircraft based on a human-computer interaction instruction; and displaying a navigation screen corresponding to the navigation mode based on at least the second display component.
The method according to claim 1, wherein the head-mounted display device further comprises a control component for switching a display state, and the method further comprises: in response to a first switching instruction input by the control component, controlling the second display component to synchronously display with the first display component.
The method according to claim 14, wherein the head-mounted display device further comprises an image acquisition component for acquiring an environment image, and the method further comprises: in response to a second switching instruction input by the control component, controlling the first display component and/or the second display component to display image information of the environment image.
The method according to claim 1, wherein the head-mounted display device further comprises a frame component for bearing the first display component and the second display component, and a wearing component for a user to wear; and wherein the wearing component is arranged on the frame component, the first display component comprises a left optical machine component and a right optical machine component located inside two frames of the frame component, and the left optical machine component and the right optical machine component adopt an optical folding light path structure.
The method according to claim 17, wherein the head-mounted display device further comprises a display adjustment component, connected to the first display component, and the method further comprises: adjusting pupil distance and/or a diopter setting of the first display component based on the display adjustment component.
The method according to claim 17, wherein the wearing component comprises a leg component and/or a head-mounted component that is detachably connected to the frame component.
The method according to claim 17, wherein the head-mounted display device further comprises: an antenna component, arranged on the frame component, wherein the antenna component has a folded first state and an opened second state.

Description

Technical Field The present disclosure relates to the field of human-computer interaction control, and in particular, to a head-mounted display device, a control method thereof, and a storage medium. Background In recent years, in order to improve the display effect of display devices, virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies have been introduced into display devices to enhance the immersive experience for users. In practical applications, such display devices are often head-mounted display devices (Head Mount Display, HMD). That is, by means of the head-mounted display device, optical signals are transmitted to the eyes of the wearer, enabling different effects such as VR, AR, and MR. Since the user needs to wear the head-mounted display device to view the display screen and perform related settings, the user experience is affected. Summary In view of the above, implementations of the present disclosure provide a head-mounted display device, a control method thereof, and a storage medium, aiming to improve the display effect of the head-mounted display device. The technical solutions of the implementations of the present disclosure are implemented as follows. In a first aspect, an implementation of the present disclosure provides a control method for a head-mounted display device. The head-mounted display device includes a first display component and a second display component. The first display component is seen by at least a wearer, and the second display component is seen by at least a non-wearer. The method includes: obtaining a display mode of the head-mounted display device; andcontrolling a display state of the first display component and/or the second display component based on the display mode,where the types of the display mode include at least: a first display mode when the user does not wear the head-mounted display device, and a second display mode when the user wears the head-mounted display device. In the above solution, the obtaining of the display mode of the head-mounted display device includes: obtaining a detection result indicating whether the head-mounted display device is worn;if it is determined based on the detection result that the head-mounted display device is not worn, the display mode is determined as the first display mode; orif it is determined based on the detection result that the head-mounted display device is worn, the display mode is determined as the second display mode. In the above solution, the controlling of the display state of the first display component and/or the second display component based on the display mode includes: in the first display mode, controlling the second display component to be in a wallpaper display state or a parameter display state or a query display state or an image transmission display state, and/or controlling the first display component to be in a screen-off display state. In the above solution, the head-mounted display device supports establishing a communication connection with an aircraft, and the controlling of the display state of the first display component and/or the second display component based on the display mode includes: when the head-mounted display device is in communication connection with the aircraft, controlling the second display component to be in the image transmission display state; andwhen the head-mounted display device is disconnected from the communication connection with the aircraft, controlling the second display component to be in the wallpaper display state or the parameter display state or the query display state, and/or controlling the first display component to be in the screen-off display state. In the above solution, the controlling of the second display component to be in the image transmission display state includes: controlling the second display component to display a captured image transmitted by the aircraft, or controlling the second display component to display an image in a forward-looking view of the aircraft. In the above solution, controlling the second display component to be in the wallpaper display state includes: controlling the second display component to display a preconfigured picture, animated picture, or video. In the above solution, controlling the second display component to be in the parameter display state includes: controlling the second display component to display at least one of a power supply, a communication state, a position, an actuator state, and environment information of the head-mounted display device and/or an associated external device. In the above solution, controlling the second display component to be in the query display state includes: controlling the second display component to display stored historical image data. In the above solution, the controlling of the display state of the first display component and/or the second display component based on the display mode includes: in the second display mode, controlling