CN-115509354-B - Interface layout method and system based on MR mixed reality technology

CN115509354BCN 115509354 BCN115509354 BCN 115509354BCN-115509354-B

Abstract

The invention discloses an interface layout method and system based on MR mixed reality technology in the MR mixed reality field, wherein the method comprises the following steps of obtaining a user sight line range, wherein in the user sight line range, an interface is displayed in a three-dimensional surrounding 360-degree mode when a user rotates by taking the user as an original point or is displayed in a plane/curved surface mode when the user moves, so that an interface display range is determined, and the interface display range is a range from 10 degrees of an upper visual angle to 60 degrees of a lower visual angle on the visual plane based on the visual plane of the user. According to the interface layout method and system based on the MR mixed reality technology, the interface is distributed in the proper visual distribution range in the surrounding type and tiling type interface layout mode taking the eye point of the user as the center, so that the content of the interface element can be effectively displayed, the three-dimensional display characteristics of mixed reality are combined, the interface display element arrangement and interface layout mode are optimized and improved, and the problems of disordered interface element arrangement and unreasonable interface arrangement are solved.

Inventors

WANG WEI
DAI MINGYUAN
TU CHENGLONG

Assignees

江苏徐工工程机械研究院有限公司
燕山大学

Dates

Publication Date: 20260505
Application Date: 20220923

Claims (6)

1. An interface layout method based on MR mixed reality technology is characterized by comprising the following steps: acquiring a sight range of a user; In the user sight range, the interface is displayed in a three-dimensional surrounding 360-degree mode when the user rotates by taking the interface as an original point or in a plane/curved surface mode when the user moves, so that the interface display range is determined; The interface display range is based on a user viewing flat line, the viewing angle on the viewing flat line ranges from 10 degrees to 60 degrees, the interface display range consists of a first interface cloth-arranging belt, a second interface cloth-arranging belt and a third interface cloth-arranging belt, wherein the first interface cloth-arranging belt is formed by the range of the viewing angle on the user viewing flat line, the second interface cloth-arranging belt is formed by the range of the viewing angle on the user viewing flat line, the third interface cloth-arranging belt is formed by the range of 35 degrees to 60 degrees, and the interface consists of a plurality of display panels.
2. The interface layout method according to claim 1, wherein the interface comprises a holographic image and an interface display element, the interface display element comprising a control and an interface icon.
3. The interface layout method according to claim 2, wherein the hologram image is arranged in the center, and the control and interface icon are arranged around the hologram image.
4. An interface layout system based on MR mixed reality technology, comprising: The acquisition module is used for acquiring the sight range of the user; The display module is used for displaying the interface in a three-dimensional surrounding 360 degrees when the user rotates by taking the user as an origin or in a plane/curved surface form when the user moves in the user sight range, so as to determine the interface display range, wherein the interface display range is a range from 10 degrees of an on-line-of-view angle to 60 degrees of a below-line-of-view angle based on the user's line-of-view angle; The interface display range consists of a first interface cloth-arranging belt, a second interface cloth-arranging belt and a third interface cloth-arranging belt, wherein the first interface cloth-arranging belt is formed by a range of 10 degrees of an angle of view on a user's visual plane, the second interface cloth-arranging belt is formed by a range of 35 degrees of an angle of view under the user's visual plane, the third interface cloth-arranging belt is formed by a range of 35 degrees to 60 degrees under the user's visual plane, and the interface consists of a plurality of display panels.
5. The interface layout system of claim 4 wherein the interface comprises a holographic image and an interface display element comprising a control and an interface icon.
6. The interface layout system of claim 5 wherein the holographic image is centrally disposed and the controls and interface icons are disposed about the holographic image.

Description

Interface layout method and system based on MR mixed reality technology Technical Field The invention relates to the technical field of MR mixed reality, in particular to an interface layout method and system based on MR mixed reality technology. Background In recent years, intelligent wearable equipment technology is rapidly developed, and the reality sense of user experience is enhanced by the mixed reality technology due to the characteristic of virtual-real fusion. The intelligent wearing equipment such as intelligent glasses and the like are increasingly widely used, and the display interface of the intelligent wearing equipment is used as an important carrier for bearing interactive contents, so that information transfer among a real environment, a virtual environment and a user is effectively realized. At present, various display terminals mainly adopt a large plane in interface layout and display element arrangement, the characteristics of plane display such as web pages and the like are still kept in a display form, the layout range is tiled, display contents mainly adopt a waterfall type sliding traditional display mode, the display contents are limited, the visual identification effect is poor, and the experience is poor. Disclosure of Invention The invention aims to overcome the defects in the prior art, provides an interface layout method and an interface layout system based on an MR mixed reality technology, lays out interface elements into an interface display range, solves the technical problems of limited display content, poor visual identification effect and poor experience in the past, and effectively improves user experience. In order to achieve the above purpose, the invention is realized by adopting the following technical scheme: In a first aspect, the present invention provides an interface layout method based on MR mixed reality technology, including the following steps: acquiring a sight range of a user; In the user sight range, the interface is displayed in a three-dimensional surrounding 360-degree mode when the user rotates by taking the interface as an original point or in a plane/curved surface mode when the user moves, so that the interface display range is determined; The interface display range is based on a user's viewing plane line, and the range of the viewing angle is from 10 degrees on the viewing plane line to 60 degrees below the viewing plane line. Based on the first aspect, the interface display range is further composed of a first interface cloth-arranging band, a second interface cloth-arranging band and a third interface cloth-arranging band, wherein the first interface cloth-arranging band is formed in a range of 10 degrees of the viewing angle on the user's viewing plane, the second interface cloth-arranging band is formed in a range of 35 degrees of the viewing angle under the user's viewing plane, and the third interface cloth-arranging band is formed in a range of 35 degrees to 60 degrees under the user's viewing plane. Based on the first aspect, further, the interface is composed of a plurality of display panels. Based on the first aspect, further, the interface comprises a holographic image and an interface display element, wherein the interface display element comprises a control and an interface icon. Based on the first aspect, further, the holographic image is arranged in the center, and the control and the interface icon are arranged around the holographic image. In a second aspect, the present invention provides an interface layout system based on MR mixed reality technology, including: The acquisition module is used for acquiring the sight range of the user; And the presentation module is used for presenting the interface in a three-dimensional surrounding 360 degrees when the user rotates by taking the user as an origin or in a plane/curved surface form when the user moves in the user sight range, so as to determine the interface display range, wherein the interface display range is based on a user's sight line, and the range from the sight angle of 10 degrees on the sight line to the sight angle of 60 degrees below the sight line. Based on the second aspect, the interface display range is further composed of a first interface cloth-arranging band, a second interface cloth-arranging band and a third interface cloth-arranging band, wherein the first interface cloth-arranging band is formed in a range of 10 degrees of the viewing angle on the user's viewing plane, the second interface cloth-arranging band is formed in a range of 35 degrees of the viewing angle under the user's viewing plane, and the third interface cloth-arranging band is formed in a range of 35 degrees to 60 degrees under the user's viewing plane. Based on the second aspect, further, the interface is composed of a plurality of display panels. Based on the second aspect, further, the interface comprises a holographic image and an interface display element, wherein the interface displ