US-12619195-B2 - Image display method and apparatus

US12619195B2US 12619195 B2US12619195 B2US 12619195B2US-12619195-B2

Abstract

An image display method includes: obtaining an input operation by a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen; determining, in conjunction with the input operation, a movement trajectory of the virtual interactive object, a first appearance state feature of the virtual interactive object relative to an eye position of the first user, and a second appearance state feature of the virtual interactive object relative to an eye position of a second user, after a current moment; displaying the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen; and displaying the virtual interactive object having the movement trajectory and the second appearance state feature on a second display surface of the transparent holographic display screen.

Inventors

Jiangtao GONG
Liuxin Zhang

Assignees

LENOVO (BEIJING) LIMITED

Dates

Publication Date: 20260505
Application Date: 20220224
Priority Date: 20210906

Claims (14)

1 . An image display method comprising: obtaining an input operation by a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, the first user being located at a first display surface side of the transparent holographic display screen; determining, in conjunction with the input operation, a movement trajectory of the virtual interactive object, a first appearance state feature of the virtual interactive object relative to an eye position of the first user, and a second appearance state feature of the virtual interactive object relative to an eye position of a second user, after a current moment, the second user being located at a second display surface side of the transparent holographic display screen, the movement trajectory being determined through combining a current movement speed and a current movement direction of the virtual interactive object, and a magnitude and a direction of a force of the input operation on the virtual interactive object, wherein a size change feature corresponding to an apparent size of the virtual interactive object is determined as the virtual interactive object moves along the movement trajectory based on a preconfigured correspondence relationship defining correspondences between a plurality of different apparent sizes of the virtual interactive object and a plurality of different distances of the virtual interactive object relative to a user's eyes, and the determining the size change feature comprises querying the preconfigured correspondence relationship using a distance between the virtual interactive object and the user's eyes; displaying the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen; and displaying the virtual interactive object having the movement trajectory and the second appearance state feature on a second display surface of the transparent holographic display screen.
2 . The method according to claim 1 , wherein determining the movement trajectory, the first appearance state feature, and the second appearance state feature after the current moment includes: determining the movement trajectory of the virtual interactive object after the current moment in conjunction with the input operation; determining a first size change feature corresponding to a first size of the virtual interactive object after the current moment in conjunction with the movement trajectory, the first size being a size of the virtual interactive object relative to the eye position of the first user and being smaller in response to the virtual interactive object being farther away from the eye position of the first user; and determining a second size change feature corresponding to a second size of the virtual interactive object after the current moment in conjunction with the movement trajectory, the second size being a size of the virtual interactive object relative to the eye position of the second user and being smaller in response to the virtual interactive object being farther away from the eye position of the second user.
3 . The method according to claim 1 , wherein determining the movement trajectory, the first appearance state feature, and the second appearance state feature after the current moment includes: determining a first color change feature of a first color of the virtual interactive object after the current moment in conjunction with the movement trajectory, the first color being a color that the virtual interactive object needs to present to the eye position of the first user and being lighter in response to the virtual interactive object being farther away from the eye position of the first user; and determining a second color change feature of a second color of the virtual interactive object after the current moment in conjunction with the movement trajectory, the second color being a color that the virtual interactive object needs to present to the eye position of the second user and being lighter in response to the virtual interactive object being farther away from the eye position of the second user.
4 . The method according to claim 3 , wherein the determining the first color change feature comprises applying a first color change rule as the virtual interactive object moves along the movement trajectory, and the determining the second color change feature comprises applying a second color change rule as the virtual interactive object moves along the movement trajectory.
5 . The method according to claim 1 , wherein a first diffraction grating is superimposed on the first display surface of the transparent holographic display screen, and a second diffraction grating is superimposed on the second display surface of the transparent holographic display screen; the method further comprising: controlling the second diffraction grating to block first image light corresponding to the virtual interactive object having the movement trajectory and the first appearance state feature to make the virtual interactive object having the movement trajectory and the first appearance state feature invisible on the second display surface; and controlling the first diffraction grating to block second image light corresponding to the virtual interactive object having the movement trajectory and the second appearance state feature to make the virtual interactive object having the movement trajectory and the second appearance state feature invisible on the first display surface.
6 . The method according to claim 5 , wherein: displaying the virtual interactive object having the movement trajectory and the first appearance shape feature on the first display surface of the transparent holographic display screen includes projecting the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen through at least one projection light source, the at least one projection light source being disposed inside the transparent holographic display screen or facing toward the transparent holographic display screen; and controlling the second diffraction grating to block the first image light corresponding to the virtual interactive object having the movement trajectory and the first appearance state feature includes sending an electrical control signal to the second diffraction grating, the electrical control signal being configured to control a sub-grating area, covered by the first image light, of the second diffraction grating to be in a light blocking state.
7 . The method according to claim 5 , wherein: displaying the virtual interactive object having the movement trajectory and the second appearance state feature on the second display surface of the transparent holographic display screen includes projecting the virtual interactive object having the movement trajectory and the second appearance state feature on the second display surface of the transparent holographic display screen through at least one projection light source, the at least one projection light source being disposed inside the transparent holographic display screen or facing toward the transparent holographic display screen; and controlling the first diffraction grating to block the second image light corresponding to the virtual interactive object having the movement trajectory and the second appearance state feature include sending an electrical control signal to the first diffraction grating, the electrical control signal being configured to control a sub-grating area, covered by the second image light, of the first diffraction grating to be in a light blocking state.
8 . The method according to claim 5 , wherein the second diffraction grating has mechanically adjustable second grating spacing and the controlling the second diffraction grating comprises adjusting the second grating spacing in a first sub-grating area covered by the first image light until reaching a first light blocking state, and the first diffraction grating has mechanically adjustable first grating spacing and the controlling the first diffraction grating comprises adjusting the first grating spacing in a second sub-grating area covered by the second image light until reaching a second light blocking state.
9 . An electronic device comprising: a memory storing program instructions; and a processor configured to execute the program instructions to: obtain an input operation by a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, the first user being located at a first display surface side of the transparent holographic display screen; determine, in conjunction with the input operation, a movement trajectory of the virtual interactive object, a first appearance state feature of the virtual interactive object relative to an eye position of the first user, and a second appearance state feature of the virtual interactive object relative to an eye position of a second user, after a current moment, the second user being located at a second display surface side of the transparent holographic display screen, the movement trajectory being determined through combining a current movement speed and a current movement direction of the virtual interactive object, and a magnitude and a direction of a force of the input operation on the virtual interactive object, wherein a size change feature corresponding to an apparent size of the virtual interactive object is determined as the virtual interactive object moves along the movement trajectory based on a preconfigured correspondence relationship defining correspondences between a plurality of different apparent sizes of the virtual interactive object and a plurality of different distances of the virtual interactive object relative to a user's eyes, and the determining the size change feature comprises querying the preconfigured correspondence relationship using a distance between the virtual interactive object and the user's eyes; display the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen; and display the virtual interactive object having the movement trajectory and the second appearance state feature on a second display surface of the transparent holographic display screen.
10 . The electronic device according to claim 9 , wherein the processor is further configured to execute the program instructions stored in the memory to, when determining the movement trajectory, the first appearance state feature, and the second appearance state feature after the current moment: determine the movement trajectory of the virtual interactive object after the current moment in conjunction with the input operation; determine a first size change feature corresponding to a first size of the virtual interactive object after the current moment in conjunction with the movement trajectory, the first size being a size of the virtual interactive object relative to the eye position of the first user and being smaller in response to the virtual interactive object being farther away from the eye position of the first user; and determine a second size change feature corresponding to a second size of the virtual interactive object after the current moment in conjunction with the movement trajectory, the second size being a size of the virtual interactive object relative to the eye position of the second user and being smaller in response to the virtual interactive object being farther away from the eye position of the second user.
11 . The electronic device according to claim 10 , wherein when determining the movement trajectory, the first appearance state feature, and the second appearance state feature after the current moment, the processor is further configured to execute the program instructions stored in the memory to: determine a first color change feature of a first color of the virtual interactive object after the current moment in conjunction with the movement trajectory, the first color being a color that the virtual interactive object needs to present to the eye position of the first user and being lighter in response to the virtual interactive object being farther away from the eye position of the first user; and determine a second color change feature of a second color of the virtual interactive object after the current moment in conjunction with the movement trajectory, the second color being a color that the virtual interactive object needs to present to the eye position of the second user and being lighter in response to the virtual interactive object being farther away from the eye position of the second user.
12 . The electronic device according to claim 9 , wherein a first diffraction grating is superimposed on the first display surface of the transparent holographic display screen, and a second diffraction grating is superimposed on the second display surface of the transparent holographic display screen; the processor is further configured to execute the program instructions stored in the memory to: control the second diffraction grating to block first image light corresponding to the virtual interactive object having the movement trajectory and the first appearance state feature to make the virtual interactive object having the movement trajectory and the first appearance state feature invisible on the second display surface; and control the first diffraction grating to block second image light corresponding to the virtual interactive object having the movement trajectory and the second appearance state feature to make the virtual interactive object having the movement trajectory and the second appearance state feature invisible on the first display surface.
13 . The electronic device according to claim 12 , wherein: when displaying the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen, the processor is further configured to execute the program instructions stored in the memory to: project the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen through at least one projection light source, the at least one projection light source being disposed inside the transparent holographic display screen or facing toward the transparent holographic display screen; and when controlling the second diffraction grating to block the first image light corresponding to the virtual interactive object having the movement trajectory and the first appearance state feature, the processor is further configured to execute the program instructions stored in the memory to: send an electrical control signal to the second diffraction grating, the electrical control signal being configured to control a sub-grating area, covered by the first image light, of the second diffraction grating to be in a light blocking state.
14 . The electronic device according to claim 12 , wherein: when displaying the virtual interactive object having the movement trajectory and the second appearance state feature on the second display surface of the transparent holographic display screen, the processor is further configured to execute the program instructions stored in the memory to: project the virtual interactive object having the movement trajectory and the second appearance state feature on the second display surface of the transparent holographic display screen through at least one projection light source, the at least one projection light source being disposed inside the transparent holographic display screen or facing toward the transparent holographic display screen; and when controlling the first diffraction grating to block the second image light corresponding to the virtual interactive object having the movement trajectory and the second appearance state feature, the processor is further configured to execute the program instructions stored in the memory to: send an electrical control signal to the first diffraction grating, the electrical control signal being configured to control a sub-grating area, covered by the second image light, of the first diffraction grating to be in a light blocking state.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application claims priority to Chinese Patent Application No. 202111037975.8, filed on Sep. 6, 2021, the entire content of which is incorporated herein by reference. TECHNICAL FIELD The present disclosure relates to the technical field of display technologies and, more particularly, to an image display method and apparatus. BACKGROUND Application scenarios of technologies such as mixed reality increase day by day. In the application scenarios of the mixed reality, both virtual objects and real objects are present at the same time, and a virtual scene seen by different users is the same. However, in many business scenarios, it may be desirable to be able to present different virtual scenes to users at different locations, such that the users at different locations can see more realistic virtual scenes for their perspectives. SUMMARY One aspect of the present disclosure provides an image projection method. The method includes: obtaining an input operation by a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, the first user being located at a first display surface side of the transparent holographic display screen; determining, in conjunction with the input operation, a movement trajectory of the virtual interactive object, a first appearance state feature of the virtual interactive object relative to an eye position of the first user, and a second appearance state feature of the virtual interactive object relative to an eye position of a second user, after a current moment, the second user being located at a second display surface side of the transparent holographic display screen; displaying the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen; and displaying the virtual interactive object having the movement trajectory and the second appearance state feature on a second display surface of the transparent holographic display screen. Another aspect of the present disclosure provides an electronic device. The electronic device includes a memory storing program instructions, and a processor configured to execute the program instructions to: obtain an input operation by a first user on a virtual interactive object displayed on a first display surface of a transparent holographic display screen, the first user being located at a first display surface side of the transparent holographic display screen; determine, in conjunction with the input operation, a movement trajectory of the virtual interactive object, a first appearance state feature of the virtual interactive object relative to an eye position of the first user, and a second appearance state feature of the virtual interactive object relative to an eye position of a second user, after a current moment, the second user being located at a second display surface side of the transparent holographic display screen; display the virtual interactive object having the movement trajectory and the first appearance state feature on the first display surface of the transparent holographic display screen; and display the virtual interactive object having the movement trajectory and the second appearance state feature on a second display surface of the transparent holographic display screen. BRIEF DESCRIPTION OF THE DRAWINGS To more clearly illustrate the technical solution of the present disclosure, the accompanying drawings used in the description of the disclosed embodiments are briefly described below. The drawings described below are merely some embodiments of the present disclosure. Other drawings may be derived from such drawings by a person with ordinary skill in the art without creative efforts and may be encompassed in the present disclosure. FIG. 1 is a schematic structural diagram of an exemplary image projection system according to some embodiments of the present disclosure; FIG. 2 is a flowchart of an exemplary image display method according to some embodiments of the present disclosure; FIG. 3 is a flowchart of another exemplary image display method according to some embodiments of the present disclosure; FIG. 4 is a schematic diagram illustrating an exemplary mixed reality scene according to some embodiments of the present disclosure; FIG. 5 is a schematic diagram illustrating another exemplary mixed reality scene according to some embodiments of the present disclosure; FIG. 6 is a flowchart of another exemplary image display method according to some embodiments of the present disclosure; FIG. 7 is a flowchart of another exemplary image display method according to some embodiments of the present disclosure; FIG. 8 is a schematic structural diagram of an exemplary image display apparatus according to some embodiments of the present disclosure; and FIG. 9 is a schematic structural diagram of an exemplary electronic dev