KR-102961244-B1 - Digital light projector for augmented reality

KR102961244B1KR 102961244 B1KR102961244 B1KR 102961244B1KR-102961244-B1

Abstract

A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. The light source component of the DLP projector is configured to generate a single repetition of a red-green-blue color sequence per image frame. The AR display device identifies the color sequence of the light source component of the DLP projector and tracks the motion of the AR display device. The AR display device adjusts the motion of the DLP projector based on the single repetition of the red-green-blue color sequence, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.

Inventors

듀얼, 제프리 마이클
슈니처, 도미니크
싱, 아미트
와그너, 다니엘

Assignees

스냅 인코포레이티드

Dates

Publication Date: 20260508
Application Date: 20211221
Priority Date: 20210409

Claims (20)

As a method for configuring a DLP (digital light projector) of an AR (augmented reality) display device: A step of configuring the light source component of a DLP projector to generate a single red-green-blue color sequence repetition per image frame; A step of identifying the color sequence of the light source component of the above DLP projector; A step of tracking the motion of the AR display device; and The method includes the step of adjusting the operation of the DLP projector based on the repetition of the single red-green-blue color sequence, the color sequence of the light source component of the DLP projector, and the motion of the AR display device. The step of adjusting the operation of the above DLP projector is: A step of identifying motion artifacts produced by the DLP projector based on the identified color sequence, a single red-green-blue color sequence repetition per image frame, and motion of the AR display device; A step of generating a counter artifact that offsets the motion artifact based on the identified motion artifact; A step of causing the DLP projector to display the counter artifact; and A method further comprising the step of individually shifting each bit plane of each color plane based on adjusted pixel persistence values.
In paragraph 1, the step of adjusting the operation of the DLP projector is: A method further comprising the step of reducing motion artifacts produced by the DLP projector based on the identified color sequence and a single red-green-blue color sequence repetition per image frame.
delete
In paragraph 1, A method further comprising the step of individually shifting each color plane based on adjusted pixel persistence values.
delete
In paragraph 1, A step of determining an adjusted pixel persistence value based on the identified color sequence and a single red-green-blue color sequence repetition per image frame; A step of replacing the default pixel persistence value with the adjusted pixel persistence value; and A method further comprising the step of operating the DLP projector with the above-mentioned adjusted pixel persistence value.
In paragraph 6, A method further comprising the step of individually shifting each color plane based on the above-mentioned adjusted pixel persistence value.
In paragraph 6, A method further comprising the step of individually shifting each bit plane of each color plane based on the above-mentioned adjusted pixel persistence value.
In paragraph 6, the step of operating the DLP projector is: A method further comprising the step of controlling the DMD of the DLP projector to light up a pixel for the above-mentioned adjusted pixel persistence value.
In paragraph 1, Steps for accessing virtual content; and A method further comprising the step of displaying the virtual content on the screen of the AR display device by the adjusted operation of the DLP projector, wherein the virtual content is displayed once per image frame.
As a computing device: processor; and The device includes memory storing instructions, and when the instructions are executed by the processor: Configure the light source component of the DLP projector to generate a single red-green-blue color sequence repetition per image frame; Identify the color sequence of the light source component of the above DLP projector; Tracking motion of an AR display device; The operation of the DLP projector is configured to be adjusted based on the repetition of the single red-green-blue color sequence, the color sequence of the light source component of the DLP projector, and the motion of the AR display device, and Adjusting the operation of the above DLP projector is: Identifying motion artifacts produced by the DLP projector based on the above-identified color sequence, the single red-green-blue color sequence repetition per image frame, and the motion of the AR display device; Generating a counter artifact that offsets the motion artifact based on the identified motion artifact; Causing the DLP projector to display the counter artifact; and A computing device further comprising individually shifting each bit plane of each color plane based on adjusted pixel persistence values.
In Clause 11, adjusting the operation of the above-mentioned DLP projector is: A computing device further comprising reducing motion artifacts produced by the DLP projector based on the identified color sequence and a single red-green-blue color sequence repetition per image frame.
delete
In paragraph 11, the above commands are the device: A computing device further configured to individually shift each color plane based on adjusted pixel persistence values.
delete
In paragraph 11, the above commands are the device: Determines an adjusted pixel persistence value based on the identified color sequence and a single red-green-blue color sequence repetition per image frame; Replace the default pixel persistence value with the above-mentioned adjusted pixel persistence value, and A computing device further configured to operate the DLP projector with the above-mentioned adjusted pixel persistence value.
In paragraph 16, the above commands are the device: A computing device further configured to individually shift each color plane based on the above-mentioned adjusted pixel persistence value.
In paragraph 16, the above commands are the device: A computing device further configured to individually shift each bit plane of each color plane based on the above-mentioned adjusted pixel persistence value.
In Clause 16, operating the above DLP projector is: A computing device further comprising controlling the DMD of the DLP projector to light up a pixel for the above-mentioned adjusted pixel persistence value.
As a non-transient computer-readable storage medium, the computer-readable storage medium comprises instructions, and when the instructions are executed by a computer, the computer: Configure the light source component of the DLP projector to generate a single red-green-blue color sequence repetition per image frame; Identify the color sequence of the light source component of the above DLP projector; Tracking motion of an AR display device; Causing the operation of the DLP projector to be adjusted based on the repetition of the single red-green-blue color sequence, the color sequence of the light source component of the DLP projector, and the motion of the AR display device, and Adjusting the operation of the above DLP projector is: Identifying motion artifacts produced by the DLP projector based on the above-identified color sequence, the single red-green-blue color sequence repetition per image frame, and the motion of the AR display device; Generating a counter artifact that offsets the motion artifact based on the identified motion artifact; Causing the DLP projector to display the counter artifact; and A non-transient computer-readable storage medium further comprising individually shifting each bit plane of each color plane based on adjusted pixel persistence values.

Description

Digital light projector for augmented reality [Cross-reference] The present application is a continuation of U.S. Application No. 17/301,657 filed on April 9, 2021, claiming priority to U.S. Provisional Application No. 63/132,023 filed on December 30, 2020, and claims priority thereto, the contents of each of these applications are incorporated herein by reference in their entirety. [Technology Field] The subject matter disclosed herein generally relates to display systems. Specifically, the present disclosure covers systems and methods for using digital light projectors for augmented reality. Augmented reality (AR) devices allow users to view virtual content that can be aligned with items, images, objects, or environments within the device's field of view while observing a real-world scene. AR devices include a partially transparent display that generates a composite image of the virtual content. To easily identify the discussion of any specific element or action, the top digit or numbers of the reference number indicate the drawing number where the element is first introduced. FIG. 1 is a block diagram illustrating a network environment for operating an AR (Augmented Reality) display device according to one exemplary embodiment. FIG. 2 is a block diagram illustrating an AR display device according to one exemplary embodiment. FIG. 3 is a block diagram illustrating a DLP projector according to an exemplary embodiment. FIG. 4 is a block diagram illustrating a DLP controller according to one exemplary embodiment. FIG. 5 is a chart illustrating an image ghosting effect according to one embodiment. FIG. 6 is a chart illustrating a predicted color sequence effect according to one exemplary embodiment. FIG. 7 is a chart illustrating a low color persistence effect according to one exemplary embodiment. FIG. 8 illustrates a server according to one exemplary embodiment. FIG. 9 is a flowchart illustrating a method of configuring a DLP projector according to one exemplary embodiment. FIG. 10 is a flowchart illustrating a method of operating a DLP projector according to one exemplary embodiment. FIG. 11 is a flowchart illustrating a method of operating a DLP projector according to one exemplary embodiment. FIG. 12 is a flowchart illustrating a method for adjusting pixel persistence according to one exemplary embodiment. FIG. 13 is a block diagram illustrating a software architecture in which the present disclosure can be implemented according to an exemplary embodiment. FIG. 14 is a schematic representation of a machine in the form of a computer system in which a set of instructions to cause the machine to perform any one or more of the methodologies discussed in this specification can be executed, according to one exemplary embodiment. The following description describes systems, methods, techniques, instruction sequences, and computing machine program products that illustrate exemplary embodiments of the subject matter. In the following description, numerous specific details are provided for illustrative purposes to facilitate an understanding of the various embodiments of the subject matter. However, it will be apparent to those skilled in the art that embodiments of the subject matter may be practiced without some or others of these specific details. Examples merely exemplify possible variations. Unless explicitly stated otherwise, structures (structural components, such as modules) may be optional, combined, or subdivided, and operations (e.g., in procedures, algorithms, or other functions) may be sequenced, combined, or subdivided. AR applications allow users to experience information such as the form of virtual objects rendered on the display of an AR display device (also referred to as a display device). The rendering of virtual objects can be based on the position of the display device relative to a physical object or a reference frame (outside the display device), ensuring that the virtual object appears accurately on the display. Virtual objects appear aligned with physical objects as perceived by the user of the AR display device. Graphics (e.g., graphic elements including commands and guides) appear to be attached to the physical object of interest. To achieve this, the AR display device detects physical objects and tracks the orientation of the AR display device relative to the physical object's location. The orientation identifies the position and orientation of the object relative to the reference frame or another object. In one example, an AR display device includes a projector (e.g., a Digital Light Projector (DLP)) that displays virtual objects on the screen of the AR display device. DLP projectors operate by projecting light from a light source toward a Digital Micromirror Device (DMD) through a color wheel. The DMD controls whether to reflect the colored light toward the screen of the AR display device. DLP projectors generate color for the human eye by cycling through (R)ed, (G)reen, and (B)lue b