JP-2022533207-A5 -

Dates

Publication Date

20230530

Application Date

20200521

Description

The above summary is provided for illustrative purposes only and is not intended to be limiting. The present invention provides, for example, the following: (Item 1) A portable electronic system, A sensor configured to capture three-dimensional (3D) information about an object in the physical world, Active memory and Local memory and A transceiver, wherein the transceiver is configured for communication with a remote memory via a computer network, A processor, wherein the processor is communicatively coupled to the sensor, the active memory, the local memory, and the transceiver, executes computer executable instructions, and is configured to provide a 3D representation of a part of the physical world based at least in part on 3D information about objects in the physical world. Equipped with, The 3D representation of a part of the physical world comprises multiple blocks, each block having a value representing an object in a region of the physical world at a given point in time. The aforementioned computer executable instructions are: When the portable electronic system changes to an inactive operating status, the plurality of blocks remain in at least one of the active memory, the local memory, and the remote memory. A portable electronic system equipped with commands for use. (Item 2) The portable electronic system described in item 1, wherein the inactive operating status is shutdown or sleep. (Item 3) To keep the plurality of blocks residing in at least one of the active memory, the local memory, and the remote memory is to When the inactive operation status is sleep, the plurality of blocks remain in the separate memory where they currently reside so that they can be accessed by the portable electronic system in response to the wake-up of the portable electronic system. Portable electronic systems as described in item 2, including the one described in item 2. (Item 4) To keep the plurality of blocks residing in at least one of the active memory, the local memory, and the remote memory is to When the inactive operation status is shutdown, at least a portion of the blocks in the local memory remain in the remote memory, and the blocks in the active memory remain in the local memory and/or the remote memory. Portable electronic systems as described in item 2, including the one described in item 2. (Item 5) The aforementioned computer executable instructions are: At least partially, the calculation of one or more new blocks based on incoming 3D information about the objects in the physical world, Selecting blocks from the surviving blocks that at least partially overlap with the one or more new blocks, so that the surviving blocks surrounding the portable electronic system can be read out. A portable electronic system as described in item 1, equipped with instructions for performing the following actions. (Item 6) The portable electronic system according to item 5, wherein selecting blocks from the existing blocks that at least partially overlap with the one or more new blocks includes comparing the one or more new blocks with the existing blocks. (Item 7) Comparing the one or more new blocks with the existing blocks is, Comparing the one or more new blocks with the blocks that remain in the active memory. Portable electronic systems as described in item 6, including: (Item 8) Comparing the one or more new blocks with the existing blocks is, When the active memory does not have any blocks that at least partially overlap with the one or more new blocks, compare the one or more new blocks with the blocks that remain in the local memory. A portable electronic system as described in item 7, including the one described in item 7. (Item 9) Comparing the one or more new blocks with the existing blocks is, When the local memory does not have any blocks that at least partially overlap with the one or more new blocks, compare the one or more new blocks with the blocks that remain in the remote memory. A portable electronic system as described in item 8, including the one described in item 8. (Item 10) The aforementioned computer executable instructions are: The plurality of blocks are updated with one or more new blocks. A portable electronic system as described in item 5, equipped with instructions for use. (Item 11) A method for operating a portable electronic system within an augmented reality system, wherein the method is Using at least one processor, Obtaining multiple blocks that contain three-dimensional (3D) information about surfaces in the physical world, Storing at least one of the aforementioned multiple blocks in active memory, To render virtual content to the user of the portable electronic system, blocks from the active memory are used, In response to the transition to an inactive operation status during the first time period, the block is kept in active memory, In response to the transition to an active operation status at a second time after the first time period, it is determined whether to use the