KR-102961732-B1 - Augmented Reality Object Registry

KR102961732B1KR 102961732 B1KR102961732 B1KR 102961732B1KR-102961732-B1

Abstract

Various embodiments provide a registry of augmented reality (AR) objects capable of providing AR objects to a client device to support various software or hardware applications. For example, some embodiments provide an AR object registry that enables or facilitates the registration of one or more AR objects in association with one or more locations across the globe.

Inventors

파운즈, 제니카
밀스, 브렌트
로엔그렌, 울프 오스카 미셸

Assignees

스냅 인코포레이티드

Dates

Publication Date: 20260507
Application Date: 20201222
Priority Date: 20191231

Claims (20)

As a method, A step of receiving a query for one or more augmented reality objects from a first client device by a query server—the query includes a current set of coordinates corresponding to the location of the first client device on a map—; In response to the above inquiry, A step of determining a set of augmented reality objects based on the above query by the above query server - the set of augmented reality objects is determined from a plurality of registered augmented reality objects registered in an augmented reality object registry -; and A step of transmitting a query result to the first client device by the above query server - the query result includes result data for the set of augmented reality objects -; A step of receiving a request from the first client device for a first user at the first client device to interact with at least one augmented reality object within the set of augmented reality objects; and In response to the above request, A step of determining a given session server to service the request by a mapping server—the given session server is determined from a plurality of session servers operating on a first set of computer devices, the first set of computer devices is separate from a second set of computer devices operating the mapping server, the given session server is associated with a geographical partition of the map, and the geographical partition includes the location of the first client device on the map—; and A step of assigning the first client device to a given session operating on the given session server by the mapping server - the given session is for interacting with at least one augmented reality object - A method including
In paragraph 1, The above query is a method that further includes a radius for the current set of the above coordinates.
In paragraph 1, The above result data includes a currently stored state of at least one augmented reality object, and the currently stored state determines an initial state of the at least one augmented reality object for the first user on the first client device.
In paragraph 1, A method wherein the given session maintains a session state for at least one augmented reality object for one or more users associated with the given session, and the session state is updated based on the interaction between at least one of the one or more users and the at least one augmented reality object.
In paragraph 4, A method in which the session state is initialized based on the current stored state of at least one augmented reality object.
In paragraph 4, A method further comprising the step of storing a final version of the session state of at least one augmented reality object at the end of the given session by the given session server.
In paragraph 1, The above request is for a plurality of users to interact with the at least one augmented reality object, and the plurality of users include the first user on the first client device and the second user on the second client device, and The above method further comprises the step of assigning the second client device to the given session operating on the given session server by the mapping server in response to the above request, wherein the given session is for the first user and the second user to interact with the at least one augmented reality object.
In paragraph 1, The step of assigning the first client device to the given session operating on the given session server includes the step of redirecting the first client device from the mapping server to the given session server. The above method further comprises the step of establishing a network connection between the first client device and the given session on the given session server by the given session server.
In paragraph 1, A method in which the above result data includes model data for each augmented reality object within the set of augmented reality objects.
In paragraph 1, The above result data includes rule data describing a set of interaction rules associated with a set of augmented reality objects, and the set of interaction rules determines interactions available to a first user on a first client device for the set of augmented reality objects.
In Paragraph 10, A method in which the above augmented reality object registry associates a set of the above augmented reality objects with a set of the above interaction rules.
In paragraph 1, A method comprising, for each augmented reality object within a set of augmented reality objects, location data describing a given set of coordinates on a map to be displayed by a given client device when a given client device generates an augmented reality view for a given set of coordinates.
In paragraph 1, A method in which the augmented reality object registry associates each of the augmented reality objects within the plurality of registered augmented reality objects with a given set of coordinates on a map to be displayed by the given client device when the given client device generates an augmented reality view for a given set of coordinates.
In paragraph 1, A method comprising the above result data including orientation data describing a given orientation in which a given client device displays the augmented reality object when the given client device generates an augmented reality view including the augmented reality object for each augmented reality object in the set of augmented reality objects.
In paragraph 1, The above augmented reality object registry is a method for associating each augmented reality object within the plurality of registered augmented reality objects with a given orientation in which the given client device displays the augmented reality object when the given client device generates an augmented reality view including the augmented reality object.
In paragraph 1, A step of receiving a request from a second client device associated with a second user to register a given augmented reality object in the augmented reality object registry in association with a given set of coordinates on the map; A step of determining, based on permission data, whether the second user has permission to register the given augmented reality object in association with a given set of coordinates on the map, wherein the permission data describes an association between at least one set of coordinates on the map and a set of permissions; and A step of registering the given augmented reality object on the augmented reality object registry in association with a given set of coordinates, based on determining whether the second user has permission. A method that further includes.
In Paragraph 16, A method in which the above permission data is associated with a marked area of the map containing a given set of the above coordinates.
A non-transient machine-readable medium storing instructions that cause one or more computer processors to perform operations when executed by one or more computer processors of a first set of computer devices, wherein the operations are Receiving a query for one or more augmented reality objects from a client device - said query includes a current set of coordinates corresponding to the location of said client device on a map -; In response to the above inquiry, Determining a set of augmented reality objects based on the above query - the set of augmented reality objects is determined from a plurality of registered augmented reality objects registered in an augmented reality object registry -; and Transmitting the query result to the above client device - the above query result includes result data for the set of the above augmented reality objects -; Receiving a request from the client device for a user at the client device to interact with at least one augmented reality object within the set of augmented reality objects; and In response to the above request, Determining a given session server to service the above request—the given session server is determined from a plurality of session servers operating on a second set of computer devices, the second set of computer devices is separate from the first set of computer devices, the given session server is associated with a geographical partition of the map, and the geographical partition includes the location of the client device on the map—; and Assigning the above client device to a given session running on the above given session server - the given session is for interacting with at least one augmented reality object - A non-transient machine-readable medium comprising
As a system, Query server; A plurality of session servers operating on a first set of computing devices; and A mapping server operating on a second set of computing devices separate from the first set of computing devices mentioned above. Includes, The above query server is, Receiving a query for one or more augmented reality objects from a client device - said query includes a current set of coordinates corresponding to the location of said client device on a map -; In response to the above inquiry, Determine a set of augmented reality objects based on the above query - the set of augmented reality objects is determined from a plurality of registered augmented reality objects registered in the augmented reality object registry -; Transmitting the query result to the above client device - the query result includes result data for the set of the above augmented reality objects -; Each session server runs one or more sessions to support user interactions with one or more augmented reality objects; The above mapping server is, From the client device, a request is received for a user at the client device to interact with at least one augmented reality object within the set of augmented reality objects; In response to the above request, Among the plurality of session servers, a given session server to service the request is determined - the given session server is associated with a geographic partition of the map, and the geographic partition includes the location of the client device on the map -; Assigns the above client device to a given session running on the above given session server, and A system in which the given session is intended to interact with at least one augmented reality object.
In Paragraph 18, Assigning the client device to a given session running on the given session server includes redirecting the client device from the mapping server to the given session server, and the operations are: A non-transient machine-readable medium further comprising establishing a network connection between the client device and the given session on the given session server by the given session server.

Description

Augmented Reality Object Registry Claim of priority This patent application claims the benefit of priority to U.S. Application No. 16/731,821 filed on December 31, 2019, the entirety of which is incorporated herein by reference. The embodiments described herein relate to augmented reality, and more specifically, to systems, methods, devices, and instructions for a registry of augmented reality objects capable of supporting mixed reality, but are not limited thereto. Currently, geospatial databases can be used to provide three-dimensional (3D) geospatial maps of the world to mobile devices. Typically, mobile devices such as smartphones use the Global Positioning System (GPS) to standardly associate the mobile device with a coordinate location on Earth, and the coordinate location can be used to query the geospatial database for 3D map data. For example, given a center point for the coordinate location of a mobile device, the geospatial database can be queried to obtain all data regarding 3D map objects within a specific radius of that center point, or to obtain data regarding the 3D map objects closest to that center point. Various of the attached drawings are merely illustrative of some embodiments of the present disclosure and should not be construed as limiting the scope thereof. The drawings are not necessarily drawn to scale. To facilitate the identification of any specific element or operation, the highest number or number in the reference numerals refers to the drawing number where the element was first introduced, and similar numbers may describe similar components in different drawings. FIG. 1 is a block diagram illustrating an exemplary system for exchanging data (e.g., related to AR objects) through a network, which may include an augmented reality (AR) object system according to some embodiments. FIG. 2 is a block diagram illustrating an exemplary logical architecture for an AR object system according to some embodiments. FIG. 3 is a block diagram illustrating an example of an AR object interactive session service according to some embodiments. FIG. 4 is a flowchart illustrating an example of session processing by an AR object interactive session service according to some embodiments. FIG. 5 is a flowchart illustrating an example of using one or more rankers to provide one or more AR objects to a client device according to some embodiments. FIG. 6 is a block diagram illustrating an exemplary implementation of an AR object system according to some embodiments. FIGS. 7 to 13 are flowcharts illustrating methods related to an AR object registry according to some embodiments. FIG. 14 is a block diagram illustrating a representative software architecture that can be used with various hardware architectures described in this specification. FIG. 15 is a block diagram illustrating components of a machine according to some embodiments capable of reading instructions from a machine-readable medium (e.g., a machine-readable storage medium) and performing any one or more of the methodologies discussed herein. Various embodiments provide systems, methods, devices, and instructions for a registry of augmented reality objects that can provide augmented reality objects to a client device to support various software or hardware applications (e.g., mixed reality software applications). For example, some embodiments provide an augmented reality (AR) object registry that facilitates or enables the registration of one or more AR objects in association with one or more locations across the globe (e.g., on a world scale). For example, the AR object registry may enable associations between one or more AR objects and one or more locations or physical objects on the globe. By doing so, such an AR object registry may allow a user to explore AR objects at any location on the globe using the client device. Additionally, the AR object registry described herein may also support or enable the implementation of a space-based (e.g., augmented reality-based) World Wide Web. The architecture of some embodiments described herein allows for scaling to service AR object registrations in relation to locations across the globe, and allows for scaling to provide or support interactive sessions that enable a large number of users across the world (e.g., a large number of users) to interact with the registered AR objects. In some embodiments, the AR registry of the embodiment may associate (e.g., integrate) topology map data (e.g., of the globe) with AR object data to bring real-world information into a virtual model, which enables the scalability of the AR registry. In addition, some embodiments implement one or more rankers or ranker mechanisms (e.g., ranker algorithms) to determine which AR objects are provided to a client device (e.g., by filtering or sorting) (e.g., in response to a request/query for AR objects from a client device). In this way, these embodiments may affect which AR objects are displayed or surfaced by the client devi