US-12626443-B2 - Integrating augmented reality into the web view platform

Abstract

A methodology is described that provides access to an augmented reality (AR) component maintained by a messaging server system directly from a web view application. When a user activates, from a web view application executing in the messaging client, a user selectable element that references an AR component, a web view AR system obtains the identification of the AR component, performs validation of the identification and of any additional launch data, and launches a camera view user interface (UI) with the AR component loaded in the camera view UI. Content captured from the camera view UI can be shared to other computing devices.

Inventors

• Virgil L. Archer, III
• Kyle Dumo
• Allen Huang
• Ngoan Nguyen
• Bernardo Perez
• Aung Win Thein

Assignees

• SNAP INC.

Dates

Publication Date

20260512

Application Date

20240808

Claims (20)

1. 1 . A method comprising: loading a web view application in a web view provided by an embedded web browser of a message application executing at a computing device, the web view including a user selectable element; and in response to activation of the user selectable element, loading an augmented reality (AR) component in a camera view user interface (UI) of the message application, the camera view UI including an output of a digital image sensor of a camera and a shutter user selectable element actionable to capture the output of the digital image sensor of the camera, the AR component configured to apply a modification to a content item, the loading of the AR component in the camera view UI comprising applying the modification to the output of the digital image sensor.
2. 2 . The method of claim 1 , further comprising: capturing the output of the digital image sensor of the camera as augmented by the modification to create captured content; and in response to detecting a request at the message application to share the captured content: generating shared content by including, with the captured content, a web view application launch component configured to launch the web view application; and communicating the shared content to a recipient computing device.
3. 3 . The method of claim 2 , further comprising: in response to the communicating of the shared content to the recipient computing device, loading the web view application in a recipient message application executing at the recipient computing device.
4. 4 . The method of claim 2 , further comprising: in a recipient message application executing at the recipient computing device: rendering the shared content on a display device; detecting a user-initiated action with respect to the shared content; and in response to the user-initiated action, loading the web view application in the web view provided by the embedded web browser of the recipient message application executing at the recipient computing device.
5. 5 . The method of claim 4 , wherein the user-initiated action is a swipe gesture.
6. 6 . The method of claim 1 , further comprising: at the message application executing at the computing device, decrypting a payload of a deep link included in the web view application to obtain an AR component identifier; and providing the AR component identifier to a validation service executing at a backend, wherein the loading of the AR component in the camera view UI is performed in response to successful validation of the AR component identifier.
7. 7 . The method of claim 1 , wherein the AR component is configured to apply the modification according to values of one or more attributes, wherein the values are obtained from the web view application.
8. 8 . The method of claim 1 , wherein the camera view user interface excludes additional AR components beyond the AR component.
9. 9 . The method of claim 1 , wherein the modification comprises adding animation to the content item.
10. 10 . The method of claim 1 , wherein the web view application is provided by a distinct entity from the message application.
11. 11 . A system comprising: one or more processors; and a non-transitory computer readable storage medium comprising instructions that when executed by the one or processors cause the one or more processors to perform operations comprising: loading a web view application in a web view provided by an embedded web browser of a message application executing at a computing device, the web view including a user selectable element; and in response to activation of the user selectable element, loading an augmented reality (AR) component in a camera view user interface (UI) of the message application, the camera view UI including an output of a digital image sensor of a camera and a shutter user selectable element actionable to capture the output of the digital image sensor of the camera, the AR component configured to apply a modification to a content item, the loading of the AR component in the camera view UI comprising applying the modification to the output of the digital image sensor.
12. 12 . The system of claim 11 , wherein the operations further include: capturing the output of the digital image sensor of the camera as augmented by the modification to create captured content; and in response to detecting a request at the message application to share the captured content: generating shared content by including, with the captured content, a web view application launch component configured to launch the web view application; and communicating the shared content to a recipient computing device.
13. 13 . The system of claim 12 , wherein the operations further include: in response to the communicating of the shared content to the recipient computing device, loading the web view application in a recipient message application executing at the recipient computing device.
14. 14 . The system of claim 12 , wherein the operations further include: in a recipient message application executing at the recipient computing device: rendering the shared content on a display device; detecting a user-initiated action with respect to the shared content; and in response to the user-initiated action, loading the web view application in the web view provided by the embedded web browser of the recipient message application executing at the recipient computing device.
15. 15 . The system of claim 14 , wherein the user-initiated action is a swipe gesture.
16. 16 . The system of claim 11 , wherein the operations further include: at the message application executing at the computing device, decrypting a payload of a deep link included in the web view application to obtain an AR component identifier; and providing the AR component identifier to a validation service executing at a backend, wherein the loading of the AR component in the camera view UI is performed in response to successful validation of the AR component identifier.
17. 17 . The system of claim 11 , wherein the AR component is configured to apply the modification according to values of one or more attributes, wherein the values are obtained from the web view application.
18. 18 . The system of claim 11 , wherein the camera view user interface excludes additional AR components beyond the AR component.
19. 19 . The system of claim 11 , wherein the modification comprises adding animation to the content item.
20. 20 . A machine-readable non-transitory storage medium having instruction data executable by a machine to cause the machine to perform operations comprising: loading a web view application in a web view provided by an embedded web browser of a message application executing at a computing device, the web view including a user selectable element; and in response to activation of the user selectable element, loading an augmented reality (AR) component in a camera view user interface (UI) of the message application, the camera view UI including an output of a digital image sensor of a camera and a shutter user selectable element actionable to capture the output of the digital image sensor of the camera, the AR component being configured to apply a modification to a content item, the loading of the AR component in the camera view UI comprising applying the modification to the output of the digital image sensor.

Description

CLAIM OF PRIORITY This application is a continuation of U.S. patent application Ser. No. 17/359,843, filed Jun. 28, 2021, which is incorporated herein by reference in its entirety. TECHNICAL FIELD The present disclosure relates generally to facilitating interactions between a messaging client and third-party resources. BACKGROUND The popularity of computer-implemented programs that permit users to access and interact with content and other users online continues to grow. Various computer-implemented applications exist that permit users to share content with other users through messaging clients. Some of such computer-implemented applications, termed apps, can be designed to run on a mobile device such as a phone, a tablet, or a wearable device, while having a backend service provided on a server computer system to perform operations that may require resources greater than is reasonable to perform at a client device (e.g., storing large amounts of data or performing computationally expensive processing). For example, a messaging client and the associated messaging system that hosts a backend for the messaging client may be configured to permit online users to share content. A messaging client may include an embedded web browser, which is termed a web view. A web view is configured to display web content, such as web pages and web applications, from within the messaging client. BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. To easily identify the discussion of any particular element or act, the most significant digit or digits in a reference number refer to the figure number in which that element is first introduced. Some examples are illustrated by way of example, and not limitation, in the figures of the accompanying drawings in which: FIG. 1 is a diagrammatic representation of a networked environment in which a developer tools system may be deployed, in accordance with some examples. FIG. 2 is a diagrammatic representation of a messaging system, in accordance with some examples, that has both client-side and server-side functionality. FIG. 3 is a diagrammatic representation of a data structure as maintained in a database, in accordance with some examples. FIG. 4 is a diagrammatic representation of a message, in accordance with some examples. FIG. 5 is a flowchart for an access-limiting process, in accordance with some examples. FIG. 6 is a flowchart of a method for providing integration of web view applications with augmented reality components, in accordance with some examples. FIG. 7 is a diagrammatic representation of a web view application screen, in accordance with some examples. FIG. 8 is a diagrammatic representation of a camera view UI with an AR component loaded, in accordance with some examples. FIG. 9 is a diagrammatic representation of a recipient view of content captured using an AR component loaded directly from a web view application, in accordance with some examples. FIG. 10 is a diagrammatic representation of a machine in the form of a computer system within which a set of instructions may be executed for causing the machine to perform any one or more of the methodologies discussed herein, in accordance with some examples. FIG. 11 is a block diagram showing a software architecture within which examples may be implemented. DETAILED DESCRIPTION Examples of the present disclosure seek to improve the functionality of electronic messaging software and systems by enhancing users' experience of engaging with augmented reality (AR) technology. AR technology enhances/augments a user's view of a physical environment, which can be experienced by viewing of the output of the digital image sensor of a camera for example, by adding computer-generated perceptual information. A computer implemented component that provides a particular AR functionality, for example a modification in the form of an overlaid image or animation, is referred to as an AR component, for the purposes of this description. The users' experience of engaging with AR technology is enhanced by permitting users to access functionality of an AR component directly from an application executing in a web view of the messaging client. An application executing in a web view of the messaging client is referred to as a web view application, for the purposes of this description. The technical problem of facilitating access to an AR component directly from a web view application is addressed by providing a web view AR system configured to load an AR component directly from a web view application. The web view AR system encompass various components that are being engaged in the process of permitting a user to access an AR component directly from a web view application, as well as components that are used in generating content captured using an AR component assessed directly from a web view application, generating a m