US-20260127660-A1 - PROVIDING AUGMENTED REALITY-BASED CLOTHING IN A MESSAGING SYSTEM

US20260127660A1US 20260127660 A1US20260127660 A1US 20260127660A1US-20260127660-A1

Abstract

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content for clothing. The program and method provide for receiving a request to present augmented reality content in association with an image depicting a body part of a user; accessing an augmented reality content item corresponding to an article of clothing, the augmented reality content being configured to track plural points of the body part and to generate a transform based on the plural points, the transform corresponding to the article of clothing and defining plural regions for the article of clothing; presenting the augmented reality content item in association with the body part; receiving user input selecting a region; determining a set of options corresponding to the region; and updating presentation of the augmented reality content item based on the set of options.

Inventors

Riccardo Boscolo
Jean Luo
Vincent Sung
Ibram Uppal

Assignees

SNAP INC.

Dates

Publication Date: 20260507
Application Date: 20260106

Claims (20)

1 . A method, comprising: receiving, by a messaging application running on a device of a user, a request to activate an augmented reality content item in association with an image captured by a device camera, the image depicting a body part of the user; activating, in response to receiving the request, the augmented reality content item, wherein the augmented reality content item is a real-time special effect which is applied to the image and which simulates trying on an article of clothing for the body part while simultaneously applying a face effect to a face of the user, and wherein the augmented reality content item is configured to track plural points of the body part and to generate a transform based on the plural points, the transform corresponding to the article of clothing and defining plural regions on the article of clothing; based on activating the augmented reality content item, detecting a facial landmark within the face of the user, the facial landmark representing a distinguishable point present in a plurality of faces, and displaying, within a first user interface and further based on detecting the facial landmark, the face effect applied to the face captured by the device camera simultaneously with a representation of the article of clothing, the face effect being separate from the representation of the article of clothing; prompting the user to direct the device camera to the body part in order to capture the image depicting the body part of the user; causing the augmented reality content item to track the plural points to generate the transform; receiving first user input selecting a region of the plural regions; determining a set of options corresponding to the selected region, the set of options for customizing the selected region; and updating presentation of the augmented reality content item based on the set of options.
2 . The method of claim 1 , wherein presenting the augmented reality content item comprises displaying an outline for each of the plural regions.
3 . The method of claim 1 , further comprising: displaying a selection interface element for selecting an option from the set of options.
4 . The method of claim 3 , wherein updating presentation of the augmented reality content item comprises: receiving, via the selection interface element, second user input selecting the option from the set of options; and displaying an overlay corresponding to the selected option at the selected region, such that the selected option is depicted as being applied to the selected region.
5 . The method of claim 4 , further comprising: receiving third user input to add the article of clothing with the selected option to a shopping cart associated with a user account of the user; and providing, in response to receiving the third user input, for updating the shopping cart based on the article of clothing with the selected option.
6 . The method of claim 1 , wherein the article of clothing corresponds to eyewear.
7 . The method of claim 1 , further comprising: displaying, by the messaging application, a carousel interface for selecting the augmented reality content item from among plural augmented reality content items; and receiving, via the carousel interface, user selection of the augmented reality content item from among the plural augmented reality content items, wherein the request corresponds to the user selection.
8 . The method of claim 1 , wherein the transform is configured to track movement of the body part and to move along with the body part, to simulate the user trying on the article of clothing for the body part.
9 . The method of claim 1 , wherein the augmented reality content item is configured to determine a size of the body part and distances between predefined points of the body part, in order to generate the transform.
10 . The method of claim 1 , further comprising: presenting, using the augmented reality content item, a questionnaire to determine preferences of the user in order to select the article of clothing.
11 . The method of claim 10 , wherein selecting the article of clothing is further based on one or more keywords which are assigned to the article of clothing and which are sponsored by a third-party entity.
12 . A device comprising: at least one processor; and a memory storing instructions that, when executed by the at least one processor, configure the at least one processor to perform operations comprising: receiving, by a messaging application running on the device, a request to activate an augmented reality content item in association with an image captured by a device camera, the image depicting a body part of a user of the device; activating, in response to receiving the request, the augmented reality content item, wherein the augmented reality content item is a real-time special effect which is applied to the image and which simulates trying on an article of clothing for the body part while simultaneously applying a face effect to a face of the user, and wherein the augmented reality content item is configured to track plural points of the body part and to generate a transform based on the plural points, the transform corresponding to the article of clothing and defining plural regions on the article of clothing; based on activating the augmented reality content item, detecting a facial landmark within the face of the user, the facial landmark representing a distinguishable point present in a plurality of faces, and displaying, within a first user interface and further based on detecting the facial landmark, the face effect applied to the face captured by the device camera simultaneously with a representation of the article of clothing, the face effect being separate from the representation of the article of clothing; prompting the user to direct the device camera to the body part in order to capture the image depicting the body part of the user; causing the augmented reality content item to track the plural points to generate the transform; receiving first user input selecting a region of the plural regions; determining a set of options corresponding to the selected region, the set of options for customizing the selected region; and updating presentation of the augmented reality content item based on the set of options.
13 . The device of claim 12 , wherein presenting the augmented reality content item comprises displaying an outline for each of the plural regions.
14 . The device of claim 12 , the operations further comprising: displaying a selection interface element for selecting an option from the set of options.
15 . The device of claim 14 , wherein updating presentation of the augmented reality content item comprises: receiving, via the selection interface element, second user input selecting the option from the set of options; and displaying an overlay corresponding to the selected option at the selected region, such that the selected option is depicted as being applied to the selected region.
16 . The device of claim 15 , the operations further comprising: receiving third user input to add the article of clothing with the selected option to a shopping cart associated with a user account of the user; and providing, in response to receiving the third user input, for updating the shopping cart based on the article of clothing with the selected option.
17 . The device of claim 12 , wherein the article of clothing corresponds to eyewear.
18 . The device of claim 12 , the operations further comprising: displaying, by the messaging application, a carousel interface for selecting the augmented reality content item from among plural augmented reality content items; and receiving, via the carousel interface, user selection of the augmented reality content item from among the plural augmented reality content items, wherein the request corresponds to the user selection.
19 . The device of claim 12 , wherein the transform is configured to track movement of the body part and to move along with the body part, to simulate the user trying on the article of clothing for the body part.
20 . A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising: receiving, by a messaging application running on a device of a user, a request to activate an augmented reality content item in association with an image captured by a device camera, the image depicting a body part of the user; activating, in response to receiving the request, the augmented reality content item, wherein the augmented reality content item is a real-time special effect which is applied to the image and which simulates trying on an article of clothing for the body part while simultaneously applying a face effect to a face of the user, and wherein the augmented reality content item is configured to track plural points of the body part and to generate a transform based on the plural points, the transform corresponding to the article of clothing and defining plural regions on the article of clothing; based on activating the augmented reality content item, detecting a facial landmark within the face of the user, the facial landmark representing a distinguishable point present in a plurality of faces, and displaying, within a first user interface and further based on detecting the facial landmark, the face effect applied to the face captured by the device camera simultaneously with a representation of the article of clothing, the face effect being separate from the representation of the article of clothing; prompting the user to direct the device camera to the body part in order to capture the image depicting the body part of the user; causing the augmented reality content item to track the plural points to generate the transform; receiving first user input selecting a region of the plural regions; determining a set of options corresponding to the selected region, the set of options for customizing the selected region; and updating presentation of the augmented reality content item based on the set of options.

Description

CROSS-REFERENCE TO RELATED APPLICATION This patent application is a continuation of U.S. patent application Ser. No. 17/476,065, filed Sep. 15, 2021, which application claims the benefit of U.S. Provisional Patent Application No. 63/198,076 , filed Sep. 28, 2020, entitled “PROVIDING AUGMENTED REALITY-BASED CLOTHING IN A MESSAGING SYSTEM”, which is incorporated by reference herein in its entirety. TECHNICAL FIELD The present disclosure relates generally to a messaging system, including providing augmented reality content with a captured image. BACKGROUND Messaging systems provide for the exchange of message content between users. For example, a messaging system allows a user to exchange message content (e.g., text, images) with one or more other users. BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. To easily identify the discussion of any particular element or act, the most significant digit or digits in a reference number refer to the figure number in which that element is first introduced. Some nonlimiting examples are illustrated in the figures of the accompanying drawings in which: FIG. 1 is a diagrammatic representation of a networked environment in which the present disclosure may be deployed, in accordance with some examples. FIG. 2 is a diagrammatic representation of a messaging system, in accordance with some examples, that has both client-side and server-side functionality. FIG. 3 is a diagrammatic representation of a data structure as maintained in a database, in accordance with some examples. FIG. 4 is a diagrammatic representation of a message, in accordance with some examples. FIG. 5 is an interaction diagram illustrating a process for providing augmented reality-based clothing in a messaging system, in accordance with some example embodiments. FIG. 6A illustrates an example user interface for displaying an article of clothing with selectable regions, in accordance with some example embodiments. FIG. 6B illustrates an example user interface for displaying an article of clothing with a selected option, in accordance with some example embodiments. FIG. 6C illustrates an example user interface in which an article of clothing with a selected option is displayed as an overlay with respect to a captured image, in accordance with some example embodiments. FIG. 7A illustrates an example user interface for displaying packaging for an article of clothing, in accordance with some example embodiments. FIG. 7B illustrates an example user interface for displaying packaging together with prompting a user to direct a device camera to a body part to visualize wearing the article of clothing, in accordance with some example embodiments. FIG. 8A illustrates an example user interface in which an article of clothing with selectable regions is displayed as an overlay with respect to a captured image, in accordance with some example embodiments. FIG. 8B illustrates an example user interface in which an article of clothing is further displayed with selectable regions as an overlay within a captured image, in accordance with some example embodiments. FIG. 9A illustrates an example user interface relating to a questionnaire for determining an article of clothing, in accordance with some example embodiments. FIG. 9B illustrates an example user interface with additional question(s) for determining an article of clothing, in accordance with some example embodiments. FIG. 9C illustrates an example user interface with additional question(s) for determining an article of clothing, in accordance with some example embodiments. FIG. 10A illustrates an example user interface for user selection of an article of clothing based on questionnaire responses, in accordance with some example embodiments. FIG. 10B illustrates an example user interface for displaying a user-selected article of clothing based on questionnaire responses, in accordance with some example embodiments. FIG. 10C illustrates an example user interface in which an article of clothing selected based on questionnaire responses is displayed as an overlay with respect to a captured image, in accordance with some example embodiments. FIG. 11 is a flowchart illustrating a process for providing augmented reality-based clothing in a messaging system, in accordance with some example embodiments. FIG. 12 is a flowchart for an access-limiting process, in accordance with some examples. FIG. 13 is a diagrammatic representation of a machine in the form of a computer system within which a set of instructions may be executed for causing the machine to perform any one or more of the methodologies discussed herein, in accordance with some examples. FIG. 14 is a block diagram showing a software architecture within which examples may be implemented. DETAILED DESCRIPTION A messaging system typically allow users to exchange content items (e.g., messages, im