Search

CN-122029573-A - Applying augmented reality animation to an image

CN122029573ACN 122029573 ACN122029573 ACN 122029573ACN-122029573-A

Abstract

Methods and systems for applying augmented reality animation to an image are disclosed. The methods and systems access an image and select an Augmented Reality (AR) experience to apply to the image, the AR experience including one or more AR element animations. The method and system repeatedly apply an AR experience to an image over a specified time interval to superimpose one or more AR element animations on the image. The method and system generate a video having a duration corresponding to a specified time interval in response to repeatedly applying an AR experience to an image, the video depicting one or more AR element animations on the image.

Inventors

  • AN XIN
  • Jim T. Dipu
  • Jacob Klipping
  • Matthew mahal
  • Tony matthew
  • SHANG WENTAO
  • Sarah Weirum
  • ZHANG LINGZHI

Assignees

  • 斯纳普公司

Dates

Publication Date
20260512
Application Date
20241007
Priority Date
20231212

Claims (20)

  1. 1.A method, comprising: Accessing, by one or more processors of the device, the image; selecting an Augmented Reality (AR) experience to apply to the image, the AR experience comprising one or more AR element animations; Repeatedly applying the AR experience to the image over a specified time interval to superimpose the one or more AR element animations on the image, and Generating a video having a duration corresponding to the specified time interval in response to repeatedly applying the AR experience to the image, the video depicting the one or more AR element animations on the image.
  2. 2. The method of claim 1, further comprising: Performing a first iteration of applying the AR experience to the image, the first iteration comprising: processing the image to detect one or more real world objects depicted in the image, and The one or more AR element animations are positioned at a first location on the image based on the detected locations of one or more real world objects depicted in the image.
  3. 3. The method of any of claims 1-2, further comprising: Performing a second iteration of applying the AR experience to the image after performing the first iteration, the second iteration comprising: Processing the image to re-detect the one or more real world objects depicted in the image, and Moving the one or more AR element animations to a second position on the image based on the re-detected positions of the one or more real world objects depicted in the image.
  4. 4. A method according to any one of claims 1 to 3, further comprising tracking the one or more real world objects in the image.
  5. 5. The method of any of claims 1-4, wherein the AR experience is selected in response to an input interacting with a first icon representing the AR experience, the first icon being presented in a list of icons.
  6. 6. The method of any one of claims 1 to 5, further comprising: an input is received to set a value for the specified time interval.
  7. 7. The method of any one of claims 1 to 6, further comprising: when no input for the specified time interval setting value is received, the specified time interval is set to a default value.
  8. 8. The method of any of claims 1 to 7, further comprising: Receiving input selecting one or more modifications for the image, and The one or more modifications are applied to the image along with the one or more AR element animations superimposed on the image.
  9. 9. The method of claim 8, wherein the one or more modifications comprise at least one of static or animated graphical elements, text, or additional images.
  10. 10. The method of any of claims 1-9, the AR experience being a first AR experience, further comprising: Receiving input selecting a second AR experience, and In response to receiving the input, repeatedly applying the second AR experience to the image over the specified time interval to superimpose one or more second AR element animations on the image instead of superimposing the one or more AR element animations of the first AR experience.
  11. 11. The method of any one of claims 1 to 10, further comprising: audio associated with the AR experience is disabled in response to determining that the AR experience is being repeatedly applied to the image.
  12. 12. The method of any of claims 1-11, wherein the AR experience is automatically repeatedly applied to generate the video in response to receiving input to access the image.
  13. 13. The method of any one of claims 1 to 12, further comprising: Accessing metadata associated with the AR experience; determining that the metadata indicates that the AR experience includes animation, and Repeated application of the AR experience to the image is performed in response to determining that the metadata indicates that the AR experience includes the animation.
  14. 14. The method of any of claims 1 to 13, wherein the image comprises a single image captured from a real-time video stream.
  15. 15. The method of any one of claims 1 to 14, further comprising: Receiving a request to access a library of content items, and In response to receiving the request, a plurality of thumbnails associated with the content item are presented, the plurality of thumbnails including individual thumbnails associated with the video.
  16. 16. The method of claim 15, further comprising: receiving a request for previewing the individual thumbnail, and In response to receiving the request for previews, rendering in the image without overlaying the one or more AR element animations.
  17. 17. The method of any one of claims 1 to 16, further comprising: receiving a request to edit the individual thumbnail images, and In response to receiving the request to edit: identifying the AR experience associated with the image, and The AR experience is repeatedly applied to the image to again superimpose the one or more AR element animations on the image.
  18. 18. The method of claim 17, further comprising: metadata associated with the image is stored, the metadata indicating that the image is associated with the AR experience.
  19. 19. A system, comprising: at least one processor, and At least one memory component storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations further comprising: accessing an image; selecting an Augmented Reality (AR) experience to apply to the image, the AR experience comprising one or more AR element animations; Repeatedly applying the AR experience to the image over a specified time interval to superimpose the one or more AR element animations on the image, and Generating a video having a duration corresponding to the specified time interval in response to repeatedly applying the AR experience to the image, the video depicting the one or more AR element animations on the image.
  20. 20. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising: accessing an image; selecting an Augmented Reality (AR) experience to apply to the image, the AR experience comprising one or more AR element animations; Repeatedly applying the AR experience to the image over a specified time interval to superimpose the one or more AR element animations on the image, and Generating a video having a duration corresponding to the specified time interval in response to repeatedly applying the AR experience to the image, the video depicting the one or more AR element animations on the image.

Description

Applying augmented reality animation to an image Priority claim The present application claims the priority of U.S. provisional application serial No. 63/590,303 filed on day 2023, 10 and 13 and U.S. patent application serial No. 18/537,381 filed on day 2023, 12, which are incorporated herein by reference in their entirety. Technical Field The present disclosure relates generally to generating content items using an augmented reality (XR) experience. Background Interactive applications are typically used to capture and store various content items, such as images, audio clips, and video. These content items are typically shared among users in various forms. Some of these content items are placed in a collection for viewing by a recipient as a playlist. This is often referred to as a story (e.g., a collection of content items). Drawings In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. For ease of identifying a discussion of any particular element or act, one or more of the highest digits in a reference number refer to the figure number in which that element was first introduced. Some non-limiting examples are shown in the figures of the accompanying drawings, in which: FIG. 1 is a diagrammatic representation of a networking environment in which the present disclosure may be deployed, according to some examples. Fig. 2 is a diagrammatic representation of a messaging system having both client-side and server-side functionality in accordance with some examples. FIG. 3 is a diagrammatic representation of a data structure maintained in a database in accordance with some examples. Fig. 4 is a diagrammatic representation of a message according to some examples. Fig. 5 and 6 are graphical representations of example user interfaces of an AR experience system according to some examples. Fig. 7 is a flow chart illustrating example operations and methods of an AR experience system according to some examples. FIG. 8 is a diagrammatic representation of machine in the form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed according to some examples. Fig. 9 is a block diagram illustrating a software architecture in which an example may be implemented. Fig. 10 illustrates a system in which a head wearable device may be implemented, according to some examples. Detailed Description The following description includes systems, methods, techniques, sequences of instructions, and computer program products embodying illustrative examples of the present disclosure. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide an understanding of the various examples. It will be apparent, however, to one skilled in the art that the examples may be practiced without these specific details. In general, well-known instruction instances, protocols, structures, and techniques have not necessarily been shown in detail. In general, communication platforms allow users to share content and create images for transmission to other users. These images may be used to promote a product or service and/or simply represent different real world objects in a simulated or real environment. Generating a collection of content items (e.g., also referred to as a story) involves a significant amount of time. The user has to choose which items to include in the collection and to which recipients or groups of users the collection of content items is sent. A collection of content items may be automatically shared with all friends or contacts of a given user. This may be referred to as a public story or a collection of public content items. Alternatively, a collection of content items may be shared with a specified subset of friends or contacts of a given user. This may be referred to as a private story or a collection of private content items. Sometimes users apply AR effects to the video they make. For example, a user may access and view a real-time video feed. The user may select an AR effect to apply to a real-time video feed. The AR effect may include various animations of AR elements, which may vary based on real world objects depicted in the real-time video feed. In some cases, the user may then store the video including the AR elements for sharing with other users. In some cases, a user captures a screenshot that includes a single image. The single image may include a static representation of the AR element or may include the content of the image without any AR element. Sharing such images may not represent the actual intent of the user. That is, sharing images without AR elements may transmit different messages than those expected by the user. Sharing video feeds that have been captured and include animations can itself consume significant storage and communication resources, which reduces the overall efficiency