Search

EP-4738356-A2 - ENTERTAINING MOBILE APPLICATION FOR ANIMATING A SINGLE IMAGE OF A HUMAN BODY AND APPLYING EFFECTS

EP4738356A2EP 4738356 A2EP4738356 A2EP 4738356A2EP-4738356-A2

Abstract

Provided are systems and methods for animating images. An example method comprises receiving an input image (125). The input image (125) includes an image of a body. The method also comprises receiving, through an interface, a user input including parameters associated with a motion. Further, the method comprises generating, based on the image of the body and the parameters associated with the motion, a video (155) featuring the body repeating the motion.

Inventors

  • GORBATYUK, SERGEI
  • SMIRNOV, Nikolai
  • MASHRABOV, Aleksandr
  • NEMCHINOV, EGOR

Assignees

  • Snap Inc.

Dates

Publication Date
20260506
Application Date
20200520

Claims (14)

  1. A computer-implemented method comprising: receiving an input image (125), the input image (125) including an image of a body; receiving, through an interface (305), a user input including parameters associated with a motion; and generating, based on the image of the body and the parameters associated with the motion, a video (155) featuring the body repeating the motion.
  2. The method of claim 1, further comprising providing, to a user, an option to share the parameters associated with the motion with a further user of a further computing device.
  3. The method of claim 2, wherein the further computing device is configured to generate, based on the parameters associated with the motion and a further input image including a further image of a further body, a further video featuring the further body repeating the motion.
  4. The method of any of the preceding claims, wherein the parameters associated with the motion are generated based on a further video featuring an individual performing a custom motion.
  5. The method of claim 4, wherein the receiving the user input includes: capturing, via a camera (115), a further image of the individual; and determining, based on the further image of the individual, a silhouette of the individual.
  6. The method of claim 5, wherein the receiving the user input further includes: displaying the silhouette to the user; and enabling the user to enter a mode for recording the further video featuring the individual performing the custom motion.
  7. The method of any of the preceding claims, further comprising: prior to generating the video (155), receiving a further user input including a hair animation effect selected from a list of hair animation effects; and while generating the video (155), applying the hair animation effect to a hair image in frames of the video (155).
  8. The method of claim 7, wherein the list of hair animation effects includes a wind effect, a zero gravity effect, and a wet hair effect.
  9. The method of any of the preceding claims, further comprising, while generating the video (155), applying an effect of change of a position of a camera (115) to frames of the video (155).
  10. The method of claim 9, further comprising displaying the video (155) to the user.
  11. The method of any of the preceding claims, wherein the method is performed by a computing device (105, 1400).
  12. A computing device comprising at least one processor (210, 1410) configured to implement the method of any of claims 1-11.
  13. A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors (210, 1410), cause the one or more processors (210, 1410) to implement the method of any of claims 1-11.
  14. A computer program product comprising instructions which, when the program is executed by a computer (105, 1400), cause the computer (105, 1400) to carry out the method of any of claims 1-11.

Description

TECHNICAL FIELD This disclosure generally relates to digital image processing. More particularly, this disclosure relates to methods, systems, and a mobile application for animating a single image of a human body and applying effects. BACKGROUND Body animation can be used in many applications, such as advertisements, entertainment shows, social media networks, computer games, videos, video conversations, virtual reality, augmented reality, and the like. An animation of a body of a person based on a single photograph can be specifically useful in various applications. For example, a person on the photograph can "come alive" by performing movements similar to a real video (for example, dancing, performing acrobatics, fighting, and so forth). Animation of the body of a person based on a single photograph entails creating a realistic model of a body of a particular person and having the model perform actions or interactions within scenes. International Patent Application Publication No. WO 2011/045768 A2 discloses an image animation method. The method includes: fitting a fitting model to at least an object in the image, and animating the object in accordance with a corresponding animation model. The fitting model is at least as rigid as the animation model, and the animation model is no more rigid than the fitting model. In U.S. Patent Application Publication No. US 2014/267117 A1, a digital collage creation kit is provided. The digital collage creation kit may include a digital photo cutter, a digital stamper, and a digital transforming tool. The digital photo cutter, the digital stamper, and the digital transforming tool may be configured to interact with a touch-screen surface of a computing device executing the digital collage creation kit application. Upon executing the digital collage creation kit application by the computing device, the digital collage creation kit may generate a digital collage creation environment, in which a digital collage may be created based on input received from one or more of the digital photo cutter, the digital stamper, and the digital transforming tool. SUMMARY This section is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description section. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. The invention is defined in the independent claims. Particular embodiments are set out in the dependent claims. A method for animating a single image of a human body and applying effects is provided. The method may include providing, by a computer device, a database of motions. The method may allow receiving, by a computing device, an input image. The input image includes a body of the person. The method may include receiving, by the computing device, a user input including a motion selected from the database of motions. The method may include segmenting, by the computing device, the input image into a body portion and a background portion. The body portion includes pixels of the input image corresponding to the body of the person. The method may include generating, by the computing device and based on the body portion and the selected motion, a video featuring the body of the person repeating the selected motion. The method may include displaying, by the computing device, the generated video. The method may further include receiving, by the computing device, a further user input. The further input may include a name of at least one social network. The method may include posting, by the computing device, the generated video on a timeline of a user of the computing device in the at least one social network. The method may include, prior to generating the video, receiving, by the computing device, a further user input. The further user input may include clothes selected from a list. The method may include, while generating the video, substituting clothes of the person in frames of the video with the selected clothes. The method may include, prior to generating the video, receiving, by the computing device, a further user input. The further user input may include a scene selected from a list of scenes. The method may include, while generating the video, substituting a background of frames of the video with the selected scene. The method may include, prior to generating the video, receiving, by the computing device, a further user input. The further user input may include an illumination effect selected from a list of illumination effects. The method may include, while generating the video, applying the illumination effect to frames of the video. The method may include, prior to generating the video, receiving, by the computing device, a further user input, the further user input including an object selected from a list of objects. The method may include, while generating t