SYSTEMS AND METHODS FOR PHOTOREALISTIC REAL-TIME PORTRAIT ANIMATION

Abstract

Provided are systems and methods for photorealistic real-time portrait animation. An example method comprises receiving a scenario video. The scenario video includes at least one input frame. The at least one input frame includes a first face of a first person. The method further comprises receiving a target image (125). The target image (125) includes a second face (140) of a second person. The method comprises determining, based on the at least one input frame and the target image (125), two-dimensional, 2D, deformations of the second face (140) and a background (145) in the target image (125). The 2D deformations when applied to the second face (140), modify the second face (140) to imitate at least a facial expression and a head orientation of the first face (130). The method also comprises applying the 2D deformations to the target image (125) to obtain at least one output frame of an output video.

Inventors

KROKHALEV, EUGENE
MASHRABOV, Aleksandr
SAVCHENKOV, PAVEL

Assignees

Snap Inc.

Dates

Publication Date: 20260506
Application Date: 20200118