US-12626724-B2 - Coherent slow-motion video displayed across multiple devices

US12626724B2US 12626724 B2US12626724 B2US 12626724B2US-12626724-B2

Abstract

A method comprises receiving one or more indications corresponding to one or more derivative video files. Each derivative video file of the one or more derivative video files has a different frame rate. The method further comprises selecting an indication of a derivative video file with a corresponding derivative video frame rate. The method further comprises receiving the derivative video file and an original video frame rate. The method further comprises determining a playback frame rate to slow a derivative video of the derivative video file using a desired frame rate, the derivative video frame rate, and the original video frame rate. The method further comprises displaying the derivative video at the determined playback frame rate.

Inventors

Joshua Bodinet
Ulaganathan Sriramulu
Abhishek Kumar Singh
Cheung NG

Assignees

ADOBE INC.

Dates

Publication Date: 20260512
Application Date: 20230602

Claims (20)

1 . A method comprising: receiving one or more indications corresponding to one or more derivative video files, each derivative video file of the one or more derivative video files having a different frame rate and a corresponding different apparent rate of motion; selecting an indication of a derivative video file with a corresponding derivative video frame rate; receiving the derivative video file and an original video frame rate corresponding to an original apparent rate of motion; determining a playback frame rate to slow a derivative video of the derivative video file using a combination of a desired frame rate, the derivative video frame rate, and the original video frame rate; and displaying the derivative video at a slowed apparent rate of motion using the determined playback frame rate, wherein the derivative video of the derivative video file has a set of one or more video properties different from the set of one or more video properties of an original video file, and wherein the set of one or more video properties comprises at least one of video file size, video color space, video bit depth, or video codec-type.
2 . The method of claim 1 , wherein displaying the derivative video at the original apparent rate of motion using the determined playback frame further comprises: determining a second playback frame rate to slow a second derivative video of a second derivative video file of the one or more derivative video files using the desired frame rate, a second derivative video frame rate, and the original video frame rate; and displaying the second derivative video at the second determined playback frame rate, wherein displaying the second derivative video at the second determined playback frame rate causes display of the original apparent rate of motion.
3 . The method of claim 1 , wherein selecting the indication of the derivative video file with the corresponding derivative video frame rate further comprises: determining an available computing resource; and selecting the indication of the derivative video file based on the available computing resource.
4 . The method of claim 1 , wherein selecting the indication of the derivative video file with the corresponding derivative video frame rate is based on at least one of a computing device identifier or a platform identifier.
5 . The method of claim 1 , further comprising: transmitting the indication of the derivative video file.
6 . The method of claim 5 , wherein the transmitted indication includes identification information identifying at least one of a user profile, a computing device identifier, or a platform identifier.
7 . The method of claim 1 , further comprising: receiving the desired frame rate as a user input.
8 . A system comprising: a memory component; and a processing device coupled to the memory component, the processing device to perform operations comprising: receiving one or more indications corresponding to one or more derivative video files, each derivative video file of the one or more derivative video files having a different frame rate and a corresponding different apparent rate of motion; selecting an indication of a derivative video file with a corresponding derivative video frame rate; receiving the derivative video file and an original video frame rate corresponding to an original apparent rate of motion; determining a playback frame rate to slow a derivative video of the derivative video file using a combination of a desired frame rate, the derivative video frame rate, and the original video frame rate; and displaying the derivative video at a slowed apparent rate of motion using the determined playback frame rate, wherein the derivative video of the derivative video file has a set of one or more video properties different from the set of one or more video properties of an original video file, and wherein the set of one or more video properties comprises at least one of video file size, video color space, video bit depth, or video codec-type.
9 . The system of claim 8 , wherein selecting the indication of the derivative video file with the corresponding derivative video frame rate further comprises: determining an available computing resource; and selecting the indication of the derivative video file based on the available computing resource.
10 . The system of claim 8 , wherein selecting the indication of the derivative video file with the corresponding derivative video frame rate is based on at least one of a computing device identifier or a platform identifier.
11 . The system of claim 8 , wherein the processing device performs further operations comprising: transmitting the indication of the derivative video file.
12 . The system of claim 11 , wherein the transmitted indication includes identification information identifying at least one of a user profile, a computing device identifier, or a platform identifier.
13 . The system of claim 8 , wherein the processing device performs further operations comprising: receiving the desired frame rate as a user input.
14 . The system of claim 13 , wherein the processing device performs further operations comprising: transmitting the desired frame rate associated with a user profile.
15 . A method comprising: receiving, by a first device, a first video file including a first video with a first frame rate, wherein the first video is a first derivative video of an original video with a first apparent rate of motion; determining, by the first device, a first playback frame rate using a combination of a desired frame rate, the first frame rate, and an original video frame rate associated with the original video; displaying, by the first device, a first slow video at an original apparent rate of motion at the desired frame rate using the first video, wherein the first slow video is displayed at the first playback frame rate; receiving, by a second device, a second video file including a second video with a second frame rate, wherein the second video is a second derivative video of the original video with a second apparent rate of motion, wherein the second derivative video has a set of one or more video properties different from the set of one or more video properties of the first video file, and wherein the set of one or more video properties comprises at least one of video file size, video color space, video bit depth, or video codec-type; determining, by the second device, the second playback frame rate using a combination of the desired frame rate, the second frame rate, and the original video frame rate associated with the original video; and displaying, by the second device, a second slow video at the original apparent rate of motion at the desired frame rate using the second video, wherein the second slow video is displayed at the second playback frame rate.
16 . The method of claim 15 , further comprising: receiving, by the first device and the second device, one or more indications corresponding to one or more video files, each video file of the one or more video files having a different frame rate; selecting, by the first device, a first video file based on a mapping of the first device to a first file size; and selecting, by the second device, a second video file based on a mapping of the second device to a second file size.
17 . The method of claim 15 , further comprising: receiving, by a third device, a third video file including a third video with a third frame rate, wherein the third video and the second video and the first video are derivative videos of the original video; and displaying, by the third device, a third slow video at a second desired frame rate using the third video, wherein the third slow video is displayed at a third playback frame rate.
18 . The method of claim 17 , further comprising: determining, by the third device, the third playback frame rate using the second desired frame rate, the third frame rate, and an original video frame rate associated with the original video.
19 . The method of claim 15 , further comprising: receiving, at the first device, an update to the desired frame rate at the second device; determining, by the second device, a third playback frame rate using the updated desired frame rate, the second frame rate, and the original video frame rate associated with the original video; and displaying, by the second device, the second slow video at the updated desired frame rate using the second video, wherein the second slow video is displayed at the third playback frame rate.
20 . The method of claim 15 , further comprising: selecting the first video with the first frame rate based on a mapping of the first device to the first frame rate or resources of the first device; and selecting the second video with the second frame rate based on a mapping of the second device to the first frame rate or resources of the second device.

Description

BACKGROUND Videos have become an integral part of our lives. With the advent of smartphone technology, it has recently become possible to take high frame rate videos, where the smartphone device captures a high number of frames per second (e.g., more than 60 frames per second). Captured videos can be slowed down to create slow-motion videos. Creating slow-motion videos is performed by presenting frames of the video at a rate slower rate than the captured fps frame rate. SUMMARY Introduced here are techniques/technologies that provide slow-motion video with improved aesthetics over prior techniques. A video processing system of the present disclosure obtains information that is distributed across different platforms, applications, servers, devices, and the like, and uses the information to determine a playback frame rate for a displayed slow-motion video. The video processing system leverages its connectivity to external resources to obtain a frame rate of an original video associated with each of multiple videos derived from an original video. The video processing system then selects a video to be slowed from the multiple derivative videos. Each of the derivative videos are different from the original video in terms of at least one of video file size, video frame rate, video color space, video bit depth, video codec-type, or other video properties. The selected video is the optimal video for the computing device executing the video processing system and/or the platform hosting the video processing the system based on available resources in the computing device executing the video processing system and/or hosting the video processing system. In other embodiments, the video processing system's selection of the optimal video file size is predetermined based on the particular computing device type and/or platform executing/hosting the video processing system. A selection of the derivative video based on an optimal video file size allows the video processing system to slow down the video in a computationally efficient, low-latency manner. The video processing system is also able to seamlessly display a slow-motion video across multiple computing devices. The unique playback frame rate determined by each of multiple computing devices creates the same slow motion video effect, even though the properties of the video that is slowed down may be different at each of the multiple computing devices. Additional features and advantages of exemplary embodiments of the present disclosure will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of such exemplary embodiments. BRIEF DESCRIPTION OF THE DRAWINGS The detailed description is described with reference to the accompanying drawings in which: FIG. 1 illustrates a diagram of a process of providing a cohesive slow-motion effect regardless of a source video, in accordance with one or more embodiments; FIG. 2 illustrates a flow diagram of a first example of providing a cohesive slow-motion effect regardless of a source video, in accordance with one or more embodiments; FIG. 3 illustrates a flow diagram of a second example of providing a cohesive slow-motion effect regardless of a source video, in accordance with one or more embodiments; FIG. 4 illustrates an example of coherent slow-motion video displayed across multiple devices, in accordance with one or more embodiments; FIG. 5 illustrates an example of user preferences, according to one or more embodiments; FIG. 6 illustrates a schematic diagram of video processing system in accordance with one or more embodiments; FIG. 7 illustrates a flowchart of a series of acts in a method of displaying slow-motion videos in accordance with one or more embodiments; FIG. 8 illustrates a schematic diagram of an exemplary environment in which the video processing system can operate in accordance with one or more embodiments; and FIG. 9 illustrates a block diagram of an exemplary computing device in accordance with one or more embodiments. DETAILED DESCRIPTION One or more embodiments of the present disclosure include a video processing system that matches an apparent speed of action of a video across multiple devices displaying the video. Conventional approaches provide slow-motion video by displaying a video at a playback frame rate that is slower than the captured frame rate of the video. The visual aesthetics of the slow-motion video determined by conventional systems depend on the video file that is slowed down. As video file sizes increase, to accommodate higher quality videos captured at faster frame rates, the latency associated with displaying slow-motion videos increases. Conventional systems reduce the latency of displaying slow-motion videos by slowing down smaller video files created, in part, by reducing the frame rate in the smaller video file. When conventional systems display slow-motion video across multiple devices, each of the displayed vi