WO-2026092347-A1 - VIDEO GENERATION METHOD AND APPARATUS, AND DEVICE, MEDIUM AND PROGRAM PRODUCT

WO2026092347A1WO 2026092347 A1WO2026092347 A1WO 2026092347A1WO-2026092347-A1

Abstract

Provided in the embodiments of the present disclosure are a video generation method and apparatus, and a device, a medium and a program product. The method comprises: displaying a target material area in a video generation page, wherein the target material area is used for displaying a media material set associated with a target video of a target object; displaying a material recommendation area in the video generation page, and displaying candidate recommended materials in the material recommendation area; in response to a material selection operation on a candidate recommended material, transferring a target recommended material from the material recommendation area to the target material area, in order to add the target recommended material to the media material set; and in response to a video generation trigger operation in the video generation page, generating the target video of the target object on the basis of the media material set associated with the target material area, and displaying the target video. The technical solution in the embodiments of the present disclosure can increase the richness of materials in a target video, thereby optimizing the video effect.

Inventors

ZHAO, WENHE
YANG, WEIDONG
HE, JUNFENG
ZHAO, YIJUN
QIU, Jiahui
GE, Yuan

Assignees

北京字跳网络技术有限公司

Dates

Publication Date: 20260507
Application Date: 20251027
Priority Date: 20241029

Claims (13)

A video generation method, comprising: The target material area is displayed on the video generation page. The target material area is used to display the media material set associated with the target video of the target object. The media material set includes the original material corresponding to the target object. The video generation page displays a material recommendation area, which displays candidate recommended materials. The candidate recommended materials are obtained by querying a preset material set based on at least two screen description information corresponding to the object information of the target object. In response to the material selection operation for the candidate recommended material, the target recommended material is transferred from the material recommendation area to the target material area, so as to add the target recommended material to the media material set; In response to the video generation trigger operation on the video generation page, a target video of the target object is generated based on the original materials and target recommended materials in the media material set, and the target video is displayed. The video generation trigger operation is used to trigger a video generation event.
According to the method of claim 1, the step of displaying a material recommendation area on the video generation page and displaying candidate recommended materials in the material recommendation area includes: In response to the material recommendation trigger operation on the video generation page, the first form of the material recommendation area is displayed, wherein the first form of the material recommendation area includes a placeholder image of recommended materials; If the candidate recommended materials are successfully loaded, the second form of the material recommendation area is displayed. In the second form, the placeholder image of the recommended materials in the material recommendation area is switched to the candidate recommended materials. The material recommendation area in the second form includes at least two material groups associated with screen description information, and adjacent material groups are associated with different screen description information. Each material group includes at least two candidate recommended materials.
The method according to claim 2 further includes: In response to the material recommendation trigger operation on the video generation page, at least one of the recommended material placeholder images is displayed in the target material area; If the candidate recommended materials are loaded successfully, then candidate recommended materials that meet the preset filtering conditions will be displayed at the position corresponding to the placeholder image of the recommended materials in the target material area. The preset filtering conditions are determined by combining the order of the material group and the order of the candidate recommended materials within the material group.
The method according to claim 3 further includes: If the candidate recommended materials fail to load, the first form of the material recommendation area in the video generation page is deleted, and the recommended material placeholder image in the target material area is deleted.
The method according to any one of claims 1-4 further comprises: The duration of the material is displayed at the designated location in the candidate recommended material; In response to a click operation on the duration of any candidate recommended material, a preview page corresponding to the candidate recommended material is displayed, and the candidate recommended material is played on the preview page.
The method according to any one of claims 1-5, wherein the step of transferring the target recommended material from the recommended material area to the target material area in response to the material selection operation for the candidate recommended material includes: In response to a click operation that adds a control to the material corresponding to the candidate recommended material, the target recommended material is moved along a preset movement path to a set material display position in the target material area, wherein the target recommended material represents the candidate recommended material associated with the click operation, and the preset movement path represents the line segment between the position of the target recommended material in the material recommendation area and the set material display position; The target recommended material is displayed at the designated material display location.
According to the method of claim 6, wherein the step of moving the target recommended material to a set material display position in the target material area along a preset movement path in response to a click operation on the material adding control corresponding to the candidate recommended material includes: In response to a click operation on the control for adding material displayed at a set position of the candidate recommended material, the target recommended material is moved along the preset movement path; During the process of the target recommended material moving along the first path segment in the preset moving path, the target recommended material is transformed from a first form to a second form, wherein the first path segment represents the line segment between the position of the target recommended material in the material recommendation area and the target position in the video generation page; During the movement of the target recommended material along the second path segment of the preset movement path, the target recommended material is restored from the second form to the first form, wherein the second path segment represents the line segment between the target position and the set material display position.
The method according to any one of claims 1-7, wherein the query method for the candidate recommended materials includes: Obtain at least one object information associated with the target object, and generate at least two screen description information associated with the object information based on at least one object information and prompt words through a preset generation model, wherein the prompt words are used to constrain the generation result of the preset generation model; The image description vector corresponding to the image description information is matched with the material vector associated with the preset material set to obtain the matching material and the matching degree corresponding to the matching material; The candidate recommended materials among the matched materials are determined based on the matching degree.
The method according to claim 8, wherein after determining the candidate recommended material among the matched materials based on the matching degree, further comprising: For any given image description information, the candidate recommended materials associated with the image description information are grouped according to the matching degree to obtain the material group associated with the image description information; Based on the order of the image description information, the material groups associated with the image description information are displayed sequentially in the material recommendation area.
A video generation apparatus, comprising: The target material area display module is configured to display the target material area on the video generation page. The target material area is used to display the media material set associated with the target video of the target object, wherein the media material set includes the original material corresponding to the target object. The material recommendation area display module is configured to display a material recommendation area on the video generation page, and to display candidate recommended materials in the material recommendation area. The candidate recommended materials are obtained by querying a preset material set based on at least two screen description information corresponding to the object information of the target object. The recommended material selection module is configured to, in response to a material selection operation for the candidate recommended materials, transfer the target recommended material from the material recommendation area to the target material area, so as to add the target recommended material to the media material set; The video generation module is configured to respond to a video generation trigger operation on the video generation page, generate a target video of the target object based on the original materials and target recommended materials in the media material set, and display the target video, wherein the video generation trigger operation is used to trigger a video generation event.
An electronic device, comprising: One or more processors; Storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the video generation method as described in any one of claims 1-9.
A storage medium containing computer-executable instructions, wherein the computer-executable instructions, when executed by a computer processor, are used to perform the video generation method as described in any one of claims 1-9.
A computer program product includes a computer program, wherein the computer program, when executed by a processor, implements the video generation method as described in any one of claims 1-9.

Description

A video generation method, apparatus, device, medium, and program product. Cross-reference of related applications This application claims priority to Chinese Patent Application No. 202411523698.5, filed on October 29, 2024, the disclosure of which is incorporated herein by reference in its entirety. Technical Field This disclosure relates to a video generation method, apparatus, device, medium, and program product. Background Technology With the development of computer technology, promoting products through videos has become widely used. For example, product promotion videos are generated based on product images and/or videos uploaded by creators. However, the materials used in these videos are often limited by the creator's uploads or the product's details page, resulting in low video quality and poor overall effect. Summary of the Invention This disclosure provides a video generation method, apparatus, device, medium, and program product that can improve the richness of target videos and optimize video effects. In a first aspect, embodiments of this disclosure provide a video generation method, characterized in that it includes: The target material area is displayed on the video generation page. The target material area is used to display the media material set associated with the target video of the target object. The media material set includes the original material corresponding to the target object. The video generation page displays a material recommendation area, which displays candidate recommended materials. The candidate recommended materials are obtained by querying a preset material set based on at least two screen description information corresponding to the object information of the target object. In response to the material selection operation for the candidate recommended material, the target recommended material is transferred from the material recommendation area to the target material area, so as to add the target recommended material to the media material set; In response to the video generation trigger operation on the video generation page, a target video of the target object is generated based on the original materials and target recommended materials in the media material set, and the target video is displayed. The video generation trigger operation is used to trigger a video generation event. Secondly, embodiments of this disclosure also provide a video generation apparatus, the apparatus comprising: The target material area display module is used to display the target material area on the video generation page. The target material area is used to display the media material set associated with the target video of the target object, wherein the media material set includes the original material corresponding to the target object. The material recommendation area display module is used to display a material recommendation area on the video generation page, and to display candidate recommended materials in the material recommendation area. The candidate recommended materials are obtained by querying a preset material set based on at least two screen description information corresponding to the object information of the target object. The recommended material selection module is used to respond to the material selection operation for the candidate recommended materials by transferring the target recommended material from the material recommendation area to the target material area, so as to add the target recommended material to the media material set; The video generation module is used to respond to the video generation trigger operation on the video generation page, generate a target video of the target object based on the original materials and target recommended materials in the media material set, and display the target video, wherein the video generation trigger operation is used to trigger a video generation event. Thirdly, embodiments of this disclosure also provide an electronic device, the electronic device comprising: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the video generation method as described in any embodiment of this disclosure. Fourthly, embodiments of this disclosure also provide a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the video generation method as described in any embodiment of this disclosure. Fifthly, embodiments of this disclosure also provide a computer program product, including a computer program, characterized in that the computer program, when executed by a processor, implements the video generation method as described in any embodiment of this disclosure. Attached Figure Description The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawing