CN-121982169-A - Action migration method and device, electronic equipment and computer storage medium

CN121982169ACN 121982169 ACN121982169 ACN 121982169ACN-121982169-A

Abstract

The embodiment of the application provides an action migration method, an action migration device, electronic equipment and a computer storage medium. The motion migration method comprises the steps of displaying a target role model, obtaining a reference motion video, wherein the reference motion video comprises a reference role for executing a reference motion, and sequentially calling artificial intelligent models corresponding to the motion migration sub-steps according to the execution sequence among a plurality of preset motion migration sub-steps in response to a preset trigger operation so as to respectively execute the corresponding motion migration sub-steps through the artificial intelligent models and migrate the reference motion executed by the reference role to the target role model. According to the embodiment of the application, the end-to-end automatic process from the display of the target character model to the driving of the target character model is realized based on the artificial intelligent model, the realization threshold of the action migration is reduced, the realization cost is saved, and the efficiency and the generalization capability of the action migration are improved.

Inventors

FAN WENLING
LI JIAXUAN
LI YUZE

Assignees

北京优酷科技有限公司

Dates

Publication Date: 20260505
Application Date: 20251201

Claims (13)

1. A method of action migration, comprising: displaying the target character model; acquiring a reference action video, wherein the reference action video comprises a reference role for executing a reference action; And responding to a preset triggering operation, and sequentially calling the artificial intelligent models corresponding to the action migration sub-steps according to the preset execution sequence among the action migration sub-steps so as to respectively execute the corresponding action migration sub-steps through the artificial intelligent models and migrate the reference action executed by the reference character to the target character model.
2. The method of claim 1, wherein after the displaying the target character model, the method further comprises: and displaying the action migration flow information, wherein the action migration flow information comprises name information of each action migration sub-step and execution sequence information among the action migration sub-steps.
3. The method of claim 1 or 2, wherein after the presentation of the target character model, the method further comprises: Displaying introduction information aiming at a current sub-step to be executed, wherein the current sub-step to be executed is an action migration sub-step with the earliest execution sequence in the unexecuted action migration sub-steps; the responding to the preset triggering operation sequentially calls the artificial intelligent model corresponding to each action migration sub-step according to the execution sequence among the preset action migration sub-steps, and the method comprises the following steps: Responding to the triggering operation aiming at the current sub-step to be executed, calling a target artificial intelligent model corresponding to the current sub-step to be executed, and executing the current sub-step to be executed through the target artificial intelligent model to obtain an execution result; And re-determining the current sub-step to be executed according to the execution sequence among a plurality of preset action migration sub-steps, and returning to the step of displaying the introduction information aiming at the current sub-step to be executed until the reference action executed by the reference character is migrated to the target character model.
4. The method of claim 1 or 2, wherein the plurality of motion migration sub-steps sequentially comprises a bone binding sub-step, a skin weight optimization sub-step, and a motion redirection sub-step.
5. The method of claim 4, wherein for the skeletal binding sub-step, invoking the artificial intelligence model corresponding to the action migration sub-step to perform the process of the corresponding action migration sub-step by the artificial intelligence model comprises: Acquiring a semantic segmentation result aiming at the target role model; inputting the model data corresponding to the target role model and the semantic segmentation result into a skeleton recognition model, and outputting a skeleton recognition result through the skeleton recognition model, wherein the skeleton recognition result comprises joint positions and joint names; determining a bone position and a bone name of the target character model according to the joint position and the joint name; determining a skeletal hierarchical relationship of the target character model based on a skeletal location and a skeletal name of the target character model; and initializing the skin weight of each vertex in the target role model according to the skeleton position, skeleton name and skeleton hierarchy relation of the target role model.
6. The method of claim 4, wherein invoking the artificial intelligence model corresponding to the action migration sub-step for the skin weight optimization sub-step to perform the process of the corresponding action migration sub-step by the artificial intelligence model comprises: Displaying model part icons respectively corresponding to model parts in the target character model; responding to a selection operation for a target model part icon, and acquiring target part data corresponding to a target model part and bone positions and bone names of all target bones contained in the target model part; Inputting the target position data, the bone position and the bone name of each target bone into a skin weight optimizing model, and predicting by the skin weight optimizing model to obtain the optimized skin weight of each vertex in the target model position.
7. The method of claim 4, wherein for the action redirection sub-step, invoking the artificial intelligence model corresponding to the action migration sub-step to perform the process of the corresponding action migration sub-step by the artificial intelligence model, comprising: analyzing the reference action video, and obtaining reference skeleton topology information of the reference roles and reference skeleton position information corresponding to each reference action video frame, wherein the reference skeleton topology information comprises skeleton names and skeleton hierarchical relations of the reference roles; inputting the reference skeleton topology information and the target skeleton topology information of the target role model into a skeleton mapping model, executing semantic alignment operation through the skeleton mapping model, and outputting skeleton mapping relation between the reference role and the target role model; respectively inputting the reference skeleton position information corresponding to each reference motion video frame, the skeleton mapping relation and the skeleton position of the target role model into a motion redirection model, and outputting a rotation angle sequence of each skeleton in the target role model through the motion redirection model; Dynamically adjusting the positions of bones and vertices in the target character model based on the rotation angle sequence and skin weight values of vertices in the target character model to migrate reference actions performed by the reference character to the target character model.
8. A method according to any one of claims 1-3, wherein the acquiring a reference motion video comprises: displaying action icons respectively corresponding to different preset actions; And responding to the selection operation of the target action icon, and acquiring the action video corresponding to the target action icon as a reference action video.
9. A method according to any one of claims 1-3, wherein the acquiring a reference motion video comprises: the video uploading guide information is used for guiding and executing the reference action video uploading operation; And receiving the uploaded reference action video.
10. An action migration apparatus comprising: The display module is used for displaying the target role model; the video acquisition module is used for acquiring a reference action video, wherein the reference action video comprises a reference role for executing a reference action; And the action migration module is used for responding to a preset trigger operation, sequentially calling the artificial intelligent models corresponding to the action migration sub-steps according to the execution sequence among a plurality of preset action migration sub-steps so as to respectively execute the corresponding action migration sub-steps through the artificial intelligent models and migrate the reference action executed by the reference character to the target character model.
11. An electronic device comprises a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface complete communication with each other through the communication bus; The memory is configured to store at least one executable instruction that causes the processor to perform operations corresponding to the method of any one of claims 1-9.
12. A computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any of claims 1-9.
13. A computer program product comprising computer instructions that instruct a computing device to perform operations corresponding to the method of any one of claims 1-9.

Description

Action migration method and device, electronic equipment and computer storage medium Technical Field The embodiment of the application relates to the technical field of computers, in particular to an action migration method, an action migration device, electronic equipment and a computer storage medium. Background The movement migration across characters refers to the process of completely migrating the movement of an existing character (reference character or source character) to another character model (target character model) so that the target character model visually reproduces the "same movement". Illustratively, in three-dimensional character animation processes, motion migration across characters is typically involved so that a three-dimensional character model can perform prescribed actions. At present, the action migration of the virtual roles is realized mainly by a manual processing mode, so that the time consumption is long, the cost is high and the method is not friendly to non-professional users. Disclosure of Invention Accordingly, embodiments of the present application provide an action migration scheme to at least partially solve the above-mentioned problems. According to a first aspect of an embodiment of the present application, there is provided an action migration method, including: displaying the target character model; acquiring a reference action video, wherein the reference action video comprises a reference role for executing a reference action; And responding to a preset triggering operation, and sequentially calling the artificial intelligent models corresponding to the action migration sub-steps according to the preset execution sequence among the action migration sub-steps so as to respectively execute the corresponding action migration sub-steps through the artificial intelligent models and migrate the reference action executed by the reference character to the target character model. According to a second aspect of an embodiment of the present application, there is provided an action migration apparatus, including: The display module is used for displaying the target role model; the video acquisition module is used for acquiring a reference action video, wherein the reference action video comprises a reference role for executing a reference action; And the action migration module is used for responding to a preset trigger operation, sequentially calling the artificial intelligent models corresponding to the action migration sub-steps according to the execution sequence among a plurality of preset action migration sub-steps so as to respectively execute the corresponding action migration sub-steps through the artificial intelligent models and migrate the reference action executed by the reference character to the target character model. According to a third aspect of the embodiment of the application, there is provided an electronic device, including a processor, a memory, a communication interface and a communication bus, where the processor, the memory and the communication interface complete communication with each other through the communication bus, and the memory is configured to store at least one executable instruction, where the executable instruction causes the processor to perform an operation corresponding to the method according to the first aspect. According to a fourth aspect of embodiments of the present application, there is provided a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the method according to the first aspect. According to a fifth aspect of embodiments of the present application, there is provided a computer program product having computer instructions embodied thereon, the computer instructions directing a computing device to perform operations corresponding to the method of the first aspect. According to the motion migration scheme provided by the embodiment of the application, a target role model can be displayed, a reference motion video is acquired, the reference motion video contains a reference role for executing a reference motion, and the artificial intelligent model corresponding to each motion migration sub-step is sequentially called according to the execution sequence among a plurality of preset motion migration sub-steps in response to a preset trigger operation so as to respectively execute the corresponding motion migration sub-steps through each artificial intelligent model and migrate the reference motion executed by the reference role to the target role model. According to the embodiment of the application, a flow processing platform for automatically realizing the action migration is integrated according to the execution sequence among the action migration sub-steps related to the action migration task. And, corresponding artificial intelligent models are respectively set for each action migration substep. Therefore, according to the embodiment of the applicatio