CN-121999084-A - Font material generation processing method and device

Abstract

The embodiment of the specification provides a font material generation processing method and device, wherein the font material generation processing method comprises the steps of firstly carrying out semantic analysis on a font generation text and a reference image submitted by a client of a font generation intelligent body to obtain semantic feature words, calling a material retrieval interface to carry out font material retrieval based on the semantic feature words to obtain font material data, then generating an interaction control according to the font material data and returning the interaction control to the client, inputting interaction data corresponding to the interaction parameter into a font generation model to carry out font material generation to obtain a target font material after the interaction parameter submitted by the client through the interaction control is obtained, and returning the obtained target font material to the client, so that the font material generation intelligent body based on the font generation intelligent body realizes font material generation processing.

Inventors

• ZHOU CHUNXIAN

Assignees

• 支付宝(杭州)数字服务技术有限公司

Dates

Publication Date

20260508

Application Date

20260116

Claims (20)

1. 1. A font material generation processing method is applied to a server side of a font generation intelligent agent, and the method comprises the following steps: carrying out semantic analysis on a font generation text and a reference image submitted by a client to obtain semantic feature words; invoking a material retrieval interface to retrieve font materials based on the semantic feature words to obtain font material data; generating an interaction control according to the font material data, returning the interaction control to the client, and acquiring interaction parameters submitted by the client through the interaction control; Inputting the interactive data corresponding to the interactive parameters into a font generation model for font material generation to obtain target font materials and returning the target font materials to the client.
2. 2. The font material generating processing method according to claim 1, wherein the invoking the material retrieval interface based on the semantic feature word for font material retrieval, obtaining font material data, comprises: The semantic feature words are sent to a search engine of each font material library by calling a search interface of each font material library so as to search font materials matched with the semantic feature words and read the material parameters of the searched font materials; And the receiving interface calls the returned material parameters of the multiple font materials.
3. 3. The font material generating processing method according to claim 2, wherein each font material library is determined by: extracting features of the semantic feature words to obtain semantic features, and extracting features of the element material information of each font material library in the material library set to obtain element material features; and carrying out matching calculation based on the semantic features and the element material features, and determining the font material library in the material library set according to a matching calculation result.
4. 4. The font material generating processing method according to claim 2, wherein the generating the interactive control according to the font material data includes: Carrying out structural conversion on the font material data according to the interaction control parameters to obtain structural material data; And performing control attribute mapping on the structured material data, and generating the interaction control according to attribute mapping data.
5. 5. The font material generating and processing method according to claim 4, wherein the interactive control is a triggerable control, and the user submits the interactive parameters by triggering the interactive control.
6. 6. The font material generating and processing method according to claim 1, wherein the interaction parameters comprise image parameters submitted by font material images configured in the interaction control, wherein the image parameters submitted by the font material images are triggered by a user, and attribute configuration parameters submitted by attribute sub-controls of the interaction control are triggered by the user; the attribute configuration parameters comprise at least one of font attribute parameters, color attribute parameters, divergence attribute parameters and material file types.
7. 7. The font material generating processing method according to claim 6, the font material generating comprising: Extracting image features of each font material image contained in the interactive data, and performing attention calculation on the image features obtained by the feature extraction to obtain common image features and difference image features; and determining a feature fusion mode based on the interaction parameters, carrying out feature fusion on the common image features, the difference image features and the text features of the font generation text according to the feature fusion mode to obtain fusion features, and generating the target font material according to the fusion features.
8. 8. The font material generating processing method according to claim 7, wherein the feature fusion of the common image feature, the difference image feature and the text feature of the font generating text according to the feature fusion method to obtain a fusion feature includes: And performing divergent weight conversion on the divergent attribute parameters contained in the interaction parameters to obtain divergent weights, and performing feature screening on the common image features, the difference image features and the text features based on the divergent weights to obtain the fusion features.
9. 9. The font material generating processing method according to claim 7, wherein the feature fusion of the common image feature, the difference image feature and the text feature of the font generating text according to the feature fusion method to obtain a fusion feature includes: And mapping the common image features and the difference image features to a semantic feature space of the text features to obtain mapping features, and embedding file type features of material file types contained in the interaction parameters into the mapping features to obtain the fusion features.
10. 10. The font material generating processing method according to claim 1, wherein the font material generation is implemented by the following manner: extracting the characteristics of the attribute configuration parameters contained in the interaction parameters to obtain attribute characteristics, and fusing the attribute characteristics with the text characteristics of the font generation text to obtain text fusion characteristics; Inputting the text fusion features and the visual fusion features into a diffusion network to generate font materials, and obtaining the target font materials; The visual fusion feature is obtained based on the image feature of the reference image and the visual feature of each font material image contained in the interactive data, or based on the visual feature of each font material image.
11. 11. A font material generation processing method applied to a client of a font generation agent, the method comprising: acquiring a font generation text and a reference image input by a user and submitting the font generation text and the reference image to a server of the font generation intelligent agent; Receiving an interactive control which is returned by the server and generated according to font material data and displaying the interactive control on an interactive interface, wherein the font material data calls a material retrieval interface to retrieve font material based on the font generated text and semantic feature words of the reference image; generating interaction parameters according to the interaction instruction of the user for the interaction control and submitting the interaction parameters to the server so as to generate font materials through a font generation model to obtain target font materials.
12. 12. The font material generating processing method according to claim 11, wherein the interactive control is generated by adopting the following way: Carrying out structural conversion on the font material data according to the interaction control parameters to obtain structural material data; And performing control attribute mapping on the structured material data, and generating the interaction control according to attribute mapping data.
13. 13. The font material generating and processing method according to claim 11, wherein the interaction parameters comprise image parameters submitted by font material images configured in the interaction control, wherein the image parameters submitted by the font material images are triggered by a user, and attribute configuration parameters submitted by attribute sub-controls of the interaction control are triggered by the user; the attribute configuration parameters comprise at least one of font attribute parameters, color attribute parameters, divergence attribute parameters and material file types.
14. 14. The font material generating processing method according to claim 13, wherein the font material generation is implemented by: extracting image features of each font material image contained in the interactive data corresponding to the interactive parameters, and performing attention calculation on the image features obtained by the feature extraction to obtain common image features and difference image features; and determining a feature fusion mode based on the interaction parameters, carrying out feature fusion on the common image features, the difference image features and the text features of the font generation text according to the feature fusion mode to obtain fusion features, and generating the target font material according to the fusion features.
15. 15. The font material generating processing method according to claim 14, wherein the feature fusion of the common image feature, the difference image feature and the text feature of the font generating text according to the feature fusion method to obtain a fusion feature includes: Performing divergent weight conversion on the divergent attribute parameters contained in the interaction parameters to obtain divergent weights, and performing feature screening on the common image features, the differential image features and the text features based on the divergent weights to obtain the fusion features; Or alternatively And mapping the common image features and the difference image features to a semantic feature space of the text features to obtain mapping features, and embedding file type features of material file types contained in the interaction parameters into the mapping features to obtain the fusion features.
16. 16. A font material generation processing device, operating at a server of a font generation agent, the device comprising: The semantic analysis module is configured to perform semantic analysis on the font generation text submitted by the client and the reference image to obtain semantic feature words; The material retrieval module is configured to call a material retrieval interface to retrieve font materials based on the semantic feature words, and font material data is obtained; The control generation module is configured to generate an interaction control according to the font material data, return the interaction control to the client, and acquire interaction parameters submitted by the client through the interaction control; And the font material generating module is configured to input the interactive data corresponding to the interactive parameters into a font generating model for font material generation to obtain target font materials and return the target font materials to the client.
17. 17. A font material generation processing apparatus, operable on a client of a font generation agent, the apparatus comprising: The data submitting module is configured to acquire font generation text and a reference image input by a user and submit the font generation text and the reference image to a server of the font generation intelligent agent; The control display module is configured to receive an interactive control generated according to font material data returned by the server and display the interactive control on an interactive interface, wherein the font material data calls a material retrieval interface to retrieve font material based on the font generated text and the semantic feature words of the reference image; And the interactive parameter submitting module is configured to generate interactive parameters according to the interactive instruction of the user for the interactive control and submit the interactive parameters to the server so as to generate font materials through a font generating model to obtain target font materials.
18. 18. A font material generating processing apparatus comprising: And a memory configured to store computer-executable instructions that, when executed, cause the processor to: carrying out semantic analysis on a font generation text submitted by a client of a font generation intelligent agent and a reference image to obtain semantic feature words; invoking a material retrieval interface to retrieve font materials based on the semantic feature words to obtain font material data; generating an interaction control according to the font material data, returning the interaction control to the client, and acquiring interaction parameters submitted by the client through the interaction control; Inputting the interactive data corresponding to the interactive parameters into a font generation model for font material generation to obtain target font materials and returning the target font materials to the client.
19. 19. A font material generating processing apparatus comprising: And a memory configured to store computer-executable instructions that, when executed, cause the processor to: Acquiring a font generation text and a reference image input by a user and submitting the font generation text and the reference image to a server of a font generation intelligent agent; Receiving an interactive control which is returned by the server and generated according to font material data and displaying the interactive control on an interactive interface, wherein the font material data calls a material retrieval interface to retrieve font material based on the font generated text and semantic feature words of the reference image; generating interaction parameters according to the interaction instruction of the user for the interaction control and submitting the interaction parameters to the server so as to generate font materials through a font generation model to obtain target font materials.
20. 20. A computer readable storage medium storing computer executable instructions which when executed implement the steps of the method of claim 1 or claim 11.

Description

Font material generation processing method and device Technical Field The present document relates to the field of image processing technologies, and in particular, to a font material generating and processing method and device. Background Along with the rapid development of artificial intelligence technology and the deep fusion of the artificial intelligence technology and design fields, the demands of various fields on personalized and diversified font materials are increasing, so that core information is expected to be transmitted through adapting to fonts with specific styles and demands, and visual expression effects are improved. Disclosure of Invention One or more embodiments of the present disclosure provide a font material generating and processing method, which is applied to a server of a font generating agent, and the method includes performing semantic analysis on a font generating text and a reference image submitted by a client to obtain a semantic feature word. And calling a material retrieval interface to retrieve font materials based on the semantic feature words, and obtaining font material data. And generating an interaction control according to the font material data, returning the interaction control to the client, and acquiring interaction parameters submitted by the client through the interaction control. Inputting the interactive data corresponding to the interactive parameters into a font generation model for font material generation to obtain target font materials and returning the target font materials to the client. One or more embodiments of the present disclosure provide another font material generating processing method applied to a client of a font generating agent, where the method includes acquiring font generating text and a reference image input by a user and submitting the font generating text and the reference image to a server of the font generating agent. And the font material data calls a material retrieval interface to retrieve font material based on the font generation text and the semantic feature word of the reference image. Generating interaction parameters according to the interaction instruction of the user for the interaction control and submitting the interaction parameters to the server so as to generate font materials through a font generation model to obtain target font materials. One or more embodiments of the present disclosure provide a font material generating and processing device, which operates on a server of a font generating agent, and the device includes a semantic parsing module configured to perform semantic parsing on a font generating text and a reference image submitted by a client to obtain a semantic feature word. And the material retrieval module is configured to call a material retrieval interface to retrieve font materials based on the semantic feature words to obtain font material data. And the control generation module is configured to generate an interaction control according to the font material data, return the interaction control to the client, and acquire interaction parameters submitted by the client through the interaction control. And the font material generating module is configured to input the interactive data corresponding to the interactive parameters into a font generating model for font material generation to obtain target font materials and return the target font materials to the client. One or more embodiments of the present disclosure provide another font material generating processing apparatus, which operates on a client of a font generating agent, and the apparatus includes a data submitting module configured to obtain a font generating text and a reference image input by a user and submit the font generating text and the reference image to a server of the font generating agent. The control display module is configured to receive the interactive control generated according to the font material data returned by the server and display the interactive control on the interactive interface, and the font material data calls a material retrieval interface to retrieve font material based on the font generated text and the semantic feature words of the reference image. And the interactive parameter submitting module is configured to generate interactive parameters according to the interactive instruction of the user for the interactive control and submit the interactive parameters to the server so as to generate font materials through a font generating model to obtain target font materials. One or more embodiments of the present specification provide a font material generating processing device including a processor and a memory configured to store computer-executable instructions that, when executed, cause the processor to semantically parse font-generating text and reference images submitted by a client of a font-generating agent to obtain semantic feature words. And calling a material retrieval interface to retrieve fo