CN-121979604-A - Image processing method and device

Abstract

The embodiment of the specification provides an image processing method and device, wherein the image processing method comprises the steps of obtaining an image editing attribute obtained by carrying out editing attribute configuration on an image to be edited based on an attribute configuration component aiming at the image to be edited, calling a data construction module by a scheduling module to construct multi-mode data based on a server access address of the image in an uploaded image sequence and the image editing attribute, and carrying out data volume update on an interactive interface by the data construction module based on the multi-mode data, so that data mixing of two modes of the image and the image editing attribute is realized by the data volume update of the interactive interface.

Inventors

• WU MINGJUN

Assignees

• 支付宝(杭州)数字服务技术有限公司

Dates

Publication Date

20260505

Application Date

20260116

Claims (18)

1. 1. An image processing method, comprising: Displaying an attribute configuration component aiming at the image to be edited according to an uploading instruction of the image to be edited submitted at an interactive interface of a generated model; acquiring an image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and sending a server access address and the image editing attribute of the image in the uploaded image sequence to a scheduling module; The scheduling module is used for calling a data construction module to construct multi-mode data based on the server access address and the image editing attribute of the image; and updating a data structure based on the multi-mode data through the data construction module, and updating a data body on the interactive interface based on the updated data structure.
2. 2. The image processing method according to claim 1, wherein the image to be edited is uploaded through an image uploading interface disposed on the interactive interface; The obtaining the image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component comprises the following steps: And using the image editing mode selected from the plurality of image editing modes contained in the attribute configuration interface and the image editing intention selected from the plurality of image editing intents in the image editing mode as the image editing attribute.
3. 3. The image processing method according to claim 2, wherein after the sending the server access address and the image editing attribute of the image in the uploaded image sequence to the scheduling module is performed, the method further comprises: Synchronizing the server access address and the image editing attribute of the image to an image processing module through the scheduling module; And rendering the image editing attribute of the image by the image processing module at the image corresponding to the access address of the server, mapping the attribute switching interface to the rendered image, and displaying the obtained mapping assembly.
4. 4. The image processing method according to claim 3, wherein the sub-step of rendering, by the image processing module, the image editing attribute of the image corresponding to the server access address, mapping the attribute switching interface to the rendered image, and displaying the obtained mapping assembly is performed, further comprises: transmitting a switching image editing attribute corresponding to a triggering instruction of an attribute switching interface in the mapping assembly to the scheduling module, and synchronizing the switching image editing attribute to the data construction module through the scheduling module; and updating a data structure and a data volume based on the switching image editing attribute through the data construction module.
5. 5. The image processing method according to claim 1, wherein the image to be edited is uploaded based on an image pasting event submitted at the interactive interface; The obtaining the image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component comprises the following steps: After an image editing mode submitted based on an attribute configuration interface is detected, editing intention generation is carried out based on the image relation between the image to be edited and the rest images in the image sequence to obtain candidate editing intention; and determining the image editing intention in the candidate editing intents according to the visual characteristics of the image to be edited.
6. 6. The image processing method according to claim 5, the editing intention generation obtaining candidate editing intention based on the image relationship of the image to be edited and the remaining image in the image sequence, comprising: Detecting whether the image to be edited and the residual image have co-occurrence image elements or not; If so, sorting the images to be edited and the residual images with the co-occurrence image elements according to the distribution positions of the co-occurrence image elements in the images to be edited and the residual images with the co-occurrence image elements respectively to obtain the arrangement sequence of the images to be edited; the candidate editing intent is generated based on the ranking order and the co-occurrence image elements.
7. 7. The image processing method according to claim 6, wherein if the execution result after the execution of the operation of detecting whether the image to be edited and the remaining image have co-occurrence image elements is no, the following operations are executed: Extracting each image element in the image to be edited; inputting the image elements into an editing intention engine to construct editing intention, and obtaining candidate editing intention of the image to be edited.
8. 8. The image processing method according to claim 5, the determining an image editing intention among the candidate editing intents according to the visual feature of the image to be edited, comprising: performing feature fusion on the visual features, page content features of a program page where the interactive interface is located and editing record features of an image editing record of a user to obtain fusion features; and determining the image editing intention in the candidate editing intention according to the fusion characteristic and the adaptation index of the intention characteristic of the candidate editing intention.
9. 9. The image processing method according to claim 5, the method further comprising: Deleting corresponding multi-mode data in a DOM tree by the data construction module based on a deleting instruction of a visual data body contained in the interactive interface, and sending a deleting event of the visual data body to the scheduling module based on the deleting instruction; And sending the deleting event to an image processing module through the scheduling module, and deleting the mapping assembly corresponding to the interactive interface through the image processing module.
10. 10. The image processing method according to claim 5, the visual characteristics being obtained by: Performing content semantic coding on the image to be edited to obtain content semantic features, and performing image style analysis and layout analysis on the image to be edited to obtain image style features and layout features; performing attention computation based on the content semantic features, the image style features and the layout features, and generating the visual features based on attention computation results.
11. 11. The image processing method according to claim 5, the method further comprising: And if the image pasting interface is called to fail to acquire the image based on the image pasting instruction submitted by the interactive interface, analyzing the pasting event object to obtain an analysis result, and extracting the image to be edited from the analysis result.
12. 12. The image processing method according to claim 11, wherein after the operation of parsing the paste event object to obtain the parsing result is performed, the method further comprises: If the image extraction from the analysis result fails, generating an image interception prompt and displaying; And calling an image interception interface of the browser to intercept a webpage selection area of the user to obtain the image to be edited.
13. 13. The image processing method according to claim 1, wherein the updating of the data volume at the interactive interface based on the updated data structure comprises: Generating a thumbnail of the image based on the multi-mode data node in the updated DOM tree, and performing image-text arrangement on the thumbnail and the image editing attribute of the image to obtain a visual data body; and rendering the visual data body to the interactive interface.
14. 14. The image processing method according to claim 13, wherein the updating of the data structure based on the multi-modal data by the data construction module, and the updating of the data volume based on the updated data structure after the step of executing the interactive interface, further comprises: based on an interaction instruction submitted at the interaction interface and interacted with the generated model, sending visual data content corresponding to the visual data body to a server; The server inputs the visual data content into the generated model to carry out image editing processing of the image and returns an image editing result.
15. 15. The image processing method according to claim 14, wherein the image editing process is implemented by: According to the visual restoration attribute of a first image in the first visual data content, performing visual restoration on the first image to obtain a visual restoration image; and according to the element synthesis attribute of the second image in the second visual data content, carrying out synthesis element conversion on the second image to obtain a synthesis element, and synthesizing the synthesis element into the visual reduction image to obtain a synthesis image.
16. 16. An image processing apparatus comprising: the component display module is configured to display an attribute configuration component for an image to be edited according to an uploading instruction of the image to be edited submitted at an interactive interface of the generated model; the sending module is configured to acquire image editing attributes obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and send a server access address and the image editing attributes of the images in the uploaded image sequence to the scheduling module; The data construction module is configured to call the data construction module through the scheduling module to construct multi-mode data based on the server access address and the image editing attribute of the image; and the data updating module is configured to update the data structure based on the multi-mode data through the data construction module and update the data volume on the interactive interface based on the updated data structure.
17. 17. An image processing apparatus comprising: And a memory configured to store computer-executable instructions that, when executed, cause the processor to: Displaying an attribute configuration component aiming at the image to be edited according to an uploading instruction of the image to be edited submitted at an interactive interface of a generated model; acquiring an image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and sending a server access address and the image editing attribute of the image in the uploaded image sequence to a scheduling module; The scheduling module is used for calling a data construction module to construct multi-mode data based on the server access address and the image editing attribute of the image; and updating a data structure based on the multi-mode data through the data construction module, and updating a data body on the interactive interface based on the updated data structure.
18. 18. A computer readable storage medium storing computer executable instructions which, when executed, implement the steps of the method of claim 1.

Description

Image processing method and device Technical Field The present document relates to the field of data processing technologies, and in particular, to an image processing method and apparatus. Background Along with the continuous popularization of internet technology and artificial intelligence, the development of online service provided based on the internet technology is faster and faster, the online service often involves editing an uploaded image in the service handling process, and the diversified demands of users are met in the service handling process through image editing, but along with the continuous increase of service parties of the same type of online service, and along with the continuous improvement of the service requirements of users on the online service, certain pressure and challenges are brought to the service parties of the online service. Disclosure of Invention One or more embodiments of the present disclosure provide an image processing method, which includes displaying an attribute configuration component for an image to be edited according to an upload instruction of the image to be edited submitted at an interactive interface of a generative model. And acquiring an image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and sending a server access address and the image editing attribute of the image in the uploaded image sequence to a scheduling module. And calling a data construction module by the scheduling module to construct multi-mode data based on the server access address and the image editing attribute of the image. And updating a data structure based on the multi-mode data through the data construction module, and updating a data body on the interactive interface based on the updated data structure. One or more embodiments of the present specification provide an image processing apparatus, including a component presenting module configured to present an attribute configuration component for an image to be edited according to an upload instruction of the image to be edited submitted at an interactive interface of a generative model. The sending module is configured to obtain the image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and send the server access address and the image editing attribute of the image in the uploaded image sequence to the scheduling module. The data construction module is configured to call the data construction module through the scheduling module to construct multi-mode data based on the server access address and the image editing attribute of the image. And the data updating module is configured to update the data structure based on the multi-mode data through the data construction module and update the data volume on the interactive interface based on the updated data structure. One or more embodiments of the present specification provide an image processing apparatus comprising a processor and a memory configured to store computer-executable instructions that, when executed, cause the processor to expose an attribute configuration component for an image to be edited in accordance with upload instructions of the image to be edited submitted at an interactive interface of a generative model. And acquiring an image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and sending a server access address and the image editing attribute of the image in the uploaded image sequence to a scheduling module. And calling a data construction module by the scheduling module to construct multi-mode data based on the server access address and the image editing attribute of the image. And updating a data structure based on the multi-mode data through the data construction module, and updating a data body on the interactive interface based on the updated data structure. One or more embodiments of the present specification provide a computer-readable storage medium storing computer-executable instructions that, when executed, implement the steps of exposing an attribute configuration component for an image to be edited based on uploading instructions of the image to be edited submitted at an interactive interface of a generative model. And acquiring an image editing attribute obtained by carrying out editing attribute configuration on the image to be edited based on the attribute configuration component, and sending a server access address and the image editing attribute of the image in the uploaded image sequence to a scheduling module. And calling a data construction module by the scheduling module to construct multi-mode data based on the server access address and the image editing attribute of the image. And updating a data structure based on the multi-mode data throug