US-12626427-B2 - Digital design recoloring and enhancement methods utilizing a text-to-image diffusion model

US12626427B2US 12626427 B2US12626427 B2US 12626427B2US-12626427-B2

Abstract

The systems, methods, and non-transitory computer-readable media include recoloring a digital design according to colors of a digital image and further generating an enhanced recolored digital design. In particular, in some embodiments, the disclosed systems identify a digital image for recoloring a digital design and recolors the digital design utilizing a color affine transformation algorithm to generate a recolored digital design. Further, in some embodiments, the disclosed systems generate the enhanced recolored digital design by transforming one or more colors of the recolored digital design to be within a range of the colors of the digital image utilizing a convex hull projection method. Moreover, in some embodiments, the disclosed systems further enhance the recolored digital design utilizing a contrast enhancement algorithm to modify luminescence values.

Inventors

Ankit Phogat
Souymodip Chakraborty
Sumit Chaturvedi
Sumit Dhingra
Vineet Batra
Vishwas Jain

Assignees

ADOBE INC.

Dates

Publication Date: 20260512
Application Date: 20230831

Claims (20)

1 . A system comprising: one or more memory components; and one or more processing devices coupled to the one or more memory components, the one or more processing devices to perform operations comprising: identifying a digital image for recoloring a digital design; recoloring, utilizing a color affine transformation algorithm, colors of the digital design according to colors of the digital image to generate a recolored digital design comprising mapped colors; and generating an enhanced recolored digital design by: utilizing a convex hull projection method to construct a convex hull from the colors of the digital image; projecting the mapped colors of the recolored digital design toward the convex hull to generate transformed colors; and modifying, utilizing a contrast enhancement algorithm, luminescence values of the transformed colors to increase color separation.
2 . The system of claim 1 , wherein the operations further comprise: determining a statistical distribution of a first range of colors of the digital design; and from the statistical distribution, reducing the colors of the digital design to a second range of colors smaller than the first range of colors.
3 . The system of claim 1 , wherein the operations further comprise converting a first range of colors of the digital design within an RGB color space to an HSL color space.
4 . The system of claim 3 , wherein the operations further comprise: initializing, utilizing a clustering algorithm, a set of color clusters with a range of colors smaller than the first range of colors; and clustering, utilizing the clustering algorithm, the first range of colors of the digital design to the set of color clusters.
5 . The system of claim 4 , wherein utilizing the clustering algorithm comprises: determining for a first color of the first range of colors, a hue value is within a predefined hue threshold of a first cluster of the set of color clusters, a saturation value matches a saturation value of the first cluster of the set of color clusters, and lightness value is within a predefined lightness threshold of the first cluster of the set of color clusters; and assigning the first color to the first cluster of the set of color clusters.
6 . The system of claim 1 , wherein utilizing the color affine transformation algorithm comprises: generating a three-dimensional array representation of the colors of the digital image; generating a three-dimensional array representation of colors of the digital design; generating, a first set of arrays from the three-dimensional array representation of the digital image and a second set of arrays from the three-dimensional array representation of the digital design; and transforming the second set of arrays of the digital design according to the first set of arrays of the digital image.
7 . The system of claim 1 , wherein utilizing the convex hull projection method further comprises: projecting the mapped colors towards a surface of the convex hull by transforming the mapped colors of the recolored digital design to align with the convex hull, wherein the mapped colors are treated as a set of points in a three-dimensional space; determining a geometric structure that contains the set of points in the three-dimensional space as the geometric structure of the convex hull; and generating a transformed recolored digital design based on the geometric structure of the convex hull.
8 . The system of claim 1 , wherein utilizing the contrast enhancement algorithm comprises modifying brightness or darkness values of the digital design.
9 . A non-transitory computer-readable medium storing executable instructions which, when executed by at least one processing device, cause the at least one processing device to perform operations comprising: identifying a digital image for recoloring a digital design; recoloring, utilizing a color affine transformation algorithm, colors of the digital design according to colors of the digital image to generate a recolored digital design comprising mapped colors; and generating an enhanced recolored digital design by: utilizing a convex hull projection method to construct a convex hull from the colors of the digital image; projecting the mapped colors of the recolored digital design toward the convex hull to generate transformed colors; and modifying, utilizing a contrast enhancement algorithm, luminescence values of the transformed colors to increase color separation.
10 . The non-transitory computer-readable medium of claim 9 , wherein the operations further comprise: determining a statistical distribution of a first range of colors of the digital design; and from the statistical distribution, reducing the first range of colors of the digital design to a second range of colors smaller than the first range of colors.
11 . The non-transitory computer-readable medium of claim 9 , wherein recoloring, utilizing the color affine transformation algorithm comprises: generating a three-dimensional array representation of the colors of the digital image; generating a three-dimensional array representation of colors of the digital design; generating, a first set of arrays from the three-dimensional array representation of the digital image and a second set of arrays from the three-dimensional array representation of the digital design; and transforming the second set of arrays of the digital design according to the first set of arrays of the digital image.
12 . The non-transitory computer-readable medium of claim 9 , wherein generating an enhanced recolored digital design further comprises: projecting the mapped colors toward a surface of the convex hull by transforming the mapped colors of the recolored digital design to align with the convex hull, wherein the mapped colors are treated as a set of points in a three-dimensional space; determining a geometric structure that contains the set of points in the three-dimensional space as the geometric structure of the convex hull; generating a transformed recolored digital design based on the geometric structure of the convex hull; and modifying the transformed recolored digital design by utilizing the contrast enhancement algorithm to modify brightness or darkness values to generate the enhanced recolored digital design.
13 . A method comprising: identifying a digital image for recoloring a digital design; recoloring, utilizing a color affine transformation algorithm, colors of the digital design according to colors of the digital image to generate a recolored digital design comprising mapped colors; and generating an enhanced recolored digital design by: utilizing a convex hull projection method to construct a convex hull from the colors of the digital image; projecting the mapped colors of the recolored digital design toward the convex hull to generate transformed colors; and modifying, utilizing a contrast enhancement algorithm, luminescence values of the transformed colors to increase color separation.
14 . The method of claim 13 , further comprising: determining a statistical distribution of a first range of colors of the digital design; and from the statistical distribution, reducing the colors of the digital design to a second range of colors smaller than the first range of colors.
15 . The method of claim 13 , further comprising converting a first range of colors of the digital design within an RGB color space to an HSL color space.
16 . The method of claim 15 , further comprising: initializing, utilizing a clustering algorithm, a set of color clusters with a range of colors smaller than the first range of colors; and clustering, utilizing the clustering algorithm, the first range of colors of the digital design to the set of color clusters.
17 . The method of claim 16 , wherein utilizing the clustering algorithm comprises: determining for a first color of the first range of colors, a hue value is within a predefined hue threshold of a first cluster of the set of color clusters, a saturation value matches a saturation value of the first cluster of the set of color clusters, and lightness value is within a predefined lightness threshold of the first cluster of the set of color clusters; and assigning the first color to the first cluster of the set of color clusters.
18 . The method of claim 13 , wherein utilizing the color affine transformation algorithm comprises: generating a three-dimensional array representation of the colors of the digital image; generating a three-dimensional array representation of colors of the digital design; generating, a first set of arrays from the three-dimensional array representation of the digital image and a second set of arrays from the three-dimensional array representation of the digital design; and transforming the second set of arrays of the digital design according to the first set of arrays of the digital image.
19 . The method of claim 13 , wherein utilizing the convex hull projection method further comprises: projecting the mapped colors towards a surface of the convex hull by transforming the mapped colors of the recolored digital design to align with the convex hull, wherein the mapped colors are treated as a set of points in a three-dimensional space; determining a geometric structure that contains the set of points in the three-dimensional space as the geometric structure of the convex hull; and generating a transformed recolored digital design based on the geometric structure of the convex hull.
20 . The method of claim 13 , wherein utilizing the contrast enhancement algorithm comprises modifying brightness or darkness values of the digital design.

Description

BACKGROUND Recent years have seen significant advancement in hardware and software platforms for modifying digital designs to produce modified color schemes that convey a certain theme or concept. For example, many platforms offer software applications that provide tools to edit elements such as colors within a digital design. For instance, many platforms provide the option for a user to manipulate colors of a digital design and then to manually adjust elements of the digital design in response to manipulating the colors. However, despite these advancements, existing software platform systems for modifying digital designs continue to suffer from a variety of problems with regard to efficiency and operational flexibility. SUMMARY One or more embodiments described herein provide benefits and/or solve one or more of problems in the art with systems, methods, and non-transitory computer-readable media that recolor a digital design based on a color theme from a digital image. More particularly, in one or more implementations, the systems recolor a digital design based on a color theme from a digital image generated utilizing a text-to-image diffusion model. For instance, in one or more embodiments, the disclosed system preserves the geometry of the digital design and takes on the digital image's look and feel by transferring the color variations of the digital image to the digital design. In some embodiments, the disclosed system recolors the digital design using a color affine transformation algorithm. Further, in some embodiments, the disclosed system generates an enhanced recolored digital design by using a convex hull projection and contrast enhancement tailored to address issues that arise during color transfer via the color affine transformation algorithm. Additionally, in some embodiments, the disclosed system receives an indication of a selection of a digital design and a text prompt input. Further, in some embodiments, the disclosed system generates a digital image from the text prompt using a diffusion model. Moreover, in some embodiments, the disclosed system recolors a digital design according to colors of the digital image. Additional features and advantages of one or more embodiments of the present disclosure are outlined in the description which follows, and in part will be obvious from the description, or may be learned by the practice of such example embodiments. BRIEF DESCRIPTION OF THE DRAWINGS This disclosure will describe one or more embodiments of the invention with additional specificity and detail by referencing the accompanying figures. The following paragraphs briefly describe those figures, in which: FIG. 1 illustrates an example environment in which a design recolor system operates in accordance with one or more embodiments; FIG. 2 illustrates an overview of the design recolor system generating an enhanced recolored digital design in accordance with one or more embodiments; FIG. 3 illustrates a diagram of the design recolor system reducing a range of colors of the digital design in accordance with one or more embodiments; FIG. 4 illustrates a diagram of the design recolor system utilizing a color affine transformation algorithm in accordance with one or more embodiments; FIG. 5 illustrates a diagram of the design recolor system utilizing a convex hull projection method in accordance with one or more embodiments; FIG. 6 illustrates a diagram of the design recolor system utilizing a diffusion neural network to generate a digital image in accordance with one or more embodiments; FIG. 7 illustrates an overview of workflow within the design recolor system for generating a recolored digital design in accordance with one or more embodiments; FIG. 8 illustrates an example schematic diagram of the design recolor system in accordance with one or more embodiments; FIG. 9 illustrates a flowchart of a series of acts for providing a recolored digital design to a client device in accordance with one or more embodiments; FIG. 10 illustrates a flowchart of a series of acts for generating an enhanced recolored digital design in accordance with one or more embodiments; FIG. 11 illustrates a block diagram of an exemplary computing device in accordance with one or more embodiments. DETAILED DESCRIPTION One or more embodiments described herein include a design recoloring system that transfers color variations from a digital image to a digital design (e.g., a scalable vector graphic) and further enhances a recolored digital design by utilizing a convex hull projection method and a contrast enhancement algorithm. Conventional systems have a number of disadvantages with respect to recoloring digital designs. For example, conventional recoloring systems suffer from several technological shortcomings that result in inefficient and inflexible operation. In particular, conventional systems require a designer to provide a specific reference image for each color variation to recolor a specified digital design. To i