US-20260127784-A1 - SYSTEMS AND METHODS FOR IMPROVED SKIN TONE RENDERING IN DIGITAL IMAGES

US20260127784A1US 20260127784 A1US20260127784 A1US 20260127784A1US-20260127784-A1

Abstract

Embodiments of the present disclosure may include a system for improved skin tone rendering, of a user skin tone of a user, in digital images, the system including a first computing device. Embodiments may also include a computing device camera. Embodiments may also include a user skin tone analysis device. In some embodiments, the first computing device may be configured to receive a set of user skin tone images of the user. In some embodiments, the set of user skin tone images may include at least one unprocessed user skin tone image of the user obtained from the computing device camera. In some embodiments, the first computing device may be configured to obtain a skin tone analysis user skin tone image for the user. In some embodiments, the skin tone analysis user skin tone image may be taken using the user skin tone analysis device.

Inventors

Sergio RATTNER
Justinas VILIMAS

Assignees

FITSKIN INC.

Dates

Publication Date: 20260507
Application Date: 20231010

Claims (20)

1 . A system for improved skin tone rendering, of a user skin tone of a user, in digital images, the system comprising: a first computing device configured to: receive a set of user skin tone images of the user, comprising at least an unprocessed user skin tone image of the user obtained from a computing device camera; obtain a skin tone assembly user skin tone image for the user, the skin tone assembly user skin tone image taken using a user skin tone analysis device; extract a user skin tone color value of the user from each image in the set of user skin tone images and the skin tone assembly user skin tone image of the user; calculate a set of user skin tone rendering adjustment factors from the skin tone color values; apply one or more user skin tone rendering adjustment factors from the set of user skin tone rendering adjustment factors to the unprocessed user skin tone image to obtain an adjusted user skin tone image; and output the adjusted user skin tone image.
2 . The system of claim 1 wherein the first computing device further comprises a first computing device camera and a user skin tone analysis device that attaches to the first computing device in front of first computing device camera and wherein the obtaining is via the first computing device camera with the user skin tone analysis device in front of the computing device camera and wherein the skin tone assembly user skin tone image for the user is an image of the user.
3 . The system of claim 2 wherein the skin tone assembly user skin tone image is at a magnification of not less than 10×.
4 . The system of claim 1 further comprising a database of skin tone assembly skin tone images from a second computing device camera with a second user skin tone analysis device in front of the second computing device camera and wherein the obtaining is from the database of skin tone assembly skin tone images and the skin tone assembly user skin tone image for the user is not an image of the user and is selected based on comparing the unprocessed user skin tone image of the user to a set of skin tone assembly user skin tone images in the database of skin tone assembly skin tone images.
5 . The system of claim 1 wherein the user skin tone color value comprises a L* channel, an a* channel and a b* channel.
6 . The system of claim 5 wherein the set of user skin tone images comprises an unprocessed skin tone image and a human processed skin tone image.
7 . The system of claim 6 wherein the extracting further comprises, for each image in the set of user skin tone images: identifying a set of image pixels comprising a skin surface of the user; summing, for each pixel in the set of image pixels, the L* channel, the a* channel and the b* channel; and dividing the summing, for L* channel, the a* channel and the b* channel, by a number of pixels in the set of image pixels, to arrive at an average L* channel, an average a* channel and an average b* channel.
8 . The system of claim 7 wherein the set of skin tone rendering adjustment factors comprises a first skin tone rendering adjustment factor comprising a first difference between the a* channel between the skin tone assembly skin tone images and the unprocessed skin tone image and a second skin tone rendering adjustment factor comprising a second difference between the b* channel between the skin tone assembly skin tone images and the unprocessed skin tone image.
9 . The system of claim 8 wherein the set of skin tone rendering adjustment factors further comprises a third skin tone rendering adjustment factor comprising a third difference between the L* channel between the human processed skin tone image and the unprocessed skin tone image and the applying comprises the first skin tone rendering adjustment factor, the second skin tone rendering adjustment factor, and the third skin tone rendering adjustment factor.
10 . The system of claim 6 wherein the human processed skin tone image is created from the unprocessed skin tone image, by a human adjusting the unprocessed skin tone image, using image processing software, to make the user skin tone in the human processed skin tone image look empirically more similar to how the human sees the user skin tone in real life.
11 . The system of claim 5 wherein the extracting further comprises: identifying a first set of image pixels comprising a skin surface of the user in the unprocessed skin tone image and a second set of image pixels comprising a skin surface of the user in the skin tone assembly user skin tone image for the user; deducing a first mean L* channel for the first set of image pixels and a second mean L* channel for the second set of image pixels; setting a mapping of L* channel values from the first set of image pixels and the second set of image pixels, based on the deducing; using the mapping to create, for each pixel in the first set of image pixels, a pixel skin tone rendering adjustment factors comprising an a* channel adjustment factor and a b* channel adjustment factor; employing, for each pixel, the a* channel adjustment factor and a b* channel adjustment factor.
12 . The system of claim 1 wherein each user skin tone image in the set of user skin tone images comprises an extracted skin tone snippet of the user.
13 . The system of claim 12 wherein the applying is to the extracted skin tone snippet in the unprocessed user skin tone image.
14 . The system of claim 1 , wherein outputting comprises one or more of displaying the adjusted user skin tone image on a screen of the computing device or storing the adjusted user skin tone image on a memory of the computing device.
15 . A method for improved skin tone rendering, of a user skin tone of a user, in digital images, the method comprising: receiving, by a computing device, a set of user skin tone images of the user, comprising at least an unprocessed user skin tone image of the user obtained from a computing device camera; obtaining a skin tone assembly user skin tone image for the user, the skin tone assembly user skin tone image taken using a user skin tone analysis device; extracting a user skin tone color value of the user from each image in the set of user skin tone images and the skin tone assembly user skin tone image of the user; calculating a set of user skin tone rendering adjustment factors from the skin tone color values; applying one or more user skin tone rendering adjustment factors from the set of user skin tone rendering adjustment factors to the unprocessed user skin tone image to obtain an adjusted user skin tone image; and outputting the adjusted user skin tone image.
16 . The method of claim 15 wherein the obtaining is via the computing device, the computing device further comprising a computing device camera and a user skin tone analysis device, with the user skin tone analysis device in front of the computing device camera and wherein the skin tone assembly user skin tone image for the user is an image of the user.
17 . The method of claim 16 wherein the skin tone assembly user skin tone image is at a magnification of not less than 10×.
18 . The method of claim 15 wherein the obtaining is from a database of skin tone assembly skin tone images and the skin tone assembly user skin tone image for the user is not an image of the user and is selected based on comparing the unprocessed user skin tone image of the user to a set of skin tone assembly user skin tone image in the database of skin tone assembly skin tone images.
19 . The method of claim 15 wherein the user skin tone color value comprises a L* channel, an a* channel and a b* channel.
20 . The method of claim 19 wherein the set of user skin tone images comprises an unprocessed skin tone image and a human processed skin tone image.

Description

TECHNICAL FIELD The present invention relates to improved skin tone rendering in digital images using skin tone analysis devices that attach to computing devices. BACKGROUND Computing devices (smart phones, tablets, digital cameras, and the like) often can take pictures. It is a known challenge for those pictures to accurately capture and display accurate and realistic skin tones, across various colors and shades of skin and various lighting, and other factors, in the images. Although many approaches to render more accurate skin tones exist, the challenge remains largely unsolved—largely as a result of the limitations of the computing devices being used to capture the images and the resulting lack of ability to properly process the images. There is accordingly a need for an improved method and system for improved skin tone rendering in digital images. BRIEF SUMMARY There is a system for improved skin tone rendering, of a user skin tone of a user, in digital images, the system comprising: a first computing device configured to: receive a set of user skin tone images of the user, comprising at least an unprocessed user skin tone image of the user obtained from a computing device camera; obtain a skin tone assembly user skin tone image for the user, the skin tone assembly user skin tone image taken using a user skin tone analysis device; extract a user skin tone color value of the user from each image in the set of user skin tone images and the skin tone assembly user skin tone image of the user; calculate a set of user skin tone rendering adjustment factors from the skin tone color values; apply one or more user skin tone rendering adjustment factors from the set of user skin tone rendering adjustment factors to the unprocessed user skin tone image to obtain an adjusted user skin tone image; and output the adjusted user skin tone image. The first computing device may further comprise a first computing device camera and a user skin tone analysis device that attaches to a computing device in front of first the computing device camera and wherein the obtaining is via the first computing device camera with the user skin tone analysis device in front of the computing device camera and wherein the skin tone analysis user skin tone image for the user is an image of the user. The skin tone assembly user skin tone image is at a magnification of not less than 10×. The system may further comprise a database of skin tone assembly skin tone images from a second computing device camera with a second user skin tone analysis device in front of the second computing device camera and wherein the obtaining is from the database of skin tone assembly skin tone images and the skin tone assembly user skin tone image for the user is not an image of the user and is selected based on comparing the unprocessed user skin tone image of the user to a set of skin tone assembly user skin tone images in the database of skin tone assembly skin tone images. The user skin tone color value may comprise a L* channel, an a* channel and a b* channel. The set of user skin tone images may comprise an unprocessed skin tone image and a human processed skin tone image. The extracting may further comprise, for each image in the set of user skin tone images: identifying a set of image pixels comprising a skin surface of the user; summing, for each pixel in the set of image pixels, the L* channel, the a* channel and the b* channel; and dividing the summing, for L* channel, the a* channel and the b* channel, by a number of pixels in the set of image pixels, to arrive at an average L* channel, an average a* channel and an average b* channel. The set of skin tone rendering adjustment factors may comprise a first skin tone rendering adjustment factor comprising a first difference between the a* channel between the skin tone assembly skin tone images and the unprocessed skin tone image and a second skin tone rendering adjustment factor comprising a second difference between the b* channel between the skin tone assembly skin tone images and the unprocessed skin tone image. The set of skin tone rendering adjustment factors may further comprise a third skin tone rendering adjustment factor comprising a third difference between the L* channel between the human processed skin tone image and the unprocessed skin tone image and the applying comprises the first skin tone rendering adjustment factor, the second skin tone rendering adjustment factor, and the third skin tone rendering adjustment factor. The human processed skin tone image may be created from the unprocessed skin tone image, by a human adjusting the unprocessed skin tone image, using image processing software, to make the user skin tone in the human processed skin tone image look empirically more similar to how the human sees the user skin tone in real life. The extracting may further comprise: identifying a first set of image pixels comprising a skin surface of the user in the unprocessed skin tone image