US-12625487-B2 - Robotic cosmetic application device with machine learning and user preference integration

Abstract

A robotic cosmetic application device, and techniques for controlling the device, are provided. The device may include sensors that capture real-time data associated with a user's face and robotic arms equipped with makeup applicator tools. The device may receive an indication of a makeup look selected by the user; analyze the real-time data associated with the user's face in order to generate a three-dimensional map associated with the face of the user, identify facial features of the user's face on the three-dimensional map; and control the robotic arms to automatically adjust the makeup applicator tools with respect to the user's face, to apply one or more cosmetic products to the user's facial features in order to achieve the makeup look selected by the user.

Inventors

• Christopher Aidan

Assignees

• ELC MANAGEMENT LLC

Dates

Publication Date

20260512

Application Date

20240216

Claims (19)

1. 1 . An intelligent robotic cosmetic application device, comprising: one or more sensors configured to capture real-time data associated with a face of a user; one or more robotic arms equipped with one or more respective makeup applicator tools; a controller, comprising: one or more processors; and one or more memories storing non-transitory computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to: receive, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by the user; analyze the real-time data associated with the face of the user in order to generate a three-dimensional map associated with the face of the user; identify one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and control the one or more robotic arms to automatically: dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.
2. 2 . The intelligent robotic cosmetic application device of claim 1 , wherein the one or more sensors include one or more of a camera or a depth sensor.
3. 3 . The intelligent robotic cosmetic application device of claim 1 , wherein the one or more makeup applicator tools include one or more of: a brush applicator tool, a sponge applicator tool, a puff applicator tool, a pencil applicator tool, a felt tip applicator tool, a marker applicator tool, a crayon applicator tool, a lip stick applicator tool, a lip gloss applicator tool, a roller applicator tool, or a mascara wand applicator tool.
4. 4 . The intelligent robotic cosmetic application device of claim 1 , wherein the user interface is integrated into the intelligent robotic cosmetic application device.
5. 5 . The intelligent robotic cosmetic application device of claim 1 , further comprising a communication interface configured to communicate with a mobile device, external to the intelligent robotic cosmetic application device.
6. 6 . The intelligent robotic cosmetic application device of claim 5 , wherein the communication interface is a wired communication interface.
7. 7 . The intelligent robotic cosmetic application device of claim 5 , wherein the communication interface is a wireless communication interface.
8. 8 . The intelligent robotic cosmetic application device of claim 5 , wherein the user interface is integrated into the mobile device.
9. 9 . The intelligent robotic cosmetic application device of claim 5 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to request images of the face of the user as captured by a camera of the mobile device, wherein the images of the face of the user are used to generate the three-dimensional map associated with the face of the user.
10. 10 . The intelligent robotic cosmetic application device of claim 5 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to request that a light source of the mobile device modify one or more lighting parameters in order to provide light to the face of the user.
11. 11 . The intelligent robotic cosmetic application device of claim 1 , further comprising an augmented reality (AR) component configured to generate and display an AR version of the three-dimensional map associated with the face of the user.
12. 12 . The intelligent robotic cosmetic application device of claim 11 , wherein the AR component is integrated into the user interface.
13. 13 . The intelligent robotic cosmetic application device of claim 11 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to generate a three-dimensional preview of the makeup look selected by the user as applied to the three-dimensional map associated with the face of the user, and wherein the AR component is further configured to generate and display an AR version of the three-dimensional preview of the makeup look selected by the user as applied to the three-dimensional map associated with the face of the user.
14. 14 . The intelligent robotic cosmetic application device of claim 13 , wherein the three-dimensional preview of the makeup look selected by the user includes a three-dimensional preview of an application process of the makeup look selected by the user.
15. 15 . The intelligent robotic cosmetic application device of claim 1 , further comprising one or more dispensers for the one or more cosmetic products, wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to control dispensing of the one or more cosmetic products via the one or more dispensers.
16. 16 . The intelligent robotic cosmetic application device of claim 15 , further comprising one or more temperature control components configured to control temperatures associated with the one or more dispensers for the one or more cosmetic products within a particular range of temperatures.
17. 17 . The intelligent robotic cosmetic application device of claim 15 , wherein the non-transitory computer-readable instructions, when executed by the one or more processors, further cause the one or more processors to: track the dispensing of the one or more cosmetic products via the one or more dispensers; determine, based on tracking the dispensing of the one or more cosmetic products via the one or more dispensers, that a refill of at least one of the one or more cosmetic products is required; and provide a notification indicating that the refill of at least one of the one or more cosmetic products is required, via the user interface.
18. 18 . A computer-implemented method for controlling an intelligent robotic cosmetic application device via one or more processors, comprising: receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by a user; analyzing real-time data associated with a face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user; identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically: dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.
19. 19 . A non-transitory computer-readable medium storing instructions for controlling an intelligent robotic cosmetic application device that, when executed by one or more processors, cause the one or more processors to perform a method comprising: receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by a user; analyzing real-time data associated with a face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user; identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically: dip the one or more respective makeup applicator tools into one or more dispensers or containers containing cosmetic products; and adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to at least one of the one or more facial features of the user by touching the one or more respective makeup applicator tools to the at least one of the one or more facial features of the user in order to achieve the makeup look selected by the user.

Description

FIELD OF THE INVENTION The present invention relates generally to the field of cosmetics and, more specifically, to a robotic cosmetic application device capable of precise and controlled movements for applying makeup, utilizing machine learning, artificial intelligence, augmented reality, and other technologies. BACKGROUND The background description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in this background section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are neither expressly nor impliedly admitted as prior art against the present disclosure. While there are devices that allow for the application of makeup, these makeup applicators are typically manually operated and do not provide precision, customization, and versatility beyond the user's baseline makeup knowledge and skills. Moreover, these makeup applicators may be difficult to use for users with certain disabilities. SUMMARY In one aspect, a robotic cosmetic application device is provided, comprising: one or more sensors configured to capture real-time data associated with a face of a user; one or more robotic arms equipped with one or more respective makeup applicator tools; a controller, comprising: one or more processors; and one or more memories storing non-transitory computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to: receive, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by the user; analyze the real-time data associated with the face of the user in order to generate a three-dimensional map associated with the face of the user; identify one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and control the one or more robotic arms to automatically adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to the facial features of the user in order to achieve the makeup look selected by the user. The robotic cosmetic application device may include additional, fewer, or alternate elements, including those discussed elsewhere herein. In another aspect, a computer-implemented method for controlling a robotic cosmetic application device via one or more processors is provided. The method may include receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by the user; analyzing real-time data associated with the face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user; identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to the facial features of the user in order to achieve the makeup look selected by the user. The method may include additional, fewer, or alternate actions, including those discussed elsewhere herein. In still another aspect, a non-transitory computer-readable storage medium storing instructions for controlling a robotic cosmetic application device is provided. The computer-readable instructions, when executed by one or more processors, may cause the one or more processors to perform a method. The method may include receiving, from a user interface associated with the intelligent robotic cosmetic application device, an indication of a makeup look selected by the user; analyzing real-time data associated with the face of the user captured by one or more sensors in order to generate a three-dimensional map associated with the face of the user; identifying one or more facial features of the face of the user on the three-dimensional map associated with the face of the user; and controlling one or more robotic arms of the intelligent robotic cosmetic application device, equipped with one or more respective makeup applicator tools, to automatically adjust the one or more respective makeup applicator tools with respect to the face of the user, to apply one or more cosmetic products to the facial features of the user in order to achieve the makeup look selected by the user. The instructions may direct additional, fewer, or alternative functionality, including that discussed elsewhere herein. Advantages will become more apparent to those of ordinary skill in the art from the following description of the preferred embodiments which have b