Search

EP-4466947-B1 - MODIFICATION OF IMAGES FOR PALETTE EXTRACTION BASED ON CONTEXT

EP4466947B1EP 4466947 B1EP4466947 B1EP 4466947B1EP-4466947-B1

Inventors

  • SQUILLACE, Jorge,Gabriel
  • SINHA, Shubhendu, Subodh
  • MEERBEEK, Berent, Willem

Dates

Publication Date
20260506
Application Date
20230112

Claims (14)

  1. A method (300) of controlling a plurality of light sources (140, 142) based on a source image (200), wherein the plurality of light sources (140, 142) are installed in an environment (150), the method (300) comprising: obtaining (302) contextual information of the environment (150), modifying (304) the source image (200) based on the contextual information into a modified source image (210), characterised in extracting (306) a set of colors present in the modified source image (210), and controlling (314) the plurality of light sources (140, 142) based on the set of colors of the modified source image (210).
  2. The method (300) of claim 1, wherein obtaining (302) contextual information of the environment (150) comprises detecting contextual information from an image of the environment (150).
  3. The method (300) of claim 1 or 2, wherein obtaining (302) contextual information of the environment (150) comprises detecting contextual information from audio and/or motion captured in the environment (150).
  4. The method (300) of any one of the preceding claims, wherein obtaining (302) contextual information of the environment (150) comprises detecting contextual information from ambient light and/or ambient temperature sensed in the environment (150).
  5. The method (300) of any one of the preceding claims, further comprising rendering (316) the modified source image (210) on a display (106).
  6. The method (300) of any one of the preceding claims, wherein controlling (314) the plurality of light sources (140, 142) comprises controlling a first light source (140) based on a first color of the set of colors and controlling a second light source (142) based on a second color of the set of colors.
  7. The method (300) of claim 6, further comprising sorting (308) the set of colors according to a predefined color scale, and wherein controlling (314) the plurality of light sources (140, 142) comprises first controlling the plurality of light sources (140, 142) based on the first color of the sorted set of colors and subsequently controlling the plurality of light sources (140, 142) based on the second color of the sorted set of colors.
  8. The method (300) of any one of the preceding claims, wherein obtaining (302) contextual information of the environment (150) comprises determining a type of the environment (150) based on the contextual information and modifying (304) the source image (200) is based on the determined type of the environment (150) into the modified source image (210).
  9. The method (300) of any one of the preceding claims, wherein the contextual information is a set of colors present in the environment (150).
  10. The method (300) of any one of the preceding claims, wherein modifying (304) the source image (200) into a modified source image (210) is also based on a time of day.
  11. The method (300) of any one of the preceding claims, wherein modifying (304) the source image (200) into a modified source image (210) comprises applying one or more filters to the source image (200).
  12. The method (300) of any one of the preceding claims, further comprising: storing (310) the extracted (306) set of colors in a memory (108), and recalling (312) the stored (310) set of colors.
  13. A lighting control system (100) for controlling a plurality of light sources (140, 142) based on a source image (200), wherein the plurality of light sources (140, 142) are installed in an environment (150), the lighting control system (100) comprising: a processor (104) configured to obtain contextual information of the environment (150), to modify the source image (200) based on contextual information into a modified source image (210), and characterised in that the processor is configured to extract a set of colors present in the modified source image (210), wherein the processor (104) is further configured to control the plurality of light sources (140, 142) based on the set of colors present in the modified source image (210).
  14. A computer program product for the lighting control system (100) of claim 13, the computer program product comprising computer program code to perform the method (300) of any one of claims 1 to 12 when the computer program product is run on the processor (104) of the lighting control system (100).

Description

FIELD OF THE INVENTION The present invention generally relates to controlling light sources based on modification of an image. BACKGROUND OF THE INVENTION Home and professional environments contain a large number of lighting devices for creation of ambient, atmosphere, accent or task lighting. These controllable lighting devices may be controlled via user interface of a control device, for example a smartphone, via a (wireless) network. An example of such a user interface is disclosed in patent application WO 2013121311 Al, which discloses a remote control unit that comprises a user interface through which a user may identify an area in an image and a light source. The identified image area is linked with the light source and color information of the identified image area is transmitted to the light source. The light setting of the light source is thereby controlled based on the color information. A user is thereby enabled to pick the color to be outputted by a light source by selecting an area in an image displayed on the remote control unit. US2020374998A1 discloses controlling a plurality of light sources based on a source image. SUMMARY OF THE INVENTION The inventors have realized that when controlling a light source based on an image, the image may not be suitable for the environment that the light source is installed in. It is therefore an object of the present invention to provide a system and a method that provide an image that is representative for the environment that the light source(s) are installed in. According to a first aspect of the present invention, the object is achieved by a method for controlling a plurality of light sources based on a source image having the features in the independent claim. Preferred embodiments are defined in the dependent claims. Hence, according to a first aspect of the present invention, there is provided a method of controlling a plurality of light sources based on a source image, wherein the plurality of light sources may be installed in an environment. The method comprises: obtaining contextual information of the environment, modifying the source image based on the contextual information into a modified source image, extracting a set of colors present in the modified source image, and controlling the plurality of light sources based on the set of colors of the modified source image. Thus, the present invention is based on the idea of providing a way to use contextual information to modify a picture differently such that the resulting palette may be affected every time a scene is recalled. The difference in palette may in principle be hidden to the user or made explicit by showing the corresponding image that is the current scene under e.g. a modified filter. The plurality of light sources may e.g. be LED light bulbs that are configured to emit light with different colors based on a control signal of a control device, such as a smartphone or remote. Alternatively, the plurality of light sources may e.g. be light bulbs that configured to emit light with different hue, color temperature, brightness, or intensity based on a control signal of a control device. The environment may e.g. be a room or zone where the light sources are installed, such as a kid's room or a hall. Metadata regarding the environment, such as the type of room, may be obtained directly from sensors monitoring the environment such as an image capturing device, temperature sensor, light sensor, acoustic sensor or motion sensor, or by manual input from a user. Modifying the source image based on the contextual image may comprise determining that e.g. a certain type of environment or a predetermined amount of motion in an environment may be modified in a specific way. For example, a kid's room may be more saturated than other similar rooms. In principle, the source image is not completely replaced and the intended color scheme or ambience that a user may have previously selected for a specific environment is not changed, but rather the specific implementation of the source image is modified to better suit the environment. Controlling the light sources may comprise controlling first light source of the plurality of light sources based on a first color of the modified source image. The modified source image may, for example, contain a plurality of colors. The first color, e.g. green, may be automatically extracted from the modified source image. Alternatively, a user may select an area in the modified source image to pick the first color, e.g. green, from the image. Subsequently, the first light source may be controlled such that it emits light (e.g. green light) based on the first color. Similarly, a second light source of the plurality of light sources may be controlled based on a second color of the modified source image. The present invention may thereby be advantageous in that the environmental light of the environment is based on, e.g., what kind of room a user is situated in and what kind of