Search

CN-122003709-A - Method and apparatus for pixel color replacement in complementary color based video

CN122003709ACN 122003709 ACN122003709 ACN 122003709ACN-122003709-A

Abstract

A method and apparatus propose to modify the colour of the pixels of a video to reduce the energy required to display the video. This is achieved by determining a pair of replacement complementary colors for a pair of co-located pixels of a successive frame of video and replacing the colors of the pair of co-located pixels with the pair of replacement complementary colors. The pair of alternative complementary colors is selected to provide energy reduction while ensuring perceptual similarity so as to provide a satisfactory quality of experience. Different embodiments propose different solutions to apply the replacement procedure to different arrangements of frames and pixels.

Inventors

  • C-H. Demati
  • K. Raven
  • L. Brown
  • AUMUND F.

Assignees

  • 交互数字CE专利控股有限公司

Dates

Publication Date
20260508
Application Date
20240919
Priority Date
20230929

Claims (15)

  1. 1. A method, comprising: obtaining a first pair of colors for a pair of pixels, wherein a first pixel of the pair of pixels is included in a first image of a video and a second pixel of the pair of pixels is included in a second image of the video, and wherein the first pixel and the second pixel are co-located in the image; Determining an average color between colors in the first pair of colors; determining a second pair of colors, wherein colors of the second pair of colors are symmetrical about the average color and a sum of energy consumed by displaying a pair of pixels having the second pair of colors is lower than a sum of energy consumed by displaying a pair of pixels having the first pair of colors, and The first pair of colors of the pair of pixels is replaced with the second pair of replacement colors.
  2. 2. The method of claim 1, wherein the first color of the second pair of colors is determined based on a distance from the first color of the first pair of colors.
  3. 3. The method of any one of claims 1 or 2, wherein a first color of the first pair of colors is perceptually identical to a first color of the second pair of colors, and a second color of the first pair of colors is perceptually identical to a second color of the second pair of colors.
  4. 4. The method of any one of claims 1 to 3, further comprising determining a set of color pairs of minimum energy and selecting the second pair of colors from the set of color pairs of minimum energy.
  5. 5. The method of any of claims 1-4, wherein the second image immediately follows the first image.
  6. 6. The method of any one of claims 1 to 5, further comprising iteratively performing the method on a plurality of first pairs of colors and storing an association between a first pair of colors and a corresponding second pair of colors.
  7. 7. The method of claim 6, wherein a pair of colors is used as an index, the association being stored in a correspondence table.
  8. 8. A method, comprising: Obtaining visual content; iterating through successive frames of the visual content, iterating through co-located pairs of pixels in the successive frames, and for a pair of iterated pixels: a method according to any one of claims 1 to 7, determining a second pair of colors for the pair of iterated pixels, and Modifying the visual content by replacing the colors of the pair of iterated pixels with the second pair of colors, and The modified visual content is provided.
  9. 9. An apparatus comprising a processor configured to: obtaining a first pair of colors for a pair of pixels, wherein a first pixel of the pair of pixels is included in a first image of a video and a second pixel of the pair of pixels is included in a second image of the video, and wherein the first pixel and the second pixel are co-located in the image; Determining an average color between colors in the first pair of colors; determining a second pair of colors, wherein colors of the second pair of colors are symmetrical about the average color and a sum of energy consumed by displaying a pair of pixels having the second pair of colors is lower than a sum of energy consumed by displaying a pair of pixels having the first pair of colors, and The first pair of colors of the pair of pixels is replaced with the second pair of replacement colors.
  10. 10. The apparatus of claim 9, wherein a first color of the first pair of colors is perceptually identical to a first color of the second pair of colors, and a second color of the first pair of colors is perceptually identical to a second color of the second pair of colors.
  11. 11. The apparatus of any one of claims 9 or 10, wherein the processor further comprises iteratively performing the method for a plurality of first pairs of colors and storing associations between the first pairs of colors and corresponding second pairs of colors.
  12. 12. The apparatus of claim 11, wherein a pair of colors is used as an index, the association being stored in a correspondence table.
  13. 13. An apparatus comprising a processor configured to: Obtaining visual content; iterating through successive frames of the visual content, iterating through co-located pairs of pixels in the successive frames, and for a pair of iterated pixels: a method according to any one of claims 9 to 12, determining a second pair of colors for the pair of iterated pixels, and Modifying the visual content by replacing the colors of the pair of iterated pixels with the second pair of colors, and The modified visual content is provided.
  14. 14. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 8.
  15. 15. A non-transitory computer readable medium storing executable program instructions to cause a computer to execute the instructions to perform the method of any one of claims 1 to 8.

Description

Method and apparatus for pixel color replacement in complementary color based video Cross Reference to Related Applications The present application claims priority from european application number 23306641.4 filed on 9/29 of 2023, the entire contents of which are incorporated herein by reference. Technical Field The present disclosure is in the field of video content distribution, and more particularly, at least one embodiment relates to reducing energy consumption for displaying video by replacing colors of a pair of co-located pixels in successive frames of video with complementary colors. Background Reducing the power consumption of electronic devices has not only become a requirement for manufacturers of electronic devices, but also to limit the environmental impact as much as possible and to facilitate the advent of the sustainable display industry. The increase in display resolution from SD to HD, then to 4K and soon to 8K and higher, and the introduction of high dynamic range imaging has led to a corresponding increase in the energy requirements of display devices. A large number of devices are known with displays (i.e. TV, mobile phones, tablet computers, etc.), which do not meet the global need to reduce power consumption. Indeed, for consumer electronics devices, whether battery-powered devices (e.g., smart phones, tablet computers, head mounted displays, automotive display screens) or non-battery-powered devices (e.g., televisions, advertising display panels), the display is the most important source of energy consumption. In recent years, different display technologies have been developed. While modern displays consume energy in a more controlled and efficient manner than older displays, they remain the most important source of energy consumption in the video chain. In the case of a backlit display, its power consumption is primarily determined by the intensity of the backlight. An Organic Light Emitting Diode (OLED) is one example of a display technology, which is finding more and more popular use compared to previous technologies such as thin film transistor liquid crystal displays (TFT-LCDs) because of a number of advantages. Instead of using a uniform backlight, OLED displays and mini LEDS include individual direct-emitting image pixels. OLED power consumption is thus highly correlated with image content, and by taking into account the values of the displayed image pixels, the power consumption of a given input image can be estimated. It is therefore interesting to carefully study energy-aware images or videos, i.e. images or videos that will require less energy, especially when displayed on a consumer electronic device OLED display. Techniques for reducing energy consumption include the use of Spatially Alternating Complementary Colors (SACCs) as described in international patent application WO2024132682A1 or Temporally Alternating Complementary Colors (TACCs) as described in international patent application WO2024132680A1, for example. Common within the techniques described in both applications is that they relate to a reduction of the energy requirements of the display device, with the aim of maintaining a quality of experience (QoE) based on contrast, brightness, temporal smoothness or color level, for example by using the principle of alternating complementary colors. Disclosure of Invention In view of the foregoing, the embodiments described below have been designed and a process for modifying video is introduced to reduce its power consumption while maintaining perceptual similarity. The process may be applied to a pair of co-located pixels in successive frames of the video and based on replacing an original color of the pair of co-located pixels with a pair of replacement colors that are symmetrical about an average color of the colors of the pair of pixels. The pair of alternate colors may be selected such that the sum of the energy consumed by displaying the pair of pixels of the alternate colors is lower than the sum of the energy consumed by displaying the pair of pixels of the original colors. The pair of alternative colors may be selected to be perceptually individually similar or close to the pair of original colors. This process is named color replacement in video for energy reduction, hereinafter abbreviated CRV. A first aspect relates to a method comprising obtaining a first pair of colors of a pair of pixels, wherein a first pixel of the pair of pixels is included in a first image of a video and a second pixel of the pair of pixels is included in a second image of the video, and wherein the first pixel and the second pixel are co-located in the image, determining an average color between colors of the first pair of colors, determining a second pair of colors, wherein colors of the second pair of colors are symmetric about the average color, and a sum of energy consumed by displaying a pair of pixels having the second pair of colors is lower than a sum of energy consumed by