Search

EP-4736442-A1 - VISUAL CONTENT ENERGY REDUCTION BASED ON ATTENUATION MAP USING INTERACTIVE GREEN MPEG METADATA

EP4736442A1EP 4736442 A1EP4736442 A1EP 4736442A1EP-4736442-A1

Abstract

An interactive exchange of messages between a receiver and a transmitter allows the use of an attenuation map for reducing the energy consumption by modifying the pixel values of the image. Parameters related to the attenuation map are provided by the receiver through a display power reduction request message. Parameters comprise at least an energy reduction rate or a quality reduction rate and may also comprise parameters describing the receiver capabilities. In response to this message, the transmitter generates an attenuation map accordingly and provides it to the receiver, with an encoded image and a second set of parameters. Encoding and decoding methods and devices are described.

Inventors

  • AUMONT, FRANCK
  • LE MEUR, OLIVIER
  • DEMARTY, CLAIRE-HELENE
  • REINHARD, ERIK
  • BLONDE, LAURENT

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260506
Application Date
20240613

Claims (15)

  1. 1. A method comprising: - transmitting a display power reduction request message comprising at least an energy reduction rate or a quality reduction rate; - obtaining data comprising at least an encoded image, an attenuation map and a set of parameters; - reducing values of luminance or chrominance components of the image by decoding the image and applying the attenuation map to the image based on the set of parameters; and - providing a modified image comprising reduced values of luminance or chrominance components of the image.
  2. 2. The method of claim 1, wherein the display power reduction request message is transmitted responsive to an event related to energy reduction.
  3. 3. The method of any of claim 1 or 2, wherein a parameter is representative of an operation for applying an attenuation map to an image, the operation being selected in a set of operations comprising addition, subtraction, multiplication, and division.
  4. 4. The method of any of claims 1 to 3, wherein a parameter is representative of a mapping between components of the attenuation map and image components affected by the operation and is selected in a set comprising applying a component of the attenuation map to luma component, applying a component of the attenuation map to luma and both chroma components, applying a component of the attenuation map to three RGB components, applying a first component of the attenuation map to luma component and a second component of the attenuation map to both chroma components, applying three components of the attenuation map respectively to luma component and both chroma components, applying three components of the attenuation map respectively to three RGB components, applying a first component of the attenuation map to the first component, applying a second component of the attenuation map to the second component, and applying a third component of the attenuation map to the third component.
  5. 5. A method comprising: - obtaining a display power reduction request message comprising a first set of parameters, the parameters comprising at least an energy reduction rate or a quality reduction rate; - obtaining an input image of a video; - determining an attenuation map based on the input image according to the energy reduction rate or quality reduction rate, wherein applying the attenuation map to the input image reduces values of luminance or chrominance components of the input image; and - generating an encoded video comprising at least the input image, the attenuation map and a second set of parameters, wherein the second set of parameters comprises at least a parameter representative of the energy reduction rate or the quality reduction rate; wherein the display power reduction request message, the display power reduction response message and the set of parameters are formatted according to a MPEG green metadata SEI message.
  6. 6. The method of any of claim 1 to 5, wherein the display power reduction request message, the display power reduction response message and the set of parameters are formatted according to a MPEG green metadata SEI message.
  7. 7. The method of any of claims 1 to 6, wherein the set of parameters is carried by supplemental enhancement message according to a format specified in ISO/IEC 23001-11 and the attenuation map is carried by an auxiliary picture according to the format specified in ISO/IEC 23002-3 and ISO/IEC 14496-10 or ISO/IEC DIS 23008-2 or ISO/IEC FDIS 23002-7.
  8. 8. An apparatus comprising a processor configured to, responsive to an event related to energy reduction: - transmit a display power reduction request message comprising at least an energy reduction rate or quality reduction rate corresponding to the event related to energy reduction; - obtain data comprising at least an encoded image, an attenuation map and a set of parameters; - reduce values of components of the image by decoding the image and applying the attenuation map to the decoded image based on the set of parameters; and - provide a modified image comprising reduced values of luminance or chrominance components of the image.
  9. 9. The apparatus of claim 8, wherein a parameter is representative of an operation for applying an attenuation map to an image, the operation being selected in a set of operations comprising addition, subtraction, multiplication, and division.
  10. 10. The apparatus of any of claims 8 or 9, wherein a parameter is representative of a mapping between components of the attenuation map and image components affected by the operation and is selected in a set comprising applying a component of the attenuation map to luma component, applying a component of the attenuation map to luma and both chroma components, applying a component of the attenuation map to three RGB components, applying a first component of the attenuation map to luma component and a second component of the attenuation map to both chroma components, applying three components of the attenuation map respectively to luma component and both chroma components, applying three components of the attenuation map respectively to three RGB components, applying one component of the attenuation map to the first component, applying one component of the attenuation map to the second component, and applying one component of the attenuation map to the third component.
  11. 11. The apparatus of any of claims 8 to 10, wherein the apparatus is one of a television, a television signal receiver, a set-top box, a gateway device, a mobile device, a cell phone, a tablet, a computer, a laptop, or other electronic device.
  12. 12. An apparatus comprising a processor configured to: - obtain a display power reduction request message comprising a set of parameters, the parameters comprising at least an energy reduction rate or quality reduction rate; - obtain an input image of a video; - determine an attenuation map based on the input image according to the obtained energy reduction rate or quality reduction rate, wherein applying the attenuation map to the input image reduces values of components of the input image; and - generate an encoded video comprising at least the input image, the attenuation map and a second set of parameters, wherein the second set of parameters comprises at least a parameter representative of the energy reduction rate or the quality reduction rate.
  13. 13. A bitstream, formatted to include syntax elements in obtained using the method of any of claims 10 or 11.
  14. 14. A computer program comprising instructions, which, when executed by a computer, cause the computer to carry out the method according to any of claims 1 to 7.
  15. 15. A non-transitory computer readable medium storing executable program instructions to cause a computer executing the instructions to perform a method according to any of claims 1 to 7.

Description

VISUAL CONTENT ENERGY REDUCTION BASED ON ATTENUATION MAP USING INTERACTIVE GREEN MPEG METADATA CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the priority to European Application N° 23306070.6 filed 29 June 2023 and European Application N° 23306159.7 filed 7 July 2023, which are incorporated herein by reference in their entirety. TECHNICAL FIELD The disclosure is in the field of video compression, and at least one embodiment relates more specifically to encoding and decoding a video comprising attenuation map information and corresponding parameters carried through interactive green MPEG metadata syntax elements, the application of the attenuation map allowing a reduction of the energy consumption when using the video, for example when rendering it on a display. BACKGROUND ART Reducing energy consumption of electronic devices has become a requirement not only for manufacturers of electronic devices but also to limit, as much as possible, the environmental impact and to contribute to the emergence of a sustainable display industry. The increase in display resolution from SD to HD, then to 4K and soon to 8K and beyond, as well as the introduction of high dynamic range imaging, has brought about a corresponding increase in energy requirements of display devices. This is not consistent with the global need to reduce energy consumption knowing that a huge number of devices has a display (i.e., TV, Mobile phones, tablets, etc.). Indeed, displays are the most important source of energy consumption, for consumer electronic devices, either battery-powered (e.g., smartphones, tablets, head-mounted displays, car display screens) or not (e.g., television sets, advertisement display panels). Different display technologies have been developed in the recent years. Although modem displays consume energy in a more controllable and efficient manner than older displays, they remain the most important source of energy consumption in a video chain. As far as backlight displays are concerned, their energy consumption is largely determined by the intensity of the backlight. Organic Light Emitting Diode (OLED) is one example of display technology that is finding increasingly widespread use because of numerous advantages compared to former technologies such as Thin-Film Transistor Liquid Crystal Displays (TFT-LCDs). Rather than using a uniform backlight, OLED displays, as well as mini LEDS, are composed of individual directly emissive image pixels. OLEDs power consumption is therefore highly correlated to the image content and the power consumption for a given input image can be estimated by considering the values of the displayed image pixels. Although OLED displays consume energy in a more controllable and efficient manner, they are still the most important source of energy consumption in the video chain. The ISO/IEC 23001-11 specification already specifies specific metadata, so-called Green Metadata, that enables the reduction of energy usage during media consumption, specifically at the display side. The metadata for display adaptation as defined in this specification are designed for a specific display and are particularly well tailored to transmissive display technologies embedding backlight illumination such as LCD displays. These metadata are designed to attain display energy reductions by using display adaptation techniques. They are composed of metrics made of RGB-component statistics and quality indicators of the video content. They can be used to perform RGB picture components rescaling to set the best compromise between backlight/voltage reduction and picture quality. This specification is herein called Green metadata specification. The Green metadata specification currently defines two types of metadata that are described in the SEI (supplemental enhancement information) message thanks to the metadata element “green metadata type”. If “green metadata type” is 0, then complexity metrics are present. If “green metadata type” is 1, then metadata enabling quality recovery after low- power encoding is present. Other values of “green metadata type” are reserved for future use by ISO/IEC. Since the ISO/IEC 23001-11 document was published new emissive technologies have been introduced with the spread of emissive OLED displays, which allow a pixel-wise and more efficient control of their energy consumption, and consequently, reduction. If the metadata already defined in the standard convey information for reduction of the energy consumed by displays, they also have the following drawbacks. First, they are tailored for backlit display technologies and therefore convey global information on statistics derived from the input content, and do not provide any information related to a pixel-wise attenuation map. Second, such global information is far from optimal when applied to more controllable directly emissive displays, for which it would be possible to apply energy reduction at the pixel level, allowing mor