EP-4736465-A1 - METHOD AND DEVICE FOR ENERGY REDUCTION OF VISUAL CONTENT BASED ON PIXEL-WISE ATTENUATION

Abstract

A video receiver sends, to a video transmitter, first information indicative of a request for video content adapted for energy-reduced rendering, the request comprising information indicative of at least one of a requested energy reduction rate and an accepted video quality reduction, receives, from the video transmitter, the video content, receives, from the video transmitter, second information relative to the video content, the second information indicative of an expected energy reduction rate and a measure of reduced video quality for a corresponding selected metric, and provides the video content for display.

Inventors

• AUMONT, FRANCK
• LE MEUR, OLIVIER
• DEMARTY, CLAIRE-HELENE
• BLONDE, LAURENT
• REINHARD, ERIK

Assignees

• InterDigital CE Patent Holdings, SAS

Dates

Publication Date

20260506

Application Date

20240614

Claims (20)

1. 1. A method performed by a video receiver device and comprising: sending, to a video transmitter, first information indicative of a request for video content adapted for energy -reduced rendering, the request comprising information indicative of at least one of a requested energy reduction rate and an accepted video quality reduction; receiving, from the video transmitter, the video content; receiving, from the video transmitter, second information relative to the video content, the second information indicative of an expected energy reduction rate and a measure of reduced video quality for a corresponding selected metric; and providing the video content for display.
2. 2. The method of claim 1, further comprising, prior to the sending: receiving, from the video transmitter, first video content; and wherein the video content is adapted for a different energy reduction rate than the first video content.
3. 3. The method of claim 2, wherein the first information is sent upon determination that a battery of the video receiver device is below a given level.
4. 4. The method of claim 1, further comprising: sending, to the video transmitter, third information indicative of a request for the video transmitter to cancel adaptation of the video content for energy -reduced rendering.
5. 5. The method of claim 1, wherein the second information is received in a Supplemental Enhancement Information, SEI, message.
6. 6. The method of claim 1, wherein the request further comprises at least one of a type of display on which the video receiver device renders the video content, accepted processing for the video transmitter to apply an attenuation map to obtain the video content for energy- reduced rendering, an indication to cancel adaptation of the video content for energy -reduced rendering, an indicator of at least one video component, luminance and chroma, to be affected by adaptation for energy -reduced rendering, and an indicator whether the adaptation may be applied to only luminance or to all the video components.
7. 7. The method of claim 6, wherein the type of display comprises one of transmissive pixel display and emissive pixel display.
8. 8. A video receiver device comprising: a transmitter configured to send, to a video transmitter, first information indicative of a request for video content adapted for energy-reduced rendering, the request comprising information indicative of at least one of a requested energy reduction rate and an accepted video quality reduction; a receiver configured to receive, from the video transmitter, the video content and second information relative to the video content, the second information indicative of an expected energy reduction rate and a measure of reduced video quality for a corresponding selected metric; and a processor configured to provide the video content for display.
9. 9. The video receiver device of claim 8, wherein the receiver is further configured to: receive, from the video transmitter, first video content; and wherein the video content is adapted for a different energy reduction rate than the first video content.
10. 10. The video receiver device of claim 9, wherein transmitter is further configured to send the first information upon determination that a battery of the video receiver device is below a given level.
11. 11. The video receiver device of claim 8, wherein transmitter is further configured to: send, to the video transmitter, third information, indicative of a request for the video transmitter to cancel adaptation of the video content for energy -reduced rendering.
12. 12. The video receiver device of claim 8, wherein the second information is received in a Supplemental Enhancement Information, SEI, message.
13. 13. The video receiver device of claim 8, wherein the request further comprises at least one of a type of display on which the video receiver device renders the video content, accepted processing for the video transmitter to apply an attenuation map to obtain the video content for energy-reduced rendering, an indication to cancel adaptation of the video content for energy -reduced rendering, an indicator of at least one video component, luminance and chroma, to be affected by adaptation for energy -reduced rendering, and an indicator whether the adaptation may be applied to only luminance or to all the video components.
14. 14. The video receiver device of claim 13, wherein the type of display comprises one of transmissive pixel display and emissive pixel display.
15. 15. The video receiver device of claim 8, further comprising a screen configured to display the content.
16. 16. A method performed by a video transmitter and comprising: in response to a request, from a video receiver, for video content adapted for energy- reduced rendering, the request comprising energy-reduction parameters, generating a pixelwise attenuation map to be applied to the video content; and generating metadata indicative of at least one of an expected energy reduction rate, and a measure of reduced video quality for a corresponding selected metric.
17. 17. The method of claim 16, further comprising: applying the attenuation map pixel-wise to video content to obtain the video content adapted for energy-reduced rendering; and transmitting the video content adapted for energy-reduced rendering to the video receiver.
18. 18. The method of claim 17, further comprising: transmitting information indicative of the attenuation map to the video receiver.
19. 19. The method of claim 18, wherein the video content adapted for energy -reduced rendering and the information indicative of the attenuation map are transmitted in a single bitstream.
20. 20. The method of claim 16, further comprising transmitting the metadata to the video receiver.

Description

METHOD AND DEVICE FOR ENERGY REDUCTION OF VISUAL CONTENT BASED ON PIXEL- WISE ATTENUATION CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of European Patent Application 23306043.3, filed 28 June 2023, which is incorporated herein by reference in its entirety. TECHNICAL FIELD The disclosure is in the field of video compression, and at least one embodiment relates more specifically to encoding and decoding a video comprising attenuation map information and corresponding parameters, the pixel-wise application of the attenuation map allowing a reduction of the energy consumption when using the video, for example when rendering it on a display. BACKGROUND ART Reducing energy consumption of electronic devices has become a requirement not only for manufacturers of electronic devices but also to limit, as much as possible, the environmental impact and to contribute to the emergence of a sustainable display industry. The increase in display resolution from SD to HD, then to 4K and soon to 8K and beyond, as well as the introduction of high dynamic range imaging, has brought about a corresponding increase in energy requirements of display devices. This is not consistent with the global need to reduce energy consumption knowing that a huge number of devices has a display (i.e. , TV, Mobile phones, tablets, etc.). Indeed, displays are the most important source of energy consumption, for consumer electronic devices, either battery-powered (e.g., smartphones, tablets, head-mounted displays, car display screens) or not (e.g., television sets, advertisement display panels). Different display technologies have been developed in the recent years. Although modem displays consume energy in a more controllable and efficient manner than older displays, they remain the most important source of energy consumption in a video chain. As far as backlight displays are concerned, their energy consumption is largely determined by the intensity of the backlight. Organic Light Emitting Diode (OLED) is one example of display technology that is finding increasingly widespread use because of numerous advantages compared to former technologies such as Thin-Film Transistor Liquid Crystal Displays (TFT-LCDs). Rather than using a uniform backlight, OLED displays, as well as mini LEDS, are composed of individual directly emissive image pixels. OLEDs power consumption is therefore highly correlated to the image content and the power consumption for a given input image can be estimated by considering the values of the displayed image pixels. Although OLED displays consume energy in a more controllable and efficient manner, they are still the most important source of energy consumption in the video chain. ISO/IEC 23001-11 Energy-Efficient Media Consumption (Green Metadata) specifies metadata, so-called Green Metadata, that enable the reduction of energy usage during media consumption, specifically at the display side. The metadata for display adaptation as defined in this specification (section “Display power reduction using display adaptation”) are designed for a specific display and are particularly well tailored to transmissive display technologies embedding backlight illumination such as LCD displays. These metadata are designed to attain display energy reductions by using display adaptation techniques. They are composed of metrics made of RGB-component statistics and quality indicators of the video content, and can be used to perform RGB picture components rescaling to set the best compromise between backlight/voltage reduction and picture quality. They metadata differ depending on whether the use case is point-to-point transmission or point-to-multipoint transmission. Since the publication of ISO/IEC 23001-11, new emissive technologies have been introduced with the spread of emissive OLED displays, which allow a pixel-wise and more efficient control of their energy consumption, and consequently, a reduction of their energy consumption. If the metadata already defined in the standard convey information for reduction of the energy consumed by displays, they also have the following drawbacks. First, they are tailored for backlit display technologies and therefore convey global information on statistics derived from the input content, and do not provide any information related to a pixel-wise attenuation map. Second, such global information is far from optimal when applied to more controllable directly emissive displays, for which it would be possible to apply energy reduction at the pixel level, allowing more precise control both on the energy reduction and quality of experience. SUMMARY In a first aspect, the present principles are directed to a method performed by a video receiver device and comprising sending, to a video transmitter, first information indicative of a request for video content adapted for energy-reduced rendering, the request comprising information indicative of at least one of a requested energy r