US-12627861-B2 - Method of controlling energy consumed by a mulitmedia streaming application

US12627861B2US 12627861 B2US12627861 B2US 12627861B2US-12627861-B2

Abstract

A method of controlling energy consumed by a multimedia streaming application executed in a multimedia streaming system, the method comprising: receiving ( 358 ), at an end-user device, a message including information representative of energy consumed by at least one node of the multimedia streaming system when applying at least one process on content having a first profile delivered by the multimedia streaming application prior to delivering the content having the first profile to the end-user device; and requesting ( 359 ), at the end-user device, content having a second profile based on the received information representative of the energy consumed by the at least one node.

Inventors

Christel Chamaret
Edouard Francois
Miloš Radosavljevic
Erik Reinhard
Zoubida Ameur
Remi Houdaille

Assignees

INTERDIGITAL MADISON PATENT HOLDINGS, SAS

Dates

Publication Date: 20260512
Application Date: 20210816
Priority Date: 20200901

Claims (16)

1 . A method of controlling energy actually consumed by a multimedia streaming application for streaming data executed in a multimedia streaming system, the method comprising: determining, at an intermediate node of the multimedia streaming system, a first energy actually consumed by the intermediate node when applying at least one first process on the data; receiving, at the intermediate node, a message generated by a source node, different from the intermediate node, intended to transport information representative of the energy actually consumed by the multimedia streaming application to an end-user device different from the intermediate node; inserting, at the intermediate node, into the message an information representative of the first energy; and controlling at least one characteristic of the streaming of the data, thereby modifying the energy actually consumed by the multimedia streaming application, based at least on the information representative of the first energy inserted into the message; wherein the information representative of the first energy further comprises a first syntax element specifying that the type of the streaming is a one-to-many streaming, and a second syntax element specifying a number of next nodes to which the data is distributed by the intermediate node.
2 . The method of claim 1 , further comprising transmitting the message to at least one next node of the system involved in the multimedia streaming application.
3 . The method of claim 1 , wherein the message is received from a prior node of the multimedia streaming system involved in the multimedia streaming application and different from the source node, and wherein the message comprises information representative of a second energy actually consumed by the prior node when applying at least one second process on the data.
4 . The method of claim 1 , wherein the data is any of (i) an original bitstream representative of a multimedia content, (ii) at least one bitstream representative of a profile of the multimedia content obtained from the original bitstream, or (iii) at least one bitstream representative of a profile of the multimedia content obtained from the multimedia content.
5 . The method of claim 4 , wherein the at least one first process comprises one or more of: receiving the original bitstream or the at least one bitstream from a prior node; distributing the at least one bitstream to at least one next node; transcoding the original bitstream into the at least one bitstream; decoding the original bitstream and encoding the decoded original bitstream in the at least one bitstream; or multiplexing the at least one bitstream and/or routing the at least one bitstream.
6 . The method of claim 1 , wherein the information representative of the first energy further comprises at least one third syntax element, and wherein each third syntax element of the at least one third syntax element specifies a type of process applied by the intermediate node.
7 . The method of claim 1 , wherein the message is a first message, and wherein the intermediate node estimates an energy actually consumed by a preceding intermediate node different from the source node unable to manage a message intended to transport information representative of the energy actually consumed by the multimedia streaming application and inserts an information representative of the estimated energy in the first message.
8 . A method of controlling an energy actually consumed by a multimedia streaming application executed in a multimedia streaming system, the method comprising, when executed in a node of the system, receiving data representative of a multimedia content, receiving a message generated by the method according to claim 3 , and, modifying a characteristic of the data representative of the multimedia content involved in the energy actually consumed by the multimedia streaming system in function of information contained in the message.
9 . A non-transitory information storage medium storing program code instructions for implementing the method according to claim 3 .
10 . An intermediate node of a multimedia streaming system executing a multimedia streaming application for streaming data, the node comprising electronic circuitry configured for: determining, at the intermediate node of the multimedia streaming system, a first energy actually consumed by the intermediate node when applying at least one first process on the data; receiving, at the intermediate node, a message generated by a source node, different from the intermediate node, intended to transport information representative of the energy actually consumed by the multimedia streaming application to an end-user device different from the intermediate node; inserting, at the intermediate node, into the message an information representative of the first energy; and controlling at least one characteristic of the streaming of the data, thereby modifying the energy actually consumed by the multimedia streaming application, based at least on the information representative of the first energy inserted into the message; wherein the information representative of the first energy further comprises a first syntax element specifying that the type of the streaming is a one-to-many streaming, and a second syntax element specifying a number of next nodes to which the data is distributed by the intermediate node.
11 . The intermediate node of claim 10 , wherein the electronic circuitry is further configured for transmitting the message to at least one next node of the multimedia streaming system involved in the multimedia streaming application.
12 . The intermediate node of claim 10 , wherein the message is received from a prior node of the multimedia streaming system involved in the multimedia streaming application and different from the source node, and wherein the message comprises information representative of a second energy actually consumed by the prior node when applying at least one second process on the data.
13 . The intermediate node of claim 10 , wherein the data is any of an original bitstream representative of a multimedia content, at least one bitstream representative of a profile of the multimedia content obtained from the original bitstream, or at least one bitstream representative of a profile of the multimedia content obtained from the multimedia content.
14 . The intermediate node of claim 13 , wherein the at least one first process comprises one or more of: receiving the original bitstream or the at least one bitstream from a prior node; distributing the at least one bitstream to at least one next node; transcoding the original bitstream into the at least one bitstream; decoding the original bitstream and encoding the decoded original bitstream in the at least one bitstream; or multiplexing the at least one bitstream and/or routing the at least one bitstream.
15 . The intermediate node of claim 10 , wherein the information representative of the first energy further comprises at least one third syntax element, and wherein each third syntax element of the at least one third syntax element specifies a type of process applied by the intermediate node.
16 . The intermediate node of claim 10 , wherein the message is a first message, and wherein the intermediate node estimates an energy actually consumed by a preceding intermediate node different from the source node unable to manage a message intended to transport information representative of the energy actually consumed by the multimedia streaming application and inserts an information representative of the estimated energy in the first message.

Description

CROSS REFERENCE TO RELATED APPLICATIONS This application is a U.S. National Stage Application under 35 U.S.C. § 371 of International Patent Application No. PCT/EP2021/072669, filed Aug. 16, 2021, which is incorporated herein by reference. This application claims priority to European Patent Application Nos. (i) 20305966.2, filed Sep. 1, 2020, and (ii) 21305872.0, filed Jun. 24, 2021; each of which is incorporated herein by reference in its entirety. 1. TECHNICAL FIELD At least one of the present embodiments generally relates to a method, apparatuses and a system for collecting information representative of an energy consumed by a multimedia streaming application and a method, apparatuses and systems using the collected information to control an energy consumed by a multimedia streaming application. 2. BACKGROUND Reducing our energy consumption is a major issue. This issue concerns many fields and in particular the field of electronic systems. The last few years have seen the emergence of multimedia streaming applications to such an extent that this type of applications now represents a significant part of the overall consumption of electrical energy. A recent initiative of the MPEG community can be considered as a preliminary tentative of investigating the subject of the energy consumed by multimedia streaming applications. This initiative released metadata related to the reduction of energy consumption in video codecs (encoder, decoder and display) while preserving acceptable video quality. No specific changes have been made to codecs architecture. MPEG standardized two ways of transporting this metadata: by SEI (Supplemental Enhancement Information) messages embedded in the video stream and embedded in a MPEG2 Transport stream. Encoder complexity and consumption can be reduced by alternating low-and high-quality segments in a video stream, requiring less energy use (less modes, less exhaustive search . . . ). At the decoder, the energy consumption is decreased by piloting a CPU frequency of the decoding device. More details can be found in the document ISO/IEC JTC1/SC29/WG11 N13468, “Context, Objectives, Use Cases and Requirements for Green MPEG”, April 2013, Incheon, Korea. As can be seen, green MPEG concentrates mainly on the codecs which is only a sub-part of all devices involved in multimedia streaming applications, called the multimedia streaming chain in the following. As a consequence, green MPEG allows controlling only an energy consumed by said sub-part and not by the complete multimedia streaming chain. A key aspect to be able to control efficiently the energy consumed by a multimedia streaming application is to obtain information representing the energy actually consumed by said application. However, while it is relatively easy to obtain information on the energy consumed by the codec, no standard tool allows obtaining information on the energy consumed by the rest of the multimedia streaming chain. Hence, an end-user does not have the means to really assess and control the multimedia streaming application energy consumption. Any solution allowing an end user obtaining information on the energy consumed by its multimedia streaming application is therefore welcome. This information would allow for example the end user being more responsible and actor of its own energy consumption and implementing strategies to reduce this energy consumption. It is desirable to propose solutions providing information on the energy consumed by a complete multimedia streaming chain. 3. BRIEF SUMMARY In a first aspect, one or more of the present embodiments provide a method of controlling energy consumed by a multimedia streaming application executed in a multimedia streaming system, the method comprising: receiving, at an end-user device, a message including information representative of energy consumed by at least one node of the multimedia streaming system when applying at least one process on content having a first profile delivered by the multimedia streaming application prior to delivering the content having the first profile to the end-user device; andrequesting, at the end-user device, content having a second profile based on the received information representative of the energy consumed by the at least one node. In an embodiment, the method comprises displaying, at an end-user device, energy modes representative of different profiles of the content; wherein the content having the second profile is further requested based on a energy mode selected from among the displayed energy modes. In a second aspect, one or more of the present embodiments provide a method of controlling energy consumed by a multimedia streaming application for streaming data executed in a multimedia streaming system, said method comprising: determining, at a node of the multimedia streaming system, a first energy consumed by said node when applying at least one first process on said data;obtaining, at said node, a message intended to tra