CN-121979641-A - Multimedia task processing method and device, computer equipment, chip and chip module

CN121979641ACN 121979641 ACN121979641 ACN 121979641ACN-121979641-A

Abstract

The application relates to a multimedia task processing method, a device, computer equipment, a chip and a chip module, which relate to the technical field of system-on-chip and can give consideration to resource utilization efficiency and function expansion flexibility when processing multimedia tasks. The method comprises the steps of determining a first functional module related to a multimedia task from a plurality of functional modules of a chip according to task intention of the multimedia task to be processed, responding to the first functional module comprising a hardware functional module and a programmable module, configuring the programmable module according to a software program obtained in advance to obtain a plurality of second functional modules, reconstructing interconnection paths of the plurality of second functional modules, and transmitting data streams of the second functional modules among the plurality of second functional modules according to the first interconnection paths obtained after reconstruction in the process of executing the multimedia task by utilizing the plurality of second functional modules.

Inventors

Rao Guoming
CHEN BO
YANG HE

Assignees

展讯通信（上海）有限公司

Dates

Publication Date: 20260505
Application Date: 20260129

Claims (10)

1. A method of multimedia task processing, the method comprising: Determining a first functional module related to a multimedia task from a plurality of functional modules of a chip according to task intention of the multimedia task to be processed, wherein the plurality of functional modules comprise functional modules multiplexed in different multimedia task processing processes; responding to the first functional module comprising a hardware functional module and a programmable module, and configuring the programmable module according to a software program obtained in advance to obtain a plurality of second functional modules, wherein the plurality of second functional modules comprise the hardware functional module and the configured programmable module; Reconstructing interconnection paths of the plurality of second functional modules, and transmitting data streams of the second functional modules among the plurality of second functional modules according to the first interconnection paths obtained after reconstruction in the process of executing the multimedia tasks by using the plurality of second functional modules.
2. The method of claim 1, wherein the reconstructing the interconnect paths of the plurality of second functional modules comprises: determining a plurality of candidate paths of the plurality of second functional modules on the chip; determining the number of path hops according to the number of nodes included in each candidate path; And screening the plurality of candidate paths according to the path hop count of each candidate path to determine a first interconnection path.
3. The method of claim 2, wherein said screening said plurality of candidate paths based on said number of path hops for each of said candidate paths to determine a first interconnect path comprises: Determining the congestion degree of each candidate path; And determining first interconnection paths of the plurality of second functional modules from the plurality of candidate paths according to the path hop numbers and the congestion degrees, wherein the path hop numbers and the congestion degrees of the first interconnection paths meet preset screening conditions.
4. The method of claim 1, further comprising, after the reconstructing the interconnect paths of the plurality of second functional modules: Responding to the occurrence of a trigger event for updating the interconnection paths, and reconstructing the interconnection paths of the plurality of second functional modules again to obtain second interconnection paths of the chips; Writing the second interconnection path into a second area in a register of the chip, wherein the register further comprises a first area for storing first interconnection paths applied by the plurality of second functional modules when processing a current multimedia task image frame; after the data stream of the second functional module is transmitted between the plurality of second functional modules according to the reconstructed first interconnection path, the method further comprises: and after the current multimedia task image frame processing is finished, transmitting the subsequent data flow of the second functional modules among a plurality of the second functional modules according to the second interconnection path written in the second area.
5. The method of claim 4, wherein the register comprises a plurality of registers associated with each of the second functional modules; And after the current multimedia task image frame processing is finished, transmitting the subsequent data stream of the second functional module among a plurality of second functional modules according to the second interconnection path written in the second area, including: In response to arrival of a frame boundary of the current multimedia task image frame and a next multimedia task image frame, switching an interconnection path reading area from the first area of each of the registers to each of the second areas to transmit a data stream subsequent to the second function module among a plurality of the second function modules according to the second interconnection paths stored in each of the second areas.
6. The method according to any one of claims 1 to 5, wherein said configuring said programmable module according to a pre-acquired software program comprises: the task descriptor characterizes a module task to be executed by the programmable module; Adding the task descriptor to a task queue corresponding to the programmable module, and determining a target software program associated with the module task from a plurality of candidate software programs according to the task descriptor after the task descriptor is read from the task queue by the programmable module; and configuring the programmable module according to the target software program.
7. A multimedia task processing device, the device comprising: the system comprises a screening module, a processing module and a processing module, wherein the screening module is used for determining a first functional module related to a multimedia task from a plurality of functional modules of a chip according to task intention of the multimedia task to be processed; The configuration module is used for responding to the first functional module to comprise a hardware functional module and a programmable module, and configuring the programmable module according to a software program obtained in advance to obtain a plurality of second functional modules, wherein the plurality of second functional modules comprise the hardware functional module and the configured programmable module; and the path reconstruction module is used for reconstructing interconnection paths of the plurality of second functional modules and transmitting data streams of the second functional modules among the plurality of second functional modules according to the first interconnection paths obtained after reconstruction in the process of executing the multimedia tasks by using the plurality of second functional modules.
8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor implements the steps of the method of any of claims 1 to 6 when the computer program is executed.
9. A chip comprising a processor and a communication interface, the processor being configured to cause the chip to perform the steps of the method of any one of claims 1 to 6.
10. The utility model provides a chip module, its characterized in that includes communication module, power module, storage module and chip, wherein: The power supply module is used for providing electric energy for the chip module; the storage module is used for storing data and instructions; the communication module is used for carrying out internal communication of the chip module or carrying out communication between the chip module and external equipment; The chip being for performing the steps of the method of any one of claims 1 to 6.

Description

Multimedia task processing method and device, computer equipment, chip and chip module Technical Field The present application relates to the field of system-on-chip technology, and in particular, to a multimedia task processing method, apparatus, computer device, chip module, computer readable storage medium, and computer program product. Background With the development of computer technology, a System on a Chip (SoC) may include a plurality of basic units constituting the SoC, each of which may be referred to as an IP core and has a corresponding fixed function, and the SoC may employ the plurality of IP cores to implement various multimedia tasks such as image capturing, video and display processing. In the related art, each IP core integrates a corresponding module, such as a scaling module, a color conversion module, a buffer handling module, etc., in each of the IP cores in order to implement its specific functions and process related tasks. However, different IP cores often integrate the same modules repeatedly, resulting in wasted chip area and power consumption, and when a new type of multimedia task needs to be processed, the existing IP cores may not be reused, and a lot of resources are consumed to perform the curing design to update the IP cores. As can be seen, the related art system on a chip for processing multimedia tasks has a problem that it is difficult to achieve both resource utilization efficiency and flexibility of function expansion. Disclosure of Invention In view of the foregoing, it is desirable to provide a multimedia task processing method, apparatus, computer device, chip module, computer readable storage medium, and computer program product. In a first aspect, the present application provides a multimedia task processing method, including: Determining a first functional module related to a multimedia task from a plurality of functional modules of a chip according to task intention of the multimedia task to be processed, wherein the plurality of functional modules comprise functional modules multiplexed in different multimedia task processing processes; responding to the first functional module comprising a hardware functional module and a programmable module, and configuring the programmable module according to a software program obtained in advance to obtain a plurality of second functional modules, wherein the plurality of second functional modules comprise the hardware functional module and the configured programmable module; Reconstructing interconnection paths of the plurality of second functional modules, and transmitting data streams of the second functional modules among the plurality of second functional modules according to the first interconnection paths obtained after reconstruction in the process of executing the multimedia tasks by using the plurality of second functional modules. In one embodiment, the reconstruction of the interconnection paths of the plurality of second functional modules comprises determining a plurality of candidate paths of the plurality of second functional modules on the chip, determining a path hop count according to the number of nodes included in the candidate paths for each candidate path, screening the plurality of candidate paths according to the path hop count of each candidate path, and determining a first interconnection path. In one embodiment, the screening the plurality of candidate paths according to the path hop count of each candidate path, and determining a first interconnection path includes determining a congestion level of each candidate path, determining a first interconnection path of the plurality of second functional modules from the plurality of candidate paths according to the path hop count and the congestion level, and the path hop count and the congestion level of the first interconnection path satisfy a preset screening condition. In one embodiment, after the reconfiguration of the interconnection paths of the plurality of second function modules, the method further comprises the steps of responding to the occurrence of a trigger event for updating the interconnection paths, carrying out reconfiguration on the interconnection paths of the plurality of second function modules again to obtain second interconnection paths of the chips, writing the second interconnection paths into a second area in a register of the chips, wherein the register further comprises a first area, the second area is used for storing first interconnection paths applied by the plurality of second function modules when processing current multimedia task image frames, and after the data streams of the second function modules are transmitted among the plurality of second function modules according to the first interconnection paths obtained after the reconfiguration, further comprises the step of transmitting the subsequent data streams of the second function modules among the plurality of second function modules according to the second int