CN-121985214-A - Image signal processing system, method, device, equipment and product

CN121985214ACN 121985214 ACN121985214 ACN 121985214ACN-121985214-A

Abstract

The present disclosure relates to the field of image processing technologies, and in particular, to an image signal processing system, method, apparatus, device, and product, where the image signal processing system includes a front-end processor, a middle-end processor, and a back-end processing unit; in the first working mode, the front-end processor and the middle-end processor are coupled to form an image front-end processing unit, the image front-end processing unit and the rear-end processing unit form a first image processing path through a data storage unit, in the second working mode, the front-end processor, the middle-end processor and the rear-end processing unit form a second image processing path through the data storage unit, and the access times of the first image processing path and the second image processing path to the data storage unit in the image processing process are different. By configuring the image signal processing system with a plurality of modes of operation, a suitable image processing path can be selected according to scene requirements.

Inventors

WANG TAO
LING CHEN
ZHAO LEI
SUN YU
CHEN GUANTAO

Assignees

展讯通信（上海）有限公司

Dates

Publication Date: 20260505
Application Date: 20260129

Claims (10)

1. An image signal processing system is characterized by comprising a front-end processor, a middle-end processor and a back-end processing unit; in a first working mode, the front-end processor and the middle-end processor are coupled to form an image front-end processing unit, and the image front-end processing unit and the rear-end processing unit form a first image processing path through a data storage unit; In a second working mode, the front-end processor, the middle-end processor and the rear-end processing unit form a second image processing path through a data storage unit; The first image processing path and the second image processing path have different access times to the data storage unit in the image processing process.
2. The image signal processing system of claim 1, wherein in the first mode of operation, the front-end processor is configured to receive and process at least one path of raw image data, the middle-end processor is configured to process image data output by the front-end processor, and the image data output by the middle-end processor is transmitted to the back-end processing unit via the data storage unit.
3. The image signal processing system of claim 1, wherein in the second mode of operation, the front-end processor is configured to receive and process at least one path of raw image data, the image data output by the front-end processor is transmitted to the middle-end processor via the data storage unit, and the image data output by the middle-end processor is transmitted to the back-end processing unit via the data storage unit.
4. An image signal processing system according to any of claims 1-3, wherein the front-end processor comprises at least two parallel preprocessing channels and a fusion module; the parallel preprocessing channels are used for respectively preprocessing at least two paths of original image data, and the preprocessing comprises dead point correction, black level correction and gain compensation; the fusion module is configured to be started or closed according to the data sources of the original image data of at least two paths.
5. The image signal processing system of claim 4, wherein the fusion module is enabled when at least two paths of the raw image data come from different exposure settings of the same camera sensor, the fusion module fusing the preprocessed at least two paths of image data into one path of image by high dynamic range image processing.
6. The image signal processing system of claim 4, wherein the fusion module is turned off when at least two paths of the raw image data come from different camera sensors, and the preprocessed at least two paths of the image data are stored in the data storage unit to process the at least two paths of the raw image data in parallel.
7. An image signal processing method, characterized by comprising: Acquiring at least one path of original image data; Selecting a first working mode or a second working mode according to a target processing scene and the original image data; The first working mode comprises the steps of sequentially performing image front-end processing and image middle-end processing on the original image data, storing the image data generated after the image middle-end processing into a data storage unit, and performing image rear-end processing on the image data through the data storage unit to generate an image in a target format; The second working mode comprises the steps of executing image front-end processing on the original image data, storing the image data generated by the image front-end processing into a data storage unit, acquiring the image data generated by the image front-end processing through the data storage unit, executing image middle-end processing, storing the image data generated by the image middle-end processing into the data storage unit, acquiring the image data generated by the image middle-end processing through the data storage unit, executing image rear-end processing, and generating an image in a target format.
8. An image signal processing apparatus, characterized by comprising: The acquisition module is used for acquiring at least one path of original image data; the selection module is used for selecting a first working mode or a second working mode according to the target processing scene and the original image data; The first working mode comprises the steps of sequentially performing image front-end processing and image middle-end processing on the original image data, storing the image data generated after the image middle-end processing into a data storage unit, and performing image rear-end processing on the image data through the data storage unit to generate an image in a target format; The second working mode comprises the steps of executing image front-end processing on the original image data, storing the image data generated by the image front-end processing into a data storage unit, acquiring the image data generated by the image front-end processing through the data storage unit, executing image middle-end processing, storing the image data generated by the image middle-end processing into the data storage unit, acquiring the image data generated by the image middle-end processing through the data storage unit, executing image rear-end processing, and generating an image in a target format.
9. A computer embedded device comprising a memory, a processor and a computer program stored on the memory, wherein the processor executes the computer program to implement the method of claim 7.
10. A computer program product comprising a computer program, characterized in that the computer program, when being executed by a processor, implements the method of claim 7.

Description

Image signal processing system, method, device, equipment and product Technical Field The present disclosure relates to the field of image processing technologies, and in particular, to an image signal processing system, method, apparatus, device, and product. Background In an image capturing apparatus such as a mobile phone and a camera, an image capturing device generally includes a camera sensor and an image signal Processor (IMAGE SIGNAL Processor, ISP) that processes RAW data (RAW image) captured by the camera sensor into a YUV image that is actually perceived by the human eye. The traditional ISP architecture has single design effect, the shot pictures have larger effect difference from preview pictures, the scene requirement of multi-shot scenes (such as multi-camera shooting, multi-scene video recording and the like) cannot be met, and the prior ISP capable of supporting the multi-shot scenes has the defects of large processor area and high cost. Therefore, there is a need to design a new image signal processing system. Disclosure of Invention The present disclosure has been made in view of the above-mentioned problems, and provides an image signal processing system, method, apparatus, device, and product. According to an aspect of the present disclosure, there is provided an image signal processing system including a front-end processor, a middle-end processor, and a back-end processing unit; in a first working mode, the front-end processor and the middle-end processor are coupled to form an image front-end processing unit, and the image front-end processing unit and the rear-end processing unit form a first image processing path through a data storage unit; In a second working mode, the front-end processor, the middle-end processor and the rear-end processing unit form a second image processing path through a data storage unit; The first image processing path and the second image processing path have different access times to the data storage unit in the image processing process. The method has the advantages that by configuring multiple working modes for the image signal processing system, a proper image processing path can be selected according to scene requirements, for example, a first working mode can be selected in a scene with high bandwidth and time delay requirements, the interaction times between the whole image signal processing system and an external data storage unit are only once, and the required bandwidth and time delay are smaller. For example, in a scene of processing a large-area image, the second working mode can be selected, and the image data is required to pass through an external data storage unit when entering and exiting the middle-end processor, so that the middle-end processor is equivalent to being independently an offline processor, the line cache of the middle-end processor can be designed to be smaller, the image is processed in a dicing mode, the required static random access memory can be reduced by the middle-end processor while the image with a larger area is processed, the area of the middle-end processor is further reduced, and the cost of a chip product is reduced. In addition, according to an image signal processing system of an aspect of the present disclosure, in the first operation mode, the front-end processor is configured to receive and process at least one path of original image data, the middle-end processor is configured to process the image data output by the front-end processor, and the image data output by the middle-end processor is transmitted to the back-end processing unit through the data storage unit. In one or more embodiments, the method has the beneficial effects that the original image data firstly enters the front-end processor for processing and then is directly output to the middle-end processor, which is equivalent to directly connecting the front-end processor with the middle-end processor, and the first image processing path is (front-end processor+middle-end processor), the data storage unit and the back-end processing unit. The whole image processing path only interacts with the data storage unit once, the processing is fast, the power consumption is low, and the working mode is suitable for scenes (such as continuous shooting, video recording and the like) with high requirements on speed and bandwidth. In addition, according to an image signal processing system of an aspect of the present disclosure, in the second operation mode, the front-end processor is configured to receive and process at least one path of original image data, the image data output by the front-end processor is transmitted to the middle-end processor through the data storage unit, and the image data output by the middle-end processor is transmitted to the back-end processing unit through the data storage unit. In one or more embodiments, the second image processing path has the advantages that the front-end processor, the data storage unit, the middle-end p