KR-102964190-B1 - Image processing device and method

Abstract

The present application provides an image processing apparatus and method. The apparatus comprises: a first processing unit configured to acquire a first stitched image based on a first image and a second image; and a transmitting unit configured to transmit the first stitched image, wherein the number of row pixels of the first image is M and the number of column pixels is N; the number of row pixels of the second image is P and the number of column pixels is Q, and Q≥M; and the number of row pixels of the first stitched image is N+P and the number of column pixels is Q. The first stitched image includes a second image and a third image. The third image is an image acquired through a first preprocessing of the first image. The first preprocessing includes rotating the first image, or the first preprocessing includes rotating and padding the first image. Accordingly, the acquired first stitched image includes a small number of padded pixels, and in the process of transmitting the first stitched image, the padded pixels occupy a small amount of transmission bandwidth. This improves the transmission efficiency of the first stitched image.

Inventors

• 장 신신
• 왕 샤오민

Assignees

• 셴젠 인왕 인텔리전트 테크놀러지 컴퍼니 리미티드

Dates

Publication Date

20260512

Application Date

20210926

Claims (20)

1. As an image processing device, The above image processing device is, A first processing unit configured to acquire a first stitched image based on a first image to be displayed by a first display and a second image to be displayed by a second display; and A transmitting unit configured to transmit the first stitched image above Includes, The number of row pixels of the first image is M and the number of column pixels is N, M > N, and M and N are both positive integers; The number of row pixels of the second image above is P and the number of column pixels is Q, where Q≥M, and P and Q are both positive integers; and An image processing device wherein the number of row pixels of the first stitched image is N+P and the number of column pixels is Q, the first stitched image includes the second image and the third image, the third image is an image obtained through the first preprocessing of the first image, and the first preprocessing includes rotating the first image, or the first preprocessing includes rotating and padding the first image.
2. In paragraph 1, Specifically, the above-mentioned first processing unit is, Rotate the first image above to obtain a fourth image; The third image is obtained by performing pixel padding on the fourth image; and An image processing device configured to obtain the first stitched image by stitching the third image and the second image.
3. In paragraph 2, Specifically, the first processing unit is configured to obtain the third image by performing pixel padding on the fourth image, The image processing device, wherein the first processing unit specifically comprises being configured to obtain the third image by performing pixel padding from a first target position of the fourth image, and the first target position includes at least one of a top position, a bottom position, or an intermediate position.
4. In paragraph 2, More specifically, the above-mentioned first processing unit is, An image processing device configured to obtain the fourth image by rotating the first image by (90° + 180° × n), wherein n is an integer.
5. In paragraph 1, Specifically, the above-mentioned transmitting unit is, An image processing device configured to transmit the first stitched image to a second processing unit or transmission unit.
6. In paragraph 1, The above-mentioned first processing unit is an image processing device comprising a system on a chip (SoC).
7. In paragraph 5, The image processing device, wherein the second processing unit comprises a field programmable gate array (FPGA) unit and/or a serializer (Ser).
8. As an image processing device, The above image processing device is, An acquisition unit configured to acquire a first stitched image; and A second processing unit configured to perform a first processing on the first stitched image to obtain a first image to be displayed by a first display and a second image to be displayed by a second display. Includes, The number of row pixels of the first stitched image is N+P and the number of column pixels is Q, the first stitched image includes the second image and the third image, and N, P, and Q are all positive integers; The number of row pixels of the first image is M and the number of column pixels is N, M>N, and M is a positive integer; The number of row pixels of the second image above is P and the number of column pixels is Q, and Q≥M; The first processing comprises dividing the first stitched image to obtain the second image and the third image; and An image processing device, wherein the first processing further comprises rotating the third image, or the first processing further comprises rotating and defading the third image.
9. In paragraph 8, The above-mentioned second processing unit is more specifically, Dividing the first stitched image to obtain the second image and the third image; The above third image is defatted to obtain a fourth image; and An image processing device configured to acquire the first image by rotating the fourth image.
10. In Paragraph 9, More specifically, the second processing unit is configured to obtain the fourth image by defatting the third image, The image processing device, wherein the second processing unit is specifically configured to obtain the fourth image by performing defading from a first target position of the third image, and the first target position includes at least one of a top position, a bottom position, or an intermediate position.
11. In Paragraph 9, The above-mentioned second processing unit is more specifically, An image processing device configured to obtain the first image by rotating the fourth image by (-90°- 180° × n), where n is an integer.
12. In paragraph 8, The image processing device further includes a first transmission unit, a second transmission unit, a first port, and a second port, and The first transmitting unit is configured to transmit the second image through the first port; and An image processing device configured such that the second transmission unit transmits the first image through the second port.
13. In paragraph 8, The image processing device, wherein the second processing unit comprises a field programmable gate array (FPGA) unit and/or a serializer (Ser).
14. As an image processing method, The above image processing method is, A step of obtaining a first stitched image based on a first image to be displayed by a first display and a second image to be displayed by a second display; and Step of transmitting the first stitched image Includes, The number of row pixels of the first image is M and the number of column pixels is N, M > N, and M and N are both positive integers; The number of row pixels of the second image above is P and the number of column pixels is Q, Q≥M, and P and Q are both positive integers; An image processing method wherein the number of row pixels of the first stitched image is N+P and the number of column pixels is Q, the first stitched image includes the second image and the third image, the third image is an image obtained through the first preprocessing of the first image, and the first preprocessing includes rotating the first image, or the first preprocessing includes rotating and padding the first image.
15. In Paragraph 14, The step of obtaining a first stitched image based on the first image and the second image is: A step of obtaining a fourth image by rotating the first image above; A step of obtaining the third image by performing pixel padding on the fourth image; and A step of obtaining the first stitched image by stitching the third image and the second image. An image processing method including
16. In paragraph 15, The step of obtaining the third image by performing pixel padding on the fourth image is, A step of obtaining the third image by performing pixel padding from the first target position of the fourth image. An image processing method comprising, wherein the first target position comprises at least one of an upper position, a lower position, or an intermediate position.
17. In paragraph 15, The step of obtaining a fourth image by rotating the first image is, A step of obtaining the fourth image by rotating the first image by (90° + 180° × n) - n is an integer - An image processing method including
18. As an image processing method, The above image processing method is, A step of acquiring a first stitched image; and A step of performing a first processing on the first stitched image to obtain a first image to be displayed by a first display and a second image to be displayed by a second display. Includes, The number of row pixels of the first stitched image is N+P and the number of column pixels is Q, the first stitched image includes the second image and the third image, and N, P, and Q are all positive integers; The number of row pixels of the first image is M and the number of column pixels is N, M>N, and M is a positive integer; The number of row pixels of the second image above is P and the number of column pixels is Q, and Q≥M; The first processing comprises dividing the first stitched image to obtain the second image and the third image; and An image processing method wherein the first processing further comprises rotating the third image, or the first processing further comprises rotating and defading the third image.
19. In Paragraph 18, The step of obtaining a first image and a second image by performing a first processing on the first stitched image is, A step of obtaining the second image and the third image by dividing the first stitched image; A step of obtaining a fourth image by defatting the third image; and The step of obtaining the first image by rotating the fourth image. An image processing method including
20. In Paragraph 19, The step of obtaining a fourth image by defatting the third image is, A step of obtaining the fourth image by performing defading from the first target position of the third image. An image processing method comprising, wherein the first target position comprises at least one of an upper position, a lower position, or an intermediate position.

Description

Image processing device and method The present application relates to the field of image processing, and more specifically to an image processing apparatus and method. Displays play a crucial role in intelligence as the primary interface for human-computer interaction. Multi-screen displays have become a new trend in cockpit displays following large-screen displays, and one-core multi-screen displays have become the focus of vehicle factories and cockpit system integrators. In multi-screen displays, the functions of the traditional central display screen are separated so that navigation and multimedia information are displayed on a single screen, while vehicle information such as seats, air conditioning, and advanced driving assistance systems (ADAS) is displayed on another screen or two screens. This reduces the menu levels of system applications and simplifies user operation. For example, a cockpit domain controller (CDC) uses serializer/deserializer (SeRDeS) technology to transmit images to a display via cables. The CDC includes a system-on-a-chip (SoC) and a serializer, while the display device includes a deserializer and a display. The specific process for transmitting images from the CDC to the display is as follows: The SoC transmits the image to the serializer (SeR) via the mobile industry processor interface (MIPI), the open LVDS display interface (oLDI), a display port (DP), or cables on the SoC's printed circuit board (PCB). The Ser transmits the image to the deserializer (DeS) of a different display device via different ports, and then the DeS transmits the image to the display via a board interface such as MIPI, oLDI, or DP, and the display displays the image. Due to the limitations of the pins and interfaces of the SoC and Ser, multiple images cannot be distinguished at the interface layer. Therefore, the SoC must horizontally stitch the displayed images into a regular large image through specific processing and transmit the stitched image to the Ser. The Ser (which supports 1:2 segmentation, i.e., segmenting a single image into two) performs segmentation on the large image to obtain two images and sends them individually to the corresponding display device through the serializer's two ports for display. However, the display sizes of the display devices generally differ. To facilitate stitching, the SoC performs pixel padding on at least one of the two images to be stitched to match the column specification of the other image, thereby ensuring consistency in the number of column pixels between the two images. Since Ser and Des cannot prune padded pixels, padded pixels are transmitted to the display as valid pixels, and the display prunes the padded pixels before displaying the image. In this solution, excessive padded pixels occupy an excessive amount of transmission bandwidth. This results in low image transmission efficiency. The present application provides an image processing device and method for reducing the number of padded pixels and improving image transmission efficiency. According to a first aspect, an image processing device is provided, the device comprising: a first processing unit configured to acquire a first stitched image based on a first image and a second image; and a sending unit configured to transmit the first stitched image, wherein the number of row pixels of the first image is M and the number of column pixels is N, M > N, and M and N are both positive integers; the number of row pixels of the second image is P and the number of column pixels is Q, Q ≥ M, and P and Q are both positive integers, and the number of row pixels of the first stitched image is N + P and the number of column pixels is Q, and the first stitched image comprises a second image and a third image, and the third image is an image obtained through a first preprocessing of the first image, the first preprocessing includes rotating the first image, or the first preprocessing includes rotating and padding the first image. For example, the first processing unit includes an SoC. For example, the image processing device may be a domain controller or another device having image processing capabilities, such as a CDC or a mobile data center (MDC). In the embodiments of the present application, it should be understood that the quantity of row pixels is the quantity of pixels within each row. The quantity of column pixels is the quantity of pixels within each column. In the image processing device described above, the first processing unit first obtains a third image by rotating a first image in which the number of row pixels is M and the number of column pixels is N, or by rotating and padding a first image in which the number of row pixels is M and the number of column pixels is N. Then, based on the third image and a second image in which the number of row pixels is P and the number of column pixels is Q, the first processing unit obtains a first stitched image in which the number of row pixels is N+P and