CN-115564660-B - Image processing system and video stream processing method

Abstract

The invention provides an image processing system and a video stream processing method. A first image is acquired according to the parameters. The first image is subjected to a deformation correction procedure and a second image is generated. And carrying out an identification detection program on the second image and generating a detection result. And generating control information according to the detection result. And adjusting parameters according to the control information, and generating a third image. Outputting the second image and the third image. Thus, the subsequent application can be enhanced by the dual image output.

Inventors

• LIN WENXIANG
• LIN SHENGYUAN
• Cai Milai

Assignees

• 创惟科技股份有限公司

Dates

Publication Date

20260505

Application Date

20220617

Priority Date

20220104

Claims (20)

1. 1. A method for processing a video stream, comprising: Acquiring a first image according to the parameters; Performing a deformation correction procedure on the first image and generating a second image; performing an identification detection program on the second image and generating a detection result; generating control information according to the detection result; Adjusting the parameters according to the control information; capturing another first image again according to the adjusted parameters; adjusting the other first image by the deformation correction program according to the control information and generating a third image, and And outputting the second image and the third image.
2. 2. The method for processing a video stream according to claim 1, comprising: retrieving the first image from an image capturing device; Performing the deformation correction procedure on the first image according to an image signal processing procedure to generate the second image, wherein the deformation correction procedure is used for adjusting deformation in the first image; generating the third image by the deformation correction program based on the control information, and And outputting the second image and the third image simultaneously, wherein the second image is output through a first video stream, and the third image is output through a second video stream, wherein the second video stream is different from the first video stream.
3. 3. The method for processing a video stream according to claim 2, further comprising: the second image and the third image are generated simultaneously by the deformation correction program.
4. 4. The method for processing a video stream according to claim 2, further comprising: the identification detection procedure is performed on the first video stream by a back-end device to generate the detection result, wherein the detection result is related to at least one region of interest in the second image.
5. 5. The method for processing a video stream according to claim 4, further comprising: arranging the at least one region of interest into at least one window, wherein the third image comprises the at least one window, and The third image is displayed by a display device.
6. 6. The method of processing a video stream according to claim 2, wherein outputting the second image through the first video stream and outputting the third image through the second video stream comprises: Outputting the first video stream through a mobile industry processor interface and outputting the second video stream through a universal serial bus.
7. 7. The method of processing a video stream according to claim 2, wherein outputting the second image through the first video stream and outputting the third image through the second video stream comprises: and respectively outputting the first video stream and the second video stream through two endpoints of a universal serial bus interface.
8. 8. The method for processing a video stream according to claim 7, further comprising: The control information is input through the other end point of the universal serial bus interface.
9. 9. The method of claim 2, wherein the distortion correction procedure comprises at least one of de-warping, left-right turning, tilting, scaling, rotation, translation, and viewing angle adjustment, and the parameter comprises a setting parameter of at least one of de-warping, left-right turning, tilting, scaling, rotation, translation, and viewing angle adjustment.
10. 10. The method of processing a video stream according to claim 1, wherein the first image is a wide-angle image or a fisheye image, and the second image is a reverse-warped panorama.
11. 11. An image processing system, comprising: a controller configured to: Acquiring a first image according to the parameters; Performing a deformation correction procedure on the first image and generating a second image; Adjusting the parameters according to the control information; capturing another first image again according to the adjusted parameters; Adjusting the other first image by the strain correction program according to the control information generated according to the detection result of the second image by the identification detection program, and generating a third image And outputting the second image and the third image.
12. 12. The image processing system of claim 11, further comprising: an image capture device coupled to the controller, comprising a lens and an image sensor, and capturing a first image through the lens and the image sensor, wherein the controller is further configured to: retrieving the first image from an image capturing device; Performing a deformation correction procedure on the first image according to an image signal processing procedure to generate the second image, wherein the deformation correction procedure is used for adjusting deformation in the first image; generating the third image by the deformation correction program based on the control information, and And outputting the second image and the third image simultaneously, wherein the second image is output through a first video stream, and the third image is output through a second video stream, wherein the second video stream is different from the first video stream.
13. 13. The image processing system of claim 12, wherein the controller is further configured to: the second image and the third image are generated simultaneously by the deformation correction program.
14. 14. The image processing system of claim 12, further comprising: And a back-end device coupled to the controller and configured to perform the identification detection procedure on the first video stream to generate the detection result, wherein the detection result is related to at least one region of interest in the second image.
15. 15. The image processing system of claim 14, wherein the detection result relates to at least one region of interest in the second image, and further comprising a display device coupled to the controller, wherein the controller is further configured to: arranging the at least one region of interest into at least one window, wherein the third image comprises the at least one window, and And displaying the third image through the display device.
16. 16. The image processing system of claim 12, wherein the controller comprises: a mobile industry processor interface for outputting the first video stream, and And the universal serial bus is used for outputting the second video stream.
17. 17. The image processing system of claim 12, wherein the controller comprises: The universal serial bus interface comprises two endpoints and is used for outputting the first video stream and the second video stream respectively.
18. 18. The image processing system of claim 17, wherein the universal serial bus interface further comprises: the other end point is used for inputting the control information.
19. 19. The image processing system of claim 12, wherein the deformation correction process comprises at least one of anti-warp, pan, tilt, zoom, rotate, pan, and view adjustment, and the parameter comprises a setting parameter of at least one of anti-warp, pan, tilt, zoom, rotate, pan, and view adjustment.
20. 20. The image processing system of claim 11, wherein the first image is a wide-angle image or a fisheye image and the second image is a reverse-warped panorama.

Description

Image processing system and video stream processing method Technical Field The present invention relates to an image processing technology, and in particular, to an image processing system and a video stream processing method. Background In the prior art, although a camera equipped with a wide angle lens or a fish eye (fisheye) lens can capture an image having a wide Field of View (FoV), the edges of the image may be curved and form an unnatural appearance. Distortion of the wide-angle or fisheye image may make its content difficult to recognize and may be more uncomfortable for the user's eyes. Conventional fisheye (fisheye) or wide angle camera (camera) transmits the panoramic image (panoramic image) to a back-end system (e.g., host or computer) with high computing power, and processes the display of de-warping, detection and de-warping images (DEWARPED IMAGE) together. However, the complexity of the back-end device is high and the application context of the camera is limited. Disclosure of Invention The invention is directed to an image processing system and a processing method of video streams, which can generate double video streams for detection and display application respectively. According to an embodiment of the invention, a method for processing a video stream includes, but is not limited to, acquiring a first image according to a parameter. The first image is subjected to a deformation correction procedure and a second image is generated. And carrying out an identification detection program on the second image and generating a detection result. And generating control information according to the detection result. And adjusting parameters according to the control information, and generating a third image. Outputting the second image and the third image. According to an embodiment of the present invention, an image processing system includes, but is not limited to, a controller. The controller is configured to obtain a first image according to the parameters, perform a deformation correction procedure on the first image and generate a second image, adjust the parameters according to the control information and generate a third image, and output the second image and the third image. The control information is generated based on a detection result generated by performing the recognition detection process on the second image. Based on the above, according to the image processing system and the processing method of the video stream in the embodiment of the invention, the deformation correction program can generate two images respectively carried by two video streams and can be used by different backend applications accordingly. Therefore, the labor is effectively divided, and the elasticity of the framework is improved. Drawings The accompanying drawings are included to provide a further understanding of the invention, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. FIG. 1 is a block diagram of components of an image processing system according to one embodiment of the present invention; FIG. 2 is a block diagram of components of an image processing system according to another embodiment of the present invention; FIG. 3 is a flow chart of a method of processing a video stream according to an embodiment of the invention; FIG. 4 is an exemplary illustration of a multi-window preview; fig. 5 is a flow chart of an application of dual video streams according to an embodiment of the present invention. Description of the reference numerals 1.2, An image processing system; an image capturing device; 11, a lens; 15, an image sensor; 30. 30'; 31, a memory; 39, an operation unit; 32. 33, 34, 35; 36. 37, 38 end points; 50. 70, a back-end device; 60, a display device; 71, a processor; 72, an image unit; VS1, a first video stream; VS2, a second video stream; CI is control information; S310-S360, S510-S550; TW 1-TW 3, window; A SIM, a first image; TIM, third image. Detailed Description Reference will now be made in detail to the exemplary embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers are used in the drawings and the description to refer to the same or like parts. Fig. 1 is a block diagram of components of an image processing system 1 according to an embodiment of the present invention. Referring to fig. 1, an image processing system 1 includes, but is not limited to, an image capturing apparatus 10, a controller 30, a back-end device 50, and a display apparatus 60. The image capturing apparatus 10 may be a camera, video camera, monitor or a similarly functioning device. The image capture apparatus 10 may include, but is not limited to, a lens 11 and an image sensor 15, such as a charge coupled device (Charge Coupled Device, CCD) or a Complementary Metal Oxide