US-12627781-B2 - Image processing apparatus and image processing method

US12627781B2US 12627781 B2US12627781 B2US 12627781B2US-12627781-B2

Abstract

An image processing apparatus performs a process including acquiring first image data, calculating a white balance value used for an automatic white balance adjustment according to the first image data, performing an automatic white balance adjustment on the first image data according to the white balance value to generate image data after a first correction, calculating a first luminance in the image data after the first correction by adding a color difference component to a luminance, and detecting a first region including a pixel having the first luminance higher than a first threshold value, calculating a correction degree of color information of a pixel included in the first region in the image data after the first correction, according to the first luminance, and correcting the color information of the pixel included in the first region in the image data after the first correction, according to the correction degree.

Inventors

Soichi Hagiwara
Yuji UMEZU
Junzo Sakurai

Assignees

SOCIONEXT INC.

Dates

Publication Date: 20260512
Application Date: 20240722

Claims (13)

1 . An image processing apparatus comprising: a memory device configured to store a program; and a processor configured to execute the program and perform a process including: acquiring first image data; calculating a white balance value used for an automatic white balance adjustment according to the first image data; performing an automatic white balance adjustment on the first image data according to the white balance value to generate image data after a first correction; calculating a first luminance in the image data after the first correction, obtained by adding a color difference component to a luminance, and detecting a first region including a pixel having the first luminance higher than a first threshold value; calculating a correction degree of color information of a pixel included in at least the first region in the image data after the first correction, according to the first luminance; and correcting the color information of the pixel included in at least the first region in the image data after the first correction, according to the correction degree.
2 . The image processing apparatus as claimed in claim 1 , wherein the calculating the first luminance includes: calculating the first luminance by adding a luminance in a color space including luminance information, and a color difference component in the color space, for at least each pixel included in the image data after the first correction.
3 . The image processing apparatus as claimed in claim 1 , wherein the calculating the correction degree sets the correction degree of a pixel having the first luminance higher than or equal to a first threshold value and lower than or equal to a second threshold value larger than the first threshold value to a value from 0% to 100% as the first luminance increases, and sets the correction degree of a pixel having the first luminance higher than the second threshold value to 100%.
4 . The image processing apparatus as claimed in claim 1 , wherein the calculating the first luminance outputs information indicating the pixel in the first region to the correction degree calculator, and the calculating the correction degree calculates the correction degree according to the number of pixels in the first region included in each block in a case where the image represented by the image data after the first correction is divided into a plurality of blocks.
5 . The image processing apparatus as claimed in claim 1 , wherein: the calculating the first luminance outputs information indicating the pixel in the first region to the calculating the correction degree, and the calculating the correction degree calculates the correction degree by performing a smoothing process on an image represented by the image data after the first correction by regarding the pixel in the first region as having a first pixel value and a pixel not in the first region as having a second pixel value.
6 . The image processing apparatus as claimed in claim 1 , wherein the color information corrector includes: a second white balance corrector configured to perform a white balance adjustment on the first image data using a white balance value of a standard light source to generate image data after a second correction, and a blender configured to blend pixel values of the image data after the first correction and the image data after the second correction, based on the correction degree.
7 . The image processing apparatus as claimed in claim 3 , wherein the correcting the color information corrects the color of the pixel to approach an achromatic color as the correction degree of the pixel becomes larger.
8 . An image processing apparatus comprising: a memory device configured to store a program; and a processor configured to execute the program and perform a process including: acquiring first image data; calculating a white balance value used for an automatic white balance adjustment according to the first image data; performing an automatic white balance adjustment on the first image data according to the white balance value to generate image data after a first correction; calculating a first luminance in the image data after the first correction, obtained by adding a color difference component to a luminance, and detecting a first region including a pixel having the first luminance higher than a first threshold value, for each of a plurality of types of light sources; calculating a first correction degree of a specific pixel including specific color information, and calculating a second correction degree of a normal pixel other than the specific pixel, included in the first region; correcting color information of the specific pixel included in at least the first region according to the first correction degree; and correcting color information of the normal pixel included in at least the first region according to the second correction degree.
9 . The image processing apparatus as claimed in claim 8 , wherein the calculating the first correction degree sets, in the first region, a pixel having a distance r of polar coordinates (r, θ) of a color difference space CbCr greater than a first threshold value as the specific pixel, and a pixel having the distance r less than or equal to the first threshold value as the normal pixel.
10 . The image processing apparatus as claimed in claim 8 , wherein the correcting the color information of the specific pixel includes: performing a white balance adjustment on the first image data using a white balance value of a standard light source, to generate image data after a second correction, and blending pixel values of the image data after the first correction and the image data after the second correction, based on the first correction degree, and the correcting the color information of the normal pixel corrects the color of the pixel to approach an achromatic color as the second correction degree of the pixel becomes larger.
11 . The image processing apparatus as claimed in claim 8 , wherein the calculating the first correction degree sets a pixel including color information of a red lamp of a traffic light as the specific pixel.
12 . An image processing apparatus comprising: a memory device configured to store a program; and a processor configured to execute the program and perform a process including: acquiring first image data; calculating a white balance value used for an automatic white balance adjustment according to the first image data; performing an automatic white balance adjustment on the first image data according to the white balance value to generate image data after a first correction; calculating reference coordinates that are coordinates of the white balance value in an xyY color space, and detecting a first region including a pixel having a luminance Y that is a first threshold value or more higher than a luminance Y of the reference coordinates and having color difference coordinates (x, y) that is separated by a first distance or more from color difference coordinates (x, y) of the reference coordinates, in the first image data represented in the xyY color space; setting a correction degree of color information of a pixel included in the first region greater than a correction degree of color information of a pixel not included in the first region, in the first image data; and correcting the color information of the pixel included in at least the first region in the image data after the first correction according to the correction degree.
13 . The image processing apparatus as claimed in claim 12 , wherein the correcting includes: performing a white balance adjustment on the first image data using a white balance value of a standard light source, to generate image data after a second correction, and blending pixel values of the image data after the first correction and the image data after the second correction, based on the correction degree.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation application of International Application No. PCT/JP2022/002723 filed on Jan. 25, 2022 and designated the U.S., the entire contents of which are incorporated herein by reference. FIELD The embodiments discussed herein are related to image processing apparatuses and image processing methods. BACKGROUND In an image processing apparatus, there is a known technique proposed in Japanese Laid-Open Patent Publication No. 2011-254311, for example, which estimates a light source and corrects colors of an image using a color profile created for each type of light source, when performing a white balance adjustment on the image captured under a light source that greatly affects blushing. On the other hand, there is a known technique proposed in International Publication Pamphlet No. WO 2019/111921, which reduces a color saturation of image data based on a color temperature specified from a subject image in a case where a specific luminous element is included in the subject image, when performing the white balance adjustment on an image acquired under illumination. For example, in a case where a subject region including a self-luminous subject, such as a headlamp, a traffic light, or the like, is captured under illumination of a street lamp such as a sodium-vapor lamp, a color reproducibility of the self-luminous subject may deteriorate if an automatic white balance adjustment is performed on the captured image. SUMMARY Accordingly, it is an object in one aspect of the embodiments to reduce a deterioration of a color reproducibility of a self-luminous subject caused by an automatic white balance adjustment even in a case where the self-luminous subject is included in a subject region illuminated by a main light source. According to one aspect of the embodiments, an image processing apparatus includes a memory device configured to store a program; and a processor configured to execute the program and perform a process including acquiring first image data; calculating a white balance value used for an automatic white balance adjustment according to the first image data; performing an automatic white balance adjustment on the first image data according to the white balance value to generate image data after a first correction; calculating a first luminance in the image data after the first correction, obtained by adding a color difference component to a luminance, and detecting a first region including a pixel having the first luminance higher than a first threshold value; calculating a correction degree of color information of a pixel included in at least the first region in the image data after the first correction, according to the first luminance; and correcting the color information of the pixel included in at least the first region in the image data after the first correction, according to the correction degree. The object and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, as claimed. BRIEF DESCRIPTION OF DRAWINGS FIG. 1 is a conceptual diagram illustrating an example of an image processing system including an image processing apparatus according to a first embodiment; FIG. 2 is a block diagram generally illustrating a configuration of various devices provided in a movable body of FIG. 1; FIG. 3 is a block diagram illustrating an example of a configuration of the image processing apparatus in FIG. 2; FIG. 4 is a functional block diagram illustrating an example of a functional configuration of the image processing apparatus in FIG. 2; FIG. 5 is a flow chart illustrating an example of an operation of the image processing apparatus in FIG. 2; FIG. 6 is an explanatory diagram illustrating an example of a process performed by a point light source region detector in FIG. 4; FIG. 7 is an explanatory diagram illustrating examples of processes performed by a correction degree calculator and a point light source region corrector in FIG. 4; FIG. 8 is a functional block diagram illustrating an example of the functional configuration of the image processing apparatus according to a second embodiment; FIG. 9 is a flow chart illustrating an example of the operation of the image processing apparatus in FIG. 8; FIG. 10 is a functional block diagram illustrating an example of the functional configuration of the image processing apparatus according to a third embodiment; FIG. 11 is a flow chart illustrating an example of the operation of the image processing apparatus according to a fourth embodiment; FIG. 12 is an explanatory diagram illustrating an example of a process of step S65 in FIG. 11; FIG. 13 is an explanatory diagram illustrating an example of an image correction by the process of the f