US-20260127790-A1 - IMAGE PROCESSING APPARATUS, CONTROL METHOD, AND MEDIUM

US20260127790A1US 20260127790 A1US20260127790 A1US 20260127790A1US-20260127790-A1

Abstract

An image processing apparatus is provided. The image processing apparatus determines a parameter of correction processing for extended image data generated by an image extension function, the extended image data in which image data is extended, based on feature information for each of regions including an original image region before extension and an extended region included in the extended image data generated by the image extension function, and corrects the extended image data using the parameter having been determined.

Inventors

Kohei Furuya

Assignees

CANON KABUSHIKI KAISHA

Dates

Publication Date: 20260507
Application Date: 20251031
Priority Date: 20241106

Claims (14)

1 . An image processing apparatus comprising: at least one memory storing instructions; and at least one processor that is in communication with the at least one memory and that, when executing the instructions, cooperates with the at least one memory to execute processing, the processing including determining a parameter of correction processing for extended image data generated by an image extension function, the extended image data in which image data is extended, based on feature information for each of regions including an original image region before extension and an extended region included in the extended image data generated by the image extension function, and correcting the extended image data using the parameter having been determined.
2 . The image processing apparatus according to claim 1 , wherein the processing further includes generating region specifying information specifying an original image region before extension and an extended region included in the extended image data generated by the image extension function, and the determining includes determining a parameter of correction processing for the extended image data based on feature information of the original image region and the extended region specified by the region specifying information.
3 . The image processing apparatus according to claim 2 , wherein the processing further includes storing the extended image data and the region specifying information.
4 . The image processing apparatus according to claim 2 , wherein the region specifying information is mask data corresponding to each of the original image region and the extended region.
5 . The image processing apparatus according to claim 2 , wherein the region specifying information is position information of a boundary between the original image region and the extended region.
6 . The image processing apparatus according to claim 1 , wherein the determining includes determining the parameter based on a feature amount generated from the original image region not including the extended region.
7 . The image processing apparatus according to claim 1 , wherein the determining includes determining the parameter based on feature information in which feature information generated from the extended region and the original image region and feature information generated from the original image region not including the extended region are combined.
8 . The image processing apparatus according to claim 2 , wherein the determining includes combining the feature information generated from each region specified by the region specifying information by applying a weight for each region.
9 . The image processing apparatus according to claim 8 , wherein the weight for each region is determined depending on a manner of extension for each region by the image extension function.
10 . The image processing apparatus according to claim 9 , wherein the manner of extension for each region includes automatic extension without designation of a subject by a user, extension with designation of a subject by a user, and non-extension.
11 . The image processing apparatus according to claim 1 , wherein the processing includes providing the image extension function.
12 . The image processing apparatus according to claim 11 further comprising
13 . A non-transitory computer-readable storage medium storing a program that, when loaded and executed on a computer, causes the computer to perform processing, wherein the processing includes determining a parameter of correction processing for extended image data generated by an image extension function, the extended image data in which image data is extended, based on feature information for each of regions including an original image region before extension and an extended region included in the extended image data generated by the image extension function, and correcting the extended image data using the parameter having been determined.
14 . A control method of an image processing apparatus, the control method comprising: determining a parameter of correction processing for extended image data generated by an image extension function, the extended image data in which image data is extended, based on feature information for each of regions including an original image region before extension and an extended region included in the extended image data generated by the image extension function, and correcting the extended image data using the parameter having been determined.

Description

BACKGROUND Field of the Technology The technology of the present disclosure relates to an image processing apparatus, a control method, and a medium, and relates to image processing on an extended image in particular. Description of the Related Art In recent years, image data can be extended with the development of the generative AI technology. This enables generation of a region not existing in the original image and creation of an image having a wider visual field, and enables generation of a subject not existing in the original image in a specific region of the image. A case of applying such a technology to an image requiring post-processing, such as a RAW image, will be considered. In such a case, the extended region may have different characteristics from the original region, and as a result, a region having different characteristics may be included in one extended image. In such an image, due to a difference in characteristics between the original region and the extended region, there is a possibility that a difference in color tone and luminance between these regions is visualized by post-processing, resulting in an unnatural image. Known technologies regarding white balance, which is one of post-processing of an image, include technologies described in, for example, Patent Document 1 and Patent Document 2. Japanese Patent Laid-Open No. 2012-039256 discloses a configuration in which, when an image is cut out at a set aspect ratio at the time of image recording, an evaluation value for white balance control is calculated by changing a use ratio between the entire image to be cut out and a common region of an image to be used regardless of the aspect ratio. In Japanese Patent Laid-Open No. 2012-039256, when a main subject is included in a non-common region that is used or not used depending on the setting of the aspect ratio, a use ratio of the common region is increased to calculate a color level for white balance control. In Japanese Patent Laid-Open No. 2004-064676 discloses a configuration in which, when a specific region is cut out and stored as an electronic zoom region at the time of image recording, color extraction for white balance is performed also from the outside of the region to be cut out. In Japanese Patent Laid-Open No. 2004-064676, when a light source different from a light source irradiating a subject is present outside the electronic zoom region, white balance control is performed by lowering a weight of a color extracted from the outside. Japanese Patent Laid-Open No. 2012-039256 suppresses a change in luminance and color balance of a main subject such as a face of a person due to a change in setting of an aspect ratio, and controls a difference in white balance between images having different aspect ratios having been set. Japanese Patent Laid-Open No. 2004-064676 assumes that a specific angle of view is cut out and stored, and an object thereof is to make the color balance and the luminance of an image to be cut out appropriate by effectively utilizing information of an outer region to be cut out. Therefore, for example, when the light source different from the light source irradiating the subject is present outside the electronic zoom region, the weight of the color extracted from the outside is lowered, but the weight is not changed if the light source is present inside the electronic zoom region. Even if such a known technology is applied to image data extended by AI generation or the like, the action described in each patent document is only applied to the extended image data. Therefore, it is difficult to improve image quality such as unnaturalness of an image after post-processing due to a difference in characteristics between the original region and the extended region. SUMMARY The technology of the present disclosure makes it possible to perform image processing also in consideration of an extended region while reducing an influence of the extended region on an original region in an extended image. According to one aspect of the present disclosure, provided is an image processing apparatus comprising: at least one memory storing instructions; and at least one processor that is in communication with the at least one memory and that, when executing the instructions, cooperates with the at least one memory to execute processing, the processing including determining a parameter of correction processing for extended image data generated by an image extension function, the extended image data in which image data is extended, based on feature information for each of regions including an original image region before extension and an extended region included in the extended image data generated by the image extension function, and correcting the extended image data using the parameter having been determined. According to the above configuration, it is possible to perform image processing also in consideration of an extended region while reducing an influence of the extended region