EP-4738865-A1 - ELECTRONIC DEVICE FOR PERFORMING IMAGE CORRECTION AND OPERATION METHOD THEREFOR

EP4738865A1EP 4738865 A1EP4738865 A1EP 4738865A1EP-4738865-A1

Abstract

An electronic device according to an embodiment may comprise: a camera module including a lens assembly; a motion sensor for detecting the movement of the electronic device; and at least one processor electrically connected to the camera module and the motion sensor. The at least one processor may: acquire a raw image including a plurality of pixels from the camera module; correct first lens shading by applying, to the raw image, a first LSC table to which first gain values respectively corresponding to the plurality of pixels have been allocated; generate a first corrected image to which video digital image stabilization (VDIS) correction has been applied on the basis of the movement of the electronic device; correct second lens shading by applying, to the first corrected image, a second LSC table to which second gain values corresponding to at least some of the plurality of pixels have been allocated; and generate a second corrected image to which the second lens shading correction has been applied.

Inventors

LEE, Heungsu
Jang, Hyosik
YEO, Dongwon
CHOI, WONCHUL

Assignees

Samsung Electronics Co., Ltd.

Dates

Publication Date: 20260506
Application Date: 20240801

Claims (14)

An electronic device comprising: a camera module; a motion sensor configured to detect a movement of the electronic device; and at least one processor electrically connected to the camera module and the motion sensor, wherein the at least one processor is configured to: obtain a raw image comprising a plurality of pixels from the camera module; perform first lens shading correction by applying, to the raw image, a first LSC table in which first gain values corresponding to the plurality of pixels respectively are allocated; based on a movement of the electronic device, generate a first corrected image which has been subjected to video digital image stabilization (VDIS) correction; and perform second lens shading correction by applying, to the first corrected image, a second LSC table in which second gain values corresponding to at least some of the plurality of pixels are allocated, and generate a second corrected image which has been subjected to the second lens shading correction.
The electronic device of claim 1, wherein the camera module further comprises a memory storing shading profile data for the first lens shading correction and the second lens shading correction, and wherein the at least one processor is configured to: determine the first gain values, based on the shading profile data corresponding to a brightness distribution of the raw image and a first ratio; and determine the second gain values, based on a second ratio associated with the first ratio.
The electronic device of claim 2, wherein the at least one processor is configured to: obtain, for each frame, a crop area for the VDIS correction in the raw image; and apply, to each frame of the first corrected image, the second LSC table in which second gain values corresponding to the crop area are allocated.
The electronic device of claim 2, wherein the camera module further comprises an image signal processor configured to perform image processing of an image stored in the memory, and wherein the at least one processor is configured to control the image signal processor to perform at least one of noise reduction or sharpening of the first corrected image.
The electronic device of claim 4, wherein the at least one processor is configured to convert the first corrected image, which has been subjected to the noise reduction or the sharpening, from an RGB format to a YUV format.
The electronic device of claim 5, wherein the at least one processor is configured to, based on the second gain values, adjust a Y value of the converted first corrected image.
The electronic device of claim 2, wherein the at least one processor is configured to store the second corrected image, together with the first corrected image, in the memory.
An operation method of an electronic device comprising a camera module, the method comprising: obtaining a raw image comprising a plurality of pixels from the camera module; performing first lens shading correction by applying, to the raw image, a first LSC table in which first gain values corresponding to the plurality of pixels respectively are allocated; based on a movement of the electronic device, generating a first corrected image which has been subjected to video digital image stabilization (VDIS) correction; performing second lens shading correction by applying, to the first corrected image, a second LSC table in which second gain values corresponding to at least some of the plurality of pixels are allocated; and generating a second corrected image which has been subjected to the second lens shading correction.
The method of claim 8, further comprising: determining the first gain values, based on shading profile data corresponding to a brightness distribution of the raw image and a first ratio; and determining the second gain values, based on a second ratio associated with the first ratio.
The method of claim 9, further comprising: obtaining, for each frame, a crop area for the VDIS correction in the raw image; and applying, to each frame of the first corrected image, the second LSC table in which second gain values corresponding to the crop area are allocated.
The method of claim 9, further comprising: performing at least one of noise reduction or sharpening of the first corrected image.
The method of claim 11, further comprising: converting the first corrected image, which has been subjected to the noise reduction or the sharpening, from an RGB format to a YUV format.
The method of claim 12, further comprising: based on the second gain values, adjusting a Y value of the converted first corrected image.
The method of claim 8, further comprising: storing the second corrected image, together with the first corrected image, in the memory.

Description

[Technical Field] Various embodiments of the disclosure relate to an electronic device that performs image correction and an operation method thereof. [Background Art] An electronic device including a camera may process digital data obtained via an image sensor to provide an enhanced image. Some examples of various processing techniques to enhance an image may include lens shading correction (LSC) and video digital image stabilization (VDIS) correction. Lens shading correction is for compensating for a phenomenon in which an image or video becomes darker toward its periphery due to optical characteristics of a lens. Specifically, lens shading correction may apply different gain values to the center and peripheral parts of an image frame to balance the entire image frame. Video digital image stabilization correction is for reducing distortion due to shaking when the electronic device (camera) shakes. Specifically, based on the shake information of the electronic device, the video digital image stabilization correction may determine a crop area in an image, and remove a peripheral part of an image frame to remove an area with camera shake. [Disclosure of Invention] [Solution to Problem] An electronic device according to an embodiment may include a camera module including a lens assembly, a motion sensor configured to detect a movement of the electronic device, and at least one processor electrically connected to the camera module and the motion sensor. The at least one processor according to an embodiment may be configured to obtain a raw image including a plurality of pixels from the camera module, perform first lens shading correction by applying, to the raw image, a first LSC table in which first gain values corresponding to the plurality of pixels respectively are allocated, and based on a movement of the electronic device, generate a first corrected image which has been subjected to video digital image stabilization (VDIS) correction. The at least one processor according to an embodiment may be configured to perform second lens shading correction by applying, to the first corrected image, a second LSC table in which second gain values corresponding to at least some of the plurality of pixels are allocated, and generate a second corrected image which has been subjected to the second lens shading correction. An operation method of an electronic device according to an embodiment may include an operation of obtaining a raw image including a plurality of pixels from the camera module, an operation of performing first lens shading correction by applying, to the raw image, a first LSC table in which first gain values corresponding to the plurality of pixels respectively are allocated, and an operation of, based on a movement of the electronic device, generating a first corrected image which has been subjected to video digital image stabilization (VDIS) correction. The operation method of the electronic device according to an embodiment may include an operation of performing second lens shading correction by applying, to the first corrected image, a second LSC table in which second gain values corresponding to at least some of the plurality of pixels are allocated and an operation of generating a second corrected image which has been subjected to the second lens shading correction. [Brief Description of Drawings] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.FIG. 2 is a block diagram of a camera module according to various embodiments.FIG. 3 is a diagram illustrating lens shading correction according to an embodiment.FIG. 4 is a diagram illustrating video digital image stabilization correction according to an embodiment.FIG. 5 is a flowchart of an operation method of an electronic device according to an embodiment.FIG. 6 is a flowchart of a pre-processing process in second lens shading correction according to an embodiment.FIG. 7 is a flowchart of an operation method of an electronic device according to an embodiment.FIG. 8 is a detailed flowchart of second lens shading correction according to an embodiment.FIG. 9 is a diagram illustrating a process of generating a second LSC table according to an embodiment.FIG. 10 illustrates an example in which first lens shading correction, VDIS correction, and second lens shading correction are sequentially processed in an electronic device according to an embodiment. [Mode for the Invention] In the following description, preferred embodiments of the disclosure will be described in detail with reference to the accompanying drawings. The merits and features of the disclosure, and a method of achieving the same will become apparent from the following detailed description of the embodiments given in conjunction with the accompanying drawings. However, the disclosure is not limited to the embodiments disclosed below, but may be implemented in various different forms, and the embodiments are provided to make the discl