Search

CN-116803096-B - Sensor, electronic device, and non-transitory computer-readable medium

CN116803096BCN 116803096 BCN116803096 BCN 116803096BCN-116803096-B

Abstract

An imaging sensor (60) includes a first circuit (62) and a second circuit (64). The first circuit (62) obtains first acquisition pixel data, which is data of a normal gain pixel, and outputs the first acquisition pixel data from the imaging sensor (60) as normal processing image data. The second circuit (64) obtains second acquired pixel data, which is data of a low-gain pixel, and performs normalization processing on the second acquired pixel data to obtain first normalized pixel data, outputs the first normalized pixel data from the imaging sensor (60) as normal processing image data if the normal processing image data is not saturated, and clips the second normalized pixel data from the first normalized pixel data and outputs the second normalized pixel data from the imaging sensor (60) as normal processing image data if the normal processing image data is saturated.

Inventors

  • ARAI TOSHIHIKO

Assignees

  • OPPO广东移动通信有限公司

Dates

Publication Date
20260505
Application Date
20210222

Claims (14)

  1. 1. An imaging sensor, comprising: A first circuit configured to obtain first acquisition pixel data and output the first acquisition pixel data from the imaging sensor as first conventionally processed image data, wherein the first acquisition pixel data is data of a conventional gain pixel, and A second circuit configured to obtain second collected pixel data, and normalize the second collected pixel data to obtain first normalized pixel data, wherein the second collected pixel data is data of a low-gain pixel; Wherein the second circuit is further configured to output the first normalized pixel data from the imaging sensor as second conventionally processed image data if the first conventionally processed image data is not saturated when the first conventionally processed image data is input into a conventionally image link, and The second circuit is further configured to clip second normalized pixel data from the first normalized pixel data if the first conventionally processed image data is saturated when the first conventionally processed image data is input into the conventionally processed image link, and output the second normalized pixel data from the imaging sensor as the second conventionally processed image data.
  2. 2. The imaging sensor of claim 1, wherein the first conventionally processed image data and the second conventionally processed image data are input into the conventional image link that processes non-high dynamic range HDR image data.
  3. 3. The imaging sensor of claim 1, wherein the second circuitry is further configured to embed saturation information of the first normalized pixel data into the second conventionally processed image data itself and another conventionally processed image data.
  4. 4. The imaging sensor of claim 3, wherein said second circuit is further configured to compress said first normalized pixel data to reduce the amount of data and obtain compressed data.
  5. 5. The imaging sensor of claim 4, wherein the second circuit is configured to divide the compressed data into a plurality of data slices and embed the plurality of data slices into a spare space of the second conventionally processed image data of the low gain pixel itself and a spare space of another conventionally processed image data of another pixel, wherein the spare space refers to a remaining space of the second conventionally processed image data after the second normalized pixel data is accommodated in the second conventionally processed image data.
  6. 6. The imaging sensor of claim 5, wherein the second circuit is further configured to compress the first normalized pixel data by reducing a number of bits of the first normalized pixel data based on a compression tone curve.
  7. 7. The imaging sensor of claim 6, wherein the first normalized pixel data is compressed based on the compressed tone curve, the larger the first normalized pixel data, the higher the compression ratio of the compressed tone curve.
  8. 8. The imaging sensor of claim 7, wherein said plurality of data slices are embedded into said spare space of said second conventionally processed image data of said low gain pixel itself and a spare space of conventionally processed image data of a pixel adjacent to said low gain pixel.
  9. 9. The imaging sensor of claim 8, wherein said second circuitry is further configured to output said second conventionally processed image data comprising said second normalized pixel data and said data slice of said compressed data from said imaging sensor.
  10. 10. An electronic device, comprising: the imaging sensor according to any one of claims 5 to 9, and A third circuit configured to collect the plurality of pieces of data embedded in the spare space of the second conventionally processed image data of the low gain pixel itself and the spare space of the other conventionally processed image data of the other pixel to obtain the compressed data.
  11. 11. The electronic device of claim 10, wherein the third circuit is further configured to expand the compressed data obtained by collecting the plurality of data slices to obtain reconstructed first normalized pixel data.
  12. 12. The electronic device of claim 11, wherein the third circuit is further configured to output the reconstructed first normalized pixel data.
  13. 13. The electronic device of claim 12, wherein the reconstructed first normalized pixel data is input into an HDR image link for processing the reconstructed first normalized pixel data.
  14. 14. A computer readable medium having stored thereon program instructions for performing at least the following: Collecting the embedded plurality of data pieces in a spare space of the conventionally processed image data of the low gain pixel itself and a spare space of another conventionally processed image data of another pixel, wherein the conventionally processed image data is output from the imaging sensor; obtaining compressed data based on the collected pieces of data, and And expanding the compressed data to obtain reconstructed first normalized pixel data.

Description

Sensor, electronic device, and non-transitory computer-readable medium Technical Field The invention relates to a sensor, an electronic device and a non-transitory computer readable medium. Background Electronic devices such as smart phones and tablet terminals are widely used in our daily lives. Today, many electronic devices are equipped with a camera assembly for capturing images. Some electronic devices are portable and therefore easy to carry. Thus, a user of the electronic device can easily take a picture of an object anytime and anywhere by using the camera assembly of the electronic device. Many electronic devices may generate high dynamic range (HIGH DYNAMIC RANGE, HDR) image data that may represent a wide range of luminance from dark pixels to light pixels. In this case, the sensitivity level of the pixel data acquired by the imaging sensor of the camera assembly is different between the normal gain pixel and the low gain pixel. Therefore, a specific procedure is required to normalize the pixel data of the low gain pixels acquired by the imaging sensor. This particular procedure is necessary even if HDR image data is not required. Furthermore, specific hardware structures and/or software processes are required to perform the specific processes. Thus, the cost of developing such specific hardware structures and/or specific software increases. Disclosure of Invention The present invention aims to solve at least one of the above technical problems. Accordingly, there is a need for an imaging sensor, an electronic device, and a non-transitory computer readable medium. According to the present invention, an imaging sensor may include a first circuit and a second circuit. The first circuit is configured to obtain first acquisition pixel data, which is data of a normal gain pixel, and output the first acquisition pixel data from the imaging sensor as normal processing image data. The second circuit is configured to obtain second acquired pixel data, and normalize the second acquired pixel data to obtain first normalized pixel data, the second acquired pixel data being data of a low gain pixel. The second circuit is further configured to output the first normalized pixel data from the imaging sensor as the conventionally processed image data if the conventionally processed image data is not saturated when the conventionally processed image data is input into the conventionally processed image link. The second circuit is further configured to clip second normalized pixel data from the first normalized pixel data if the conventionally processed image data is saturated when the conventionally processed image data is input into the conventionally processed image link, and output the second normalized pixel data from the imaging sensor as conventionally processed image data. According to the invention, an electronic device may comprise the imaging sensor described above and a third circuit. The third circuit is configured to collect the embedded plurality of pieces of data in a spare space of the conventionally processed image data of the low gain pixel itself and a spare space of another conventionally processed image data of another pixel to obtain compressed data. According to the present invention, a non-transitory computer readable medium has stored thereon program instructions for performing at least the following operations. The embedded plurality of data pieces are collected in a spare space of the conventionally processed image data of the low gain pixel itself and a spare space of another conventionally processed image data of another pixel. Conventionally processed image data is output from an imaging sensor. Compressed data is obtained based on the collected pieces of data. The compressed data is expanded to obtain reconstructed first normalized pixel data. Drawings The foregoing and/or other aspects and advantages of embodiments of the invention will become more apparent and more readily appreciated from the following detailed description, taken in conjunction with the accompanying drawings. Fig. 1 shows a plan view of a first side of an electronic device according to an embodiment of the invention. Fig. 2 shows a plan view of a second side of the electronic device according to an embodiment of the invention. Fig. 3 shows a block diagram of an electronic device according to an embodiment of the invention. Fig. 4 shows one example of a pixel array of an imaging sensor in a camera assembly of an electronic device according to an embodiment of the invention. Fig. 5 shows another example of a pixel array of an imaging sensor in a camera assembly of an electronic device according to an embodiment of the invention. Fig. 6 illustrates a structure of an imaging sensor of a camera assembly and a process of generating conventionally processed image data for a conventional image link of an electronic device performed in the imaging sensor according to an embodiment of the present invention. Fig. 7 shows a fl