Search

US-12624997-B2 - Hyperspectral imaging device and method

US12624997B2US 12624997 B2US12624997 B2US 12624997B2US-12624997-B2

Abstract

A hyperspectral imaging device and method disclosed herein overcomes technical problems associated with the prior art by replacing the intensity measurement performed by the single high-resolution 2D sensor of state-of-the-art methodologies, with the measurement of intensity (fluctuation) correlations retrieved by two high-resolution 2D sensors: one—the imaging/spatial sensor dedicated to polychromatic image acquisition, the other—the spectral sensor dedicated to pure spectral measurement. In the hyperspectral correlation imaging disclosed herein, the spectral information is encoded into the intensity correlation without requiring any spectral scanning. Even though multiple exposures (frames) are generally required to reconstruct light statistics and perform correlation measurements, the exposure times are several orders of magnitude shorter than those required in the scanning approach. In addition, no changes of the device are required during such multiple exposures, which simplifies the optics/optomechanics of the device and avoids further time consumption.

Inventors

  • Milena D'Angelo
  • Augusto GARUCCIO
  • Gianlorenzo MASSARO
  • Francesco Vincenzo PEPE

Assignees

  • UNIVERSITÀ DEGLI STUDI DI BARI ALDO MORO

Dates

Publication Date
20260512
Application Date
20201217

Claims (17)

  1. 1 . A device for hyperspectral correlation imaging comprising: an acquisition window, a beam splitter configured for splitting a primary light beam coming from an object and entering the acquisition window into a first secondary beam having a first optical path and including a plurality of first secondary light signals, and a second secondary beam having a second optical path and including a plurality of second secondary light signals, a first sensor configured to be impinged by the first secondary beam, a second sensor configured to be impinged by the second secondary beam, wherein: the first sensor is configured to retrieve, from the first secondary beam, an image of the object, the image comprising a plurality of spatial locations, each defined by the impingement of a first secondary light signal of the plurality of first secondary light signals on the first sensor, and the second sensor is configured to retrieve from the second secondary beam, and for each spatial location of the image, a frequency spectrum information, the device further including a processing unit configured to retrieve a hyperspectral image of the object through a measure of correlation between: a first light intensity information collected over an exposure time at a spatial location on the first sensor associated to the first secondary light signal of the plurality of first secondary light signals, and a second light intensity information collected over the exposure time at a location on the second sensor associated to a second secondary light signal of the plurality of second secondary light signals paired with the first secondary light signal of the first secondary beam, the second light intensity information being provided for each frequency in the frequency spectrum information retrieved by the second sensor, wherein said measure of correlation is a measure of statistical covariance between the first light intensity information collected over the exposure time and the second light intensity information collected over the exposure time.
  2. 2 . The device of claim 1 , wherein the first sensor and the second sensor are distinct sensors.
  3. 3 . The device of claim 1 , wherein the first sensor and the second sensor are provided on a single sensor element and correspond to different sensitive areas or elements of the single sensor element.
  4. 4 . The device of claim 1 , further including a frequency splitter device arranged along the second optical path and configured to process the second secondary beam to retrieve frequency components thereof upon interaction with the second sensor, wherein the frequency splitter device is configured to split the second secondary beam into frequency components thereof prior to impingement of the second secondary beam onto the second sensor.
  5. 5 . The device of claim 1 , wherein the second sensor comprises a sensing elements matrix, wherein each sensing element of the sensing elements matrix has a spectral sensitivity peaked on a different frequency.
  6. 6 . The device of claim 4 , wherein the acquisition window is arranged facing a first mirror configured to reflect incoming light beams from the object to a deviation mirror, the deviation mirror configured to divert the incoming light beams to the beam splitter, wherein the first secondary beam has a first optical path traversing an imaging lens, while the second secondary beam has a second optical path traversing a collimation lens which is arranged upstream of the frequency splitter device, and wherein a second mirror is arranged downstream of the frequency splitter to divert the split frequency components of the second secondary beam to the second sensor.
  7. 7 . The device of claim 4 , wherein the acquisition window is in view of the beam splitter, and wherein the first optical path traverses a lens to end up on the first sensor, and wherein the second optical path traverses the frequency splitter device and impinges onto a far field mirror, in turn configured to divert the split frequency components to the second sensor.
  8. 8 . The device of claim 4 , wherein the second secondary beam includes an optical path impinging onto a collimating mirror which is configured to divert the second secondary beam to the frequency splitter device, which is in turn configured to divert the second secondary beam to a focusing mirror, in turn focusing the second secondary beam to a cylindrical lens, wherein the cylindrical lens is configured to focus each frequency band in a line.
  9. 9 . The device of claim 8 , wherein the focusing mirror is a concave mirror exhibiting focusing properties only along an axis orthogonal to that of the cylindrical lens.
  10. 10 . The device of claim 5 , wherein the beam splitter is configured to split the primary beam into the first secondary beam with the first optical path impinging on the first sensor, and a second secondary beam with the second optical path impinging directly onto the second sensor.
  11. 11 . The device of claim 1 , comprising a second beam splitter configured to split the first secondary beam into a third and a fourth secondary beams, the third secondary beam configured to impinge onto said first sensor as a main imaging sensor, the fourth secondary beam configured to impinge onto a secondary imaging sensor, the secondary imaging sensor being configured to retrieve a focused image of the object on a plane other than a plane focused on the main imaging sensor.
  12. 12 . The device of claim 1 , comprising a first focusing lens configured to be impinged by the primary light beam, wherein the beam splitter is configured to split the primary light beam focused by the focusing lens into a first, focused secondary beam impinging the first sensor, and a second, focused secondary beam, wherein the second focused secondary beam is configured to be de-focused prior to impingement onto the second sensor by one of the following combinations: a plane mirror and a spherical lens, and a concave mirror and a cylindrical lens having an axis arranged parallel to the plane of the second sensor.
  13. 13 . A method for hyperspectral correlation imaging, comprising: splitting a primary light beam into a first secondary beam including a plurality of first secondary light signals, and a second secondary beam including a plurality of second secondary light signals, directing the first secondary beam to a first sensor, directing the second secondary beam to a second sensor, retrieving, by means of the first sensor and from the first secondary beam, an image of an object, the image comprising a plurality of spatial locations, each defined by an impingement of a respective first secondary light signal of the first secondary beam on the first sensor, retrieving, by means of the second sensor and from the second secondary beam, a frequency spectrum information for each of the plurality of spatial locations of the image, and retrieving a hyperspectral image of the object through a measure of correlation between: a first light intensity information collected over an exposure time at a spatial location on the first sensor associated to a first secondary light signal of the first secondary beam, and a second light intensity information collected over the exposure time at a location on the second sensor associated to a second secondary light signal of the second secondary beam paired with the first secondary light signal of the first secondary beam, the second light intensity information being provided for each frequency in the frequency spectrum information retrieved by the second sensor, wherein said measure of correlation is a measure of statistical covariance between the first light intensity information collected over the exposure time and the second light intensity information collected over the exposure time.
  14. 14 . The method of claim 13 , wherein the first sensor and the second sensor are provided on a single sensor element and correspond to different sensitive areas or elements of the single sensor element.
  15. 15 . The method of claim 13 , comprising splitting the second secondary beam into frequency components thereof prior to impingement on the second sensor.
  16. 16 . The method of claim 13 , wherein the second sensor comprises a sensing elements matrix, wherein each sensing element of the sensing element matrix has a spectral sensitivity peaked on a different frequency.
  17. 17 . The method of claim 13 , further comprising: splitting the first secondary light beam into a third and a fourth secondary beams, directing the third secondary beam to the first sensor and the fourth secondary beam to a further sensor configured for retrieving an image of the object, and retrieving an image of the object on a plane, the plane being other than a plane that the first sensor retrieves data from, through the further sensor.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application is a 371 National Stage of International Application No. PCT/IB2020/062131, filed Dec. 17, 2020. The disclosure of the above application is incorporated herein by reference in its entirety. FIELD OF THE INVENTION The present invention relates to hyperspectral imaging. PRIOR ART Current devices for hyperspectral imaging rely on intensity measurements performed by a high-resolution 2D sensor, and are essentially based on the two complementary concepts of scanning and snapshot imaging. The general problem of such devices is to encode on a 2D sensor an information that is in fact three-dimensional, the third dimension being the frequency of light. In scanning hyperspectral imaging techniques, a high-resolution 2D sensor acquires, in time, a sequence of monochromatic images, one for each frequency within the range of interest; examples of scanning hyperspectral systems include point scanning spectrometers, pushbroom spectrometers, tunable filter cameras, Fourier transform imaging spectrometers, computed tomography hyperspectral imaging spectrometers, and coded aperture line imaging spectrometers. The drawback of this approach is clearly the amount of time required for acquiring the sequence of monochromatic images. On the other hand, in snapshot hyperspectral imaging techniques, a high-resolution 2D sensor is divided into multiple 2D blocks of pixels, each block containing information on all the desired frequencies, one for each pixel; examples of snapshot hyperspectral systems include integral field spectrometry with faceted mirrors, with coherent fiber bundles and with lenslet arrays, multispectral beamsplitting, computer tomography imaging spectrometry, multiaperture filtered cameras, tunable echelle imagers, spectrally resolving detector arrays, image-replicating imaging spectrometers, coded aperture snapshot spectral imagers, image mapping spectrometry, snapshot hyperspectral imaging Fourier transform spectrometers, multispectral Sagnac interferometers. Here, the fast parallel acquisition of the desired multispectral images comes at the price of a sacrificed image and spectral resolution. Hence, the scanning approach entails an extremely time-consuming process to achieve a fine spectral resolution, while the snapshot approach is characterized by a strong trade-off between spatial and spectral resolution, which, for a given sensor, are inversely proportional to each other. OBJECT OF THE INVENTION The object of the present invention is to solve the technical problems mentioned in the foregoing. More specifically, the object of the invention is to provide a high resolution hyperspectral imaging device and method capable of achieving high image resolution with a fast processing rate. SUMMARY OF THE INVENTION The object of the invention is achieved by a device and a method having the features of the appended claims, which form an integral part of the technical disclosure herein provided in relation to the invention. BRIEF DESCRIPTION OF THE FIGURES Further features and advantages of the invention will become apparent from the following description with reference to the annexed drawings, given purely by way of non limiting example, wherein: FIG. 1 is a schematic representation of a device according to embodiments of the invention FIG. 2 is a schematic representation of a device according to further embodiments of the invention FIG. 3 is a schematic representation of a device according to yet further embodiments of the invention FIG. 4 is a schematic representation of a device according to yet further embodiments of the invention, FIG. 5 is a schematic representation of a device according to yet further embodiments of the invention, FIG. 6 is a schematic representation of a device according to yet further embodiments of the invention, FIG. 7 is a schematic representation of a device according to yet further embodiments of the invention, FIG. 8 is a schematic representation of a device according to yet further embodiments of the invention, and FIG. 9 is a schematic representation of a device according to yet further embodiments of the invention. DETAILED DESCRIPTION Reference number 1 in FIG. 1 designates as a whole a device for hyperspectral imaging according to embodiments of the invention. The device 1 includes an acquisition window 2, a beam splitter 3 configured for splitting a light beam B, coming from an object OBJ and entering the acquisition window, into a first secondary beam B1 traveling a first optical path S1 and including a plurality of first secondary light signals, and a second secondary beam B2 traveling a second optical path S2 and including a plurality of second secondary light signals. Generally speaking, the object OBJ may be regarded as a light source for the device 1 according to the invention, whereby each and every single point of the volume of the object OBJ is capable of emanating primary light signals of the light beams B. The whole