CN-115272844-B - Multispectral detection method and device and electronic equipment

CN115272844BCN 115272844 BCN115272844 BCN 115272844BCN-115272844-B

Abstract

The application discloses a multispectral detection method and device and electronic equipment, and belongs to the technical field of data processing. The multispectral detection method is applied to a multispectral detection device, the multispectral detection device comprises a shooting module, the shooting module comprises a multispectral component, the multispectral detection device comprises the steps of acquiring energy values of light rays of a plurality of wave bands penetrating through the multispectral component, and outputting object information of a shooting object in a shooting view field range of the shooting module according to the energy value of the light rays of each wave band.

Inventors

YUN HONG
ZHOU JING

Assignees

维沃移动通信有限公司
维沃移动通信有限公司

Dates

Publication Date: 20260421
Application Date: 20220624
Priority Date: 20220624

Claims (13)

1. The multispectral detection method is applied to a multispectral detection device, and the multispectral detection device comprises a shooting module, and is characterized in that the shooting module comprises a multispectral component, and the method comprises the following steps: acquiring energy values of light rays of a plurality of wave bands transmitted through the multispectral component; outputting object information of a shooting object in a shooting view field range of the shooting module according to the energy value of the light rays of each wave band; When the object information of the shooting object includes an object name and the number of the full spectrum pixels is plural, outputting the object information of the shooting object in the shooting field of view range of the shooting module according to the energy value of the light of each band includes: obtaining object information corresponding to each full spectrum pixel according to the energy value of the light rays of each wave band incident to each full spectrum pixel; outputting an energy curve corresponding to each full spectrum pixel according to the energy value of the light of each wave band of each full spectrum pixel; searching a target reflection spectrum matched with the curve form of each energy curve from a prestored reflection spectrum set to obtain a target reflection spectrum corresponding to each full-spectrum pixel; Determining object attribute information corresponding to the single target reflection spectrum as object information of full spectrum pixels corresponding to the single target reflection spectrum to obtain object information corresponding to each full spectrum pixel; and displaying an object information mark in an image area corresponding to each full spectrum pixel in the original image acquired by the shooting module, wherein the object information mark is used for marking object information corresponding to the full spectrum pixel.
2. The method of claim 1, wherein the multispectral component is an FPI multispectral component, the FPI multispectral component comprises a fabry-perot cavity mover and a fabry-perot cavity stator, the photographing module further comprises an image sensor, the image sensor comprises full-spectrum pixels, the FPI multispectral component is arranged on an incident side of the full-spectrum pixels; the acquiring energy values of light rays transmitted through a plurality of wavebands of the multispectral component comprises: the distance between the Fabry-Perot cavity mover and the Fabry-Perot cavity stator is sequentially adjusted according to the transmission distance corresponding to each wave band, so that light rays of each wave band sequentially penetrate through the FPI multispectral assembly to be incident into the full-spectrum pixel, and the transmission distance is the distance between the Fabry-Perot cavity mover and the Fabry-Perot cavity stator; An energy value of light incident to each band of the full spectrum pixel is acquired.
3. The method of claim 2, wherein the object information includes object names, the number of full spectrum pixels being at least two; the acquiring the energy value of the light ray of each wave band incident to the full spectrum pixel comprises: Acquiring an energy value of light rays of each wave band incident to each full spectrum pixel; The outputting the object information of the shooting object within the shooting view field range of the shooting module according to the energy value of the light rays of each wave band comprises the following steps: obtaining object information corresponding to each full spectrum pixel according to the energy value of the light rays of each wave band incident to each full spectrum pixel; displaying an object information mark in an image area corresponding to each full spectrum pixel in an original image acquired by the shooting module, wherein the object information mark is used for marking object information corresponding to the full spectrum pixel; The original image is an image of the shooting object acquired by the shooting module within the shooting view field range.
4. A method according to claim 3, wherein the obtaining object information corresponding to each full spectrum pixel according to the energy value of the light incident to each band of the full spectrum pixel comprises: Outputting an energy curve corresponding to each full spectrum pixel according to the energy value of the light of each wave band of each full spectrum pixel, wherein the energy curve is a curve of the energy value of the light along with the change of the wavelength; Searching a target reflection spectrum matched with the curve form of each energy curve from a prestored reflection spectrum set to obtain a target reflection spectrum corresponding to each full spectrum pixel, wherein the reflection spectrum set comprises at least one reflection spectrum of an object and object attribute information corresponding to each reflection spectrum; And determining object attribute information corresponding to the single target reflection spectrum as object information of full spectrum pixels corresponding to the single target reflection spectrum, so as to obtain object information corresponding to each full spectrum pixel.
5. The method of claim 1, wherein the object information comprises object names, the number of the multispectral components is at least two, the multispectral components are spectral filters, and the at least two spectral filters form at least two filter sets, each filter set comprises at least four spectral filters, the shooting module further comprises an image sensor, the at least two filter sets are arranged on pixels of the image sensor at intervals, and the wave bands of light transmitted by each spectral filter of each filter set are different; the acquiring energy values of light rays transmitted through a plurality of wavebands of the multispectral component comprises: Acquiring the energy value of the light rays of each wave band transmitted through each optical filter set; The outputting the object information of the shooting object within the shooting view field range of the shooting module according to the energy value of the light rays of each wave band comprises the following steps: Obtaining object information corresponding to each optical filter set according to the energy value of the light rays transmitted through each optical filter set in each wave band; Displaying object information marks in an image area corresponding to each optical filter set in an original image acquired by the shooting module, wherein the object information marks are used for marking object information corresponding to the optical filter sets; The original image is an image of the shooting object acquired by the shooting module within the shooting view field range.
6. The method according to claim 1, wherein the object information includes an object name, the number of the multispectral components is at least two, the photographing module further includes an image sensor, the image sensor includes at least two full-spectrum pixels, each multispectral component is respectively and correspondingly arranged on the light incident side of one full-spectrum pixel, the at least two multispectral components form at least one multispectral component group, each multispectral component group includes at least two multispectral components, and the wavelength bands of light transmitted by each multispectral component of each multispectral component group are different; the acquiring energy values of light rays transmitted through a plurality of wavebands of the multispectral component comprises: Acquiring the energy value of light rays incident to each target full-spectrum pixel, wherein the target full-spectrum pixel is a full-spectrum pixel corresponding to a multispectral assembly group; The outputting the object information of the shooting object within the shooting view field range of the shooting module according to the energy value of the light rays of each wave band comprises the following steps: Obtaining object information corresponding to each multispectral component group according to the energy value of the light of each target full-spectrum pixel; Displaying an object information mark in an image area corresponding to each target full spectrum pixel in an original image acquired by the shooting module, wherein the object information mark is used for marking object information corresponding to the target full spectrum pixel; The original image is an image of the shooting object acquired by the shooting module within the shooting view field range.
7. The method of claim 6, wherein the obtaining the object information corresponding to each multispectral component group according to the energy value of the light of each target full-spectrum pixel comprises: Outputting an energy curve corresponding to each multispectral component group according to the energy value of the light of each target full-spectrum pixel, wherein the energy curve is a curve of the energy value of the light of the full-spectrum pixel corresponding to the incident multispectral component group along with the change of the wavelength; searching a target reflection spectrum matched with the curve form of each energy curve from a prestored reflection spectrum set to obtain a target reflection spectrum corresponding to each multispectral assembly group, wherein the reflection spectrum set comprises at least one reflection spectrum of an object and object attribute information corresponding to each reflection spectrum; And determining object attribute information corresponding to the single target reflection spectrum as object information of the multispectral component groups corresponding to the single target reflection spectrum so as to obtain object information corresponding to each multispectral component group.
8. A method according to claim 3, wherein the object information further comprises object concentration information; The image area corresponding to each full spectrum pixel in the original image collected by the shooting module displays an object information mark, and the method comprises the following steps: Displaying an object information mark in an image area corresponding to each full spectrum pixel in the original image according to the energy value of the light rays incident to each full spectrum pixel, wherein the object information mark is also used for marking object concentration information corresponding to the full spectrum pixel; the larger the energy value is, the larger the concentration of the object is, and different object concentrations correspond to object information marks of different marking parameters.
9. The method of claim 8, wherein displaying object information markers in the image area corresponding to each full spectrum pixel in the original image according to the energy value of the light incident to each full spectrum pixel, comprises: Determining filling materials corresponding to all spectrum pixels according to the filling materials corresponding to the object indicated by the object name; determining the marking parameters of the filling materials corresponding to each full-spectrum pixel according to the energy value of the light rays incident to each full-spectrum pixel; filling an image area corresponding to each full-spectrum pixel in an original image acquired by the shooting module according to the marking parameters of the filling material corresponding to each full-spectrum pixel, wherein the filling material corresponds to an object indicated by the object name; The filling materials of different objects are different, wherein the filling materials comprise at least one of pure color filling materials, texture filling materials and gradient color filling materials, the larger the energy value is, the higher the color saturation of the filling materials is, the higher the energy value is, the higher the texture density of the filling materials is when the filling materials are texture filling materials, and the higher the energy value is, and the higher the gradient density of the filling materials is when the filling materials are gradient color filling materials.
10. The method of claim 1, wherein prior to said obtaining energy values for light transmitted through the multiple bands of the multispectral assembly, the method further comprises: The method comprises the steps of obtaining the geographic position of electronic equipment, wherein the electronic equipment comprises a multispectral detection device; and under the condition that the geographic position is located at a preset place, outputting alarm information, wherein the alarm information is used for prompting a user that a harmful object exists at the geographic position of the electronic equipment, and the object information of the harmful object can be detected through the electronic equipment.
11. The method according to claim 10, wherein outputting the alert information if the geographic location is at a preset location comprises: And outputting alarm information under the condition that the geographic position is located at a preset place and the air pressure value of the position where the electronic equipment is located is within the dangerous air pressure range corresponding to the preset place.
12. A multispectral detection apparatus, the apparatus comprising: The shooting module comprises a multispectral component; the acquisition module is used for acquiring energy values of light rays of a plurality of wave bands transmitted through the multispectral component; The output module is used for outputting object information of a shooting object in a shooting view field range of the shooting module according to the energy value of the light rays of each wave band; When the object information of the shooting object comprises an object name and the number of the full spectrum pixels is multiple, the output module is specifically configured to obtain object information corresponding to each full spectrum pixel according to an energy value of light rays of each wave band incident to each full spectrum pixel, output an energy curve corresponding to each full spectrum pixel according to the energy value of light rays of each wave band of each full spectrum pixel, search a target reflection spectrum matched with a curve form of each energy curve from a prestored reflection spectrum set to obtain a target reflection spectrum corresponding to each full spectrum pixel, determine object attribute information corresponding to a single target reflection spectrum as object information of the full spectrum pixel corresponding to the single target reflection spectrum to obtain object information corresponding to each full spectrum pixel, and display an object information mark in an image area corresponding to each full spectrum pixel in an original image acquired by the shooting module, wherein the object information mark is used for marking the object information corresponding to the full spectrum pixel.
13. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the multispectral detection method of any one of claims 1 to 11.

Description

Multispectral detection method and device and electronic equipment Technical Field The application belongs to the technical field of data processing, and particularly relates to a multispectral detection method and device and electronic equipment. Background With the development of mobile terminals, functions integrated with the mobile terminals are increasing, including object recognition functions. The current process of identifying the object by the mobile terminal comprises the steps of shooting the object by utilizing a shooting module to obtain an object image. The photographed object is identified by performing object recognition means such as shape detection, texture recognition, color recognition, and the like on the object image. However, the current method of object recognition using a camera module is mainly directed to an object. However, for non-object such as gas, the object detection accuracy of the mobile terminal is low because the object detection module is generally unable to detect the object due to the lack of shape, color, texture and other features. Disclosure of Invention The embodiment of the application aims to provide a multispectral detection method, a multispectral detection device and electronic equipment, which can realize detection of more objects and improve the accuracy of object detection. In a first aspect, an embodiment of the present application provides a multispectral detection method, which is applied to a multispectral detection device, where the multispectral detection device includes a shooting module, and the shooting module includes a multispectral component, and the method includes: acquiring energy values of light rays of a plurality of wave bands transmitted through the multispectral component; and outputting object information of a shooting object in the shooting view field range of the shooting module according to the energy value of the light rays of each wave band. In a second aspect, embodiments of the present application provide a multispectral detection apparatus, the apparatus comprising: The shooting module comprises a multispectral component; the acquisition module is used for acquiring energy values of light rays of a plurality of wave bands transmitted through the multispectral component; and the output module is used for outputting object information of a shooting object in the shooting view field range of the shooting module according to the energy value of the light rays of each wave band. In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method as described in the first aspect. In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor perform the steps of the method according to the first aspect. In a fifth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect. In a sixth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the first aspect. In the embodiment of the application, the object detection is realized by acquiring the energy values of the light rays of a plurality of wave bands transmitted through the multispectral component in the shooting module, so that the object information of the shooting object in the shooting view field range of the shooting module is output according to the energy value of the light rays of each wave band. The light incident into the multispectral component is the reflected light of the shooting object in the shooting view field range of the shooting module. The corresponding light rays of a plurality of wave bands transmitted through the multispectral component are the light rays of a plurality of wave bands in the reflected light rays of the shooting object, and the acquired energy values of the light rays of the plurality of wave bands can reflect the reflection condition of the shooting object on the light rays of the plurality of wave bands. The phenomenon of selective reflection of light rays with different wavelengths exists in any object, and the reflection conditions of the light rays with different wavelengths are different in different object objects. Therefore, compared with the related art, the method for determining the object information of the shooting object according to the energy values of the light rays of the multiple wave bands incident to the shooting