CN-117173738-B - Non-homologous binocular camera with alignment function

CN117173738BCN 117173738 BCN117173738 BCN 117173738BCN-117173738-B

Abstract

The non-homologous binocular camera with the alignment function is characterized by comprising a first camera, a second camera and a processor, wherein the first camera is used for shooting an original first image of a palm, the second camera is used for shooting an original second image of the palm, the first camera and the second camera are non-homologous cameras and shooting at the same time, and the processor is used for processing the original first image and the second image to obtain palm key points, further obtaining palm center information and then aligning. According to the invention, the first image and the second image are directly processed by utilizing the non-homologous binocular system, the p-sensor is saved, and the first image and the second image are aligned by utilizing the key points of the palm, so that the calculated amount of palm brushing identification is greatly reduced, the cost is reduced, and the popularization of palm brushing application is facilitated.

Inventors

HUANG LONGXIANG
HOU JUNFENG
YANG XIU
ZHOU XIANGNAN
WANG BO
ZHU LI
LV FANGLU

Assignees

深圳市光鉴科技有限公司

Dates

Publication Date: 20260508
Application Date: 20220528

Claims (8)

1. A non-homologous binocular camera with alignment function, comprising: A first camera for taking an original first image of the palm; the first camera and the second camera are non-homologous cameras and are used for shooting at the same time; The processor is used for processing the original first image and the second image, acquiring palm key points, further acquiring palm center information and then aligning; The processor includes: a detection module for the first image And a second image Respectively detecting palms to respectively obtain the first images Is in the palm region of (2) And the second image Is in the palm region of (2) Wherein the first image and the second image are non-homologous images; A key point module for the palm area And the palm area Respectively obtaining key points of the palm; The central parallax module is used for calculating parallax of the palm center according to the information of the key points; an alignment module for aligning the first image according to the parallax of the palm center And the second image Alignment; the central parallax module includes: a key parallax unit, configured to calculate a parallax d of the key point; the central position unit is used for calculating the position of the palm center according to the key points of the finger root and the palm root; And the central parallax unit is used for calculating the parallax b of the palm center according to the parallaxes of the key points of the finger root and the palm root.
2. The non-homologous binocular camera with alignment function of claim 1, further comprising: The correction module is used for respectively correcting the distortion of the original first image and the original second image, and then carrying out polar correction to obtain a corrected first image And a corrected second image 。
3. The non-homologous binocular camera with alignment capability of claim 1, wherein the keypoint module comprises: The extraction unit is used for obtaining the palm edge according to an edge extraction algorithm so as to obtain the palm gesture; The key point unit is used for obtaining key points according to the palm gestures; a matching unit for matching the first image And the second image And matching the key points.
4. The non-homologous binocular camera with alignment capability of claim 1, wherein the first image is captured in a detection module And the second image The first image is also subjected to the following steps before detection And the second image Compression is performed.
5. The non-homologous binocular camera with alignment function of claim 4, wherein for the first image And a second image Is different in compression ratio.
6. A non-homologous binocular camera with alignment function as in claim 1, wherein the central location unit comprises: A range subunit, configured to determine a range of a palm center according to positions of key points of the finger root and the palm root; a selecting subunit, configured to randomly select three points at an edge of the range, where an area of a triangle formed by the three points is not less than half of an area of the range; the difference value subunit is used for respectively calculating average difference values of the distances between the three points and the key points of the finger root and the palm root and recording the minimum average difference value f; An updating subunit, configured to move the three points towards the direction of the triangle center point, recalculate an average difference value of distances between the three points and key points of the finger root and the palm root, and record a current minimum average difference value g; The first moving subunit is used for assigning g to f if g is smaller than f, continuously moving the point corresponding to g along the original direction, and moving the other two points along the connecting line direction of the point corresponding to g; And the second moving subunit is used for moving the three points towards the direction of the point corresponding to f if g > =f.
7. A non-homologous binocular camera with alignment capability as in claim 3, wherein the first image is captured in a keypoint unit Subtracting the second image Obtaining a third image And then according to the third image Obtaining key points.
8. A palm-brushing device comprising a non-homologous binocular camera with alignment function according to any one of claims 1 to 7.

Description

Non-homologous binocular camera with alignment function Technical Field The invention relates to the field of brush palm recognition cameras, in particular to a non-homologous binocular camera with an alignment function. Background Because the lines of the palm of the person are more stable, the palm brushing identification is a biological identification technology which is more stable and safer than the face brushing identification, and the person identity can be identified through the palm brushing, so that the palm brushing identification device is used in the fields of security check, payment, identity identification and the like. The brush palm identification is a technology with wide application prospect. In the prior art, a part of palm brushing system adopts a palm support to fix the palm so as to determine the position of the palm, but the practical application is inconvenient. The partial palm brushing system estimates palm depth by using a p-sensor, and then performs pixel level alignment on the first image and the second image according to the p-sensor. In practice, since it is generally required to take a complete photograph of the palm at a short distance and to clearly image the palm at a long distance for the purpose of measuring a range and a distance. This requires that the FOV of the camera be large enough, the duty ratio of the palm in the image at a far distance is not very large, and if the p-sensors are used for alignment of two images, the number of p-sensors needed is relatively large, so that mutual interference exists, the design is difficult, and the cost is also increased greatly. In the prior art, the binocular systems all adopt homologous binocular, so that clear depth data of a target object can be obtained, but the binocular system has large calculation amount and needs to process related data by a separate system-on-chip, thereby causing a series of problems of transmission delay, recognition lag and the like. Disclosure of Invention Therefore, the invention utilizes the non-homologous binocular system formed by the first camera and the second camera to directly process the first image and the second image, saves the p-sensor, and utilizes the key points of the palm to align the first image and the second image, so that the calculation amount of palm recognition is greatly reduced, the dependent equipment is fewer, the equipment space is more easily saved, the compatibility is better, the cost is reduced, and the popularization of palm application is facilitated. In a first aspect, the present invention provides a non-homologous binocular camera with alignment function, comprising: A first camera for taking an original first image of the palm; the first camera and the second camera are non-homologous cameras and are used for shooting at the same time; And the processor is used for processing the original first image and the second image, acquiring palm key points, further acquiring palm center information and then aligning. Optionally, the non-homologous binocular camera with alignment function, wherein the processor comprises: The detection module is used for respectively detecting palms of a first image I ir and a second image I rgb to respectively obtain a palms region ROI ir of the first image I ir and a palms region ROI rgb of the second image I rgb; The key point module is used for estimating the palm postures of the palm region ROI ir and the palm region ROI rgb to respectively obtain key points of the palm; The central parallax module is used for calculating parallax of the palm center according to the information of the key points; And the alignment module is used for aligning the first image I ir and the second image I rgb according to the parallax of the palm center. Optionally, the non-homologous binocular camera with alignment function further comprises: The correction module is used for respectively correcting the distortion of the original first image and the original second image, and then carrying out polar line correction to obtain a corrected first image I ir and a corrected second image I rgb. Optionally, the non-homologous binocular camera with alignment function is characterized in that the keypoint module comprises: The extraction unit is used for obtaining the palm edge according to an edge extraction algorithm so as to obtain the palm gesture; The key point unit is used for obtaining key points according to the palm gestures; And the matching unit is used for matching the key points on the first image I ir and the second image I rgb. Optionally, the non-homologous binocular camera with alignment function is characterized in that the central parallax module includes: a key parallax unit, configured to calculate a parallax d of the key point; the central position unit is used for calculating the position of the palm center according to the key points of the finger root and the palm root; And the central parallax unit is used for calculating the parall