JP-2026074633-A - Image processing device, image processing method, program

JP2026074633AJP 2026074633 AJP2026074633 AJP 2026074633AJP-2026074633-A

Abstract

[Problem] To provide an imaging processing device, imaging processing method, and program that reduce unnecessary reshoots and misauthentication when the person to be authenticated is unlikely to be a pre-registered person. [Solution] The image processing device 100, which is an information processing device, includes a face image storage unit 106 in which a person's face image 107 is registered, an authentication unit 109 that authenticates whether the person in the input face image is the same person as the person in the face image storage unit 106, a matching unit 102 that calculates the degree of match between the input face image and the registered face image, a determination unit 103 that uses the authentication result from the authentication unit and the degree of match to determine whether the person in the input face image is likely to be the same person as the person in the registered face image, and an output unit 104 that outputs information corresponding to the determination result output by the determination unit 103 to a display device 101 located outside the image processing device. [Selection Diagram] Figure 1

Inventors

牧田孝嗣
舘俊太

Assignees

キヤノン株式会社

Dates

Publication Date: 20260507
Application Date: 20241021

Claims (18)

A facial image storage unit in which a person's facial image is registered, An authentication unit that authenticates if the person in the input facial image is the same person as the person in the facial image stored in the facial image storage unit, A matching unit that calculates the degree of match between the input face image and the registered face image, A determination unit that uses the authentication result from the authentication unit and the match score to determine whether or not the person in the input face image is likely to be the person in the registered face image, An information processing device characterized by comprising an output unit that outputs information corresponding to the determination result output by the determination unit.
If the determination unit determines that the above possibility exists, The information processing apparatus according to claim 1, characterized in that the output unit outputs information based on the results of the matching process for calculating the degree of match.
The information processing apparatus according to claim 2, characterized in that the output unit outputs the input facial image.
The information processing apparatus according to claim 2, characterized in that the output unit does not output the registered face image.
The information processing apparatus according to claim 2, characterized in that the output unit outputs an image obtained by processing the registered face image.
If the determination unit determines that the above possibility does not exist, The information processing apparatus according to claim 2, characterized in that the output unit does not output the result of the matching process.
If the authentication unit fails to authenticate that the person in the input facial image is the same person as the person in the registered facial image, The information processing apparatus according to claim 1, characterized in that the matching unit performs the calculation of the degree of match.
The matching unit includes a statistical value storage unit, The statistical value storage unit stores values based on the similarity between pairs of facial images of a certain person and another facial image of the same person, and the similarity between a facial image of a certain person and a facial image of a person other than the same person. The information processing apparatus according to claim 1, characterized in that the determination unit performs the determination using the value.
The information processing apparatus according to claim 8, characterized in that the determination unit determines whether or not the determination is possible based on the degree of match and the value.
The information processing device according to claim 1, characterized in that the determination unit comprises a classifier created by machine learning, and the classifier performs the determination.
The information processing apparatus according to claim 1, characterized in that the determination unit performs the determination based on the relationship between the degree of match and a predetermined threshold.
The information processing apparatus according to claim 11, characterized in that the determination unit determines that the possibility exists when the degree of match is smaller than the predetermined threshold.
The aforementioned face image storage unit stores artificially generated face images. The information processing apparatus according to claim 1, characterized in that the matching unit calculates the match degree from the artificially generated face image, the input face image, and the registered face image.
The information processing apparatus according to claim 1, characterized in that the matching unit calculates the degree of match based on the number of point pairs detected by the dense matching method.
The information processing device according to claim 1, characterized in that the matching unit calculates the degree of match from a portion of the input facial image.
The information processing device according to claim 1, characterized in that the matching unit calculates the degree of match based on the result of detecting the organ positions in the input facial image.
A program that causes a computer to function as an information processing device according to any one of claims 1 to 16.
An information processing method for an information processing device having a face image storage unit in which a person's face image is registered, Authentication step to verify that the person in the input facial image is the same person as the person in the facial image stored in the facial image storage unit, A matching process that calculates the degree of match between the input face image and the registered face image, A determination step that uses the authentication result in the authentication step and the match score to determine whether or not the person in the input face image is likely to be the person in the registered face image, An information processing method characterized by comprising an output step that outputs information corresponding to the determination result in the determination step.

Description

This invention relates to an imaging processing device, an imaging processing method, and a program that perform re-imaging when the authentication result of a facial recognition device is found to be unauthenticated. In image-based facial recognition systems, the system sometimes compares pre-registered facial images with the facial image of the person to be authenticated to determine whether the person's facial image matches any of the pre-registered images. However, due to the quality of the person's facial image, the system may fail to authenticate even if the image is registered. Patent Document 1 discloses a method to improve the quality of facial images by improving the shooting method, which involves providing guidance on what the person to take when the facial recognition result is unauthenticated. Japanese Patent Publication No. 2019-040642 Minchul Kim, et al, “AdaFace: Quality Adaptive Margin for Face Recognition”, in CVPR 2022, arXiv: 2204.00964Jiaming Sun, et al, “LoFTR: Detector-Free Local Feature Matching with Transformers”, in CVPR 2021, arXiv: 2104.00680“You Only Look Once: Unified, Real-Time Object Detection”, in arXiv:1506.02640Kaiming He, Georgia Gkioxari, Piotr Dollar, Ross Girshick, “Mask R-CNN”, arXiv:1703.06870Amir Zadeh, Tadas Baltrusaitis, Louis-Philippe Morency “Convolutional Experts Constrained Local Model for Facial Landmark Detection”, arXiv:1611.08657 This is an example of the configuration of an image processing apparatus according to the first embodiment.This flowchart shows an example of the procedure for determining the likelihood of the person being identified according to the first embodiment.This is an example of an image taken in procedure S200.This is an example of an image created in step S201.This is an example of the information presented in step S206.This is an example of the procedure for determining the threshold used in procedure S201.This is a scatter plot showing the frequency distribution of pairs of facial images of the same person.This is an example of the procedure for determining the threshold used in procedure S204.This is an example of a scatter plot of pairs of facial images.This is a schematic diagram illustrating how a facial image is divided into rectangular regions.This is a schematic diagram showing the number of pairs of two face images where the corresponding rectangular regions both contain a face.This is a schematic diagram showing the result of extracting pixels containing faces from a facial image.This is a schematic diagram showing the result of superimposing two face regions onto a single image region.This is a schematic diagram showing the results of detecting the location of facial organs from a facial image.This is a schematic diagram showing the result of correlating the positions of facial organs detected from two facial images.This figure shows an example of the target position of facial organs.This figure shows an example of an image created by normalizing a facial image.This is a schematic diagram showing the positions of facial features on two facial images.This is a schematic diagram showing the distance between the centers of the right eyes in two facial images.This flowchart shows a detailed example of procedure S204.This is an example of a scatter plot of pairs of facial images.This is a scatter plot from Figure 21 with class division lines drawn on it.This figure shows the scatter plot in Figure 21, with the areas where the facial similarity is below a certain value divided into multiple regions.This is a flowchart showing an example of the procedure for calculating the match score.This is an example of a method for displaying matching results without showing pre-registered facial images.This is an example of how matching results are displayed with pre-registered facial images blurred.This is an example of a method for displaying matching results using illustrations based on pre-registered facial images. The present invention will be described below based on preferred embodiments with reference to the attached drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations. (First Embodiment) This embodiment describes an information processing device having an authentication function and a function to determine whether the person to be authenticated is likely to be a person registered in advance (hereinafter also referred to as "likelihood"), and to display the determination result. The information processing device according to this embodiment will be explained with reference to Figures 1 to 9. Figure 1 shows an example of the configuration of the information processing device in this embodiment. The image processing device 100 is an example of an information processing device and includes a matching unit 102, a determination unit 103, an output unit 104, a receiving unit 105, an authentication unit 109, a face image st