JP-7855412-B2 - Information processing device, information processing method, and program

JP7855412B2JP 7855412 B2JP7855412 B2JP 7855412B2JP-7855412-B2

Inventors

田中頌二
佐藤博

Assignees

キヤノン株式会社

Dates

Publication Date: 20260508
Application Date: 20220613

Claims (20)

A first extraction means performs a first extraction process on an image to be registered to extract first feature information representing the characteristics of the registered image, A second extraction means performs a second extraction process on the image to be registered to extract second feature information that can be compared with the first feature information, A comparison means for comparing the first characteristic information and the second characteristic information, A registration means that registers registration information associated with the registration target, which of the first extraction process or the second extraction process to be used for the matching process based on the results of the comparison by the comparison means, An information processing device characterized by having the following features.
The information processing apparatus according to claim 1, characterized in that the second extraction process is an extraction process that requires less computational effort to extract the feature information than the first extraction process.
The information processing apparatus according to claim 1, characterized in that the second extraction process is an extraction process that requires a smaller configuration for extracting the feature information than the first extraction process.
The first extraction means extracts the first feature information by the first extraction process using the first model generated by learning, The information processing apparatus according to claim 1, characterized in that the second extraction means extracts the second feature information by a second extraction process using the second model generated by distillation using the first model.
The second extraction means extracts a plurality of second feature information using a plurality of second models generated by distillation using the first model, The comparison means compares the first characteristic information with the plurality of second characteristic information, The information processing apparatus according to claim 4, characterized in that the registration means generates registration information that associates with the registration target whether to perform a matching process using a first extraction process using the first model or a second extraction process using one of the multiple second models, based on the result of the comparison by the comparison means.
The comparison means calculates the distance between the first feature information and the second feature information, The information processing apparatus according to claim 1, characterized in that the registration means uses the second extraction process for matching when the distance calculated by the comparison means is less than or equal to a predetermined threshold.
The information processing apparatus according to claim 1, characterized in that the registration means generates registration information that associates information indicating whether the first extraction process or the second extraction process is to be used for the matching process, and the feature information extracted by either the first or second extraction process designated for the matching process, with identification information unique to the registration target.
Image acquisition means for acquiring a captured image including the aforementioned registration target, The system includes a detection means for detecting the image to be registered from the captured image, The first extraction means extracts the first feature information from the detected image of the target to be registered, The information processing apparatus according to claim 1, wherein the second extraction means extracts the second feature information from the detected image of the target to be registered.
The information processing apparatus according to claim 8, characterized in that, at a predetermined time, the image acquisition means acquires a new image of the target to be registered, and updates the registration information by performing processing from the detection means to the registration means based on the new image of the target to be registered.
The information processing apparatus according to claim 9, characterized in that the predetermined period is a time when the seasons change or a time when the amount of daylight changes.
It has detection means for detecting changes in the external environment, The information processing apparatus according to claim 8, characterized in that when a change in the external environment is detected, the image acquisition means acquires a new image of the target to be registered, and updates the registration information by performing processing from the detection means to the registration means based on the new image of the target to be registered.
The information processing apparatus according to claim 11, characterized in that the detection means detects at least one of the following as changes in the external environment: changes in ambient light, changes in the installation location of the imaging device that acquires the image of the registered target, changes in the field of view of the imaging device, and changes in the arrangement of objects around the imaging device.
The information processing device according to claim 1, characterized in that the image to be registered is a facial image of a person.
A detection means for detecting an image of the object to be recognized from a captured image that includes the object to be recognized, A means for acquiring registration information that acquires registration information registered by an information processing device according to any one of claims 1 to 13, Based on the registration information obtained by the registration information acquisition means, an extraction means extracts feature information from the image of the object to be recognized, A matching means that uses the feature information extracted by the extraction means to verify whether the recognized target is the registered target, An information processing device characterized by having the following features.
The system has identification information acquisition means for acquiring identification information of the recognized target, The information processing apparatus according to claim 14, wherein the registration information acquisition means acquires registration information of a registration target identified according to the identification information from a database in which the registration information is stored.
The information processing apparatus according to claim 15, characterized in that the detection means tracks the recognition target identified by the identification information.
An information processing method performed by an information processing device, A first extraction step involves performing a first extraction process on an image to be registered to extract first feature information that represents the characteristics of the image to be registered, A second extraction step involves performing a second extraction process on the image to be registered to extract second feature information that can be compared with the first feature information, A comparison step of comparing the first characteristic information and the second characteristic information, A registration step in which, based on the results of the comparison in the comparison step, the registration information is registered that associates with the registration target which of the first extraction process or the second extraction process will be used for the matching process, An information processing method characterized by having the following features.
An information processing method performed by an information processing device, A detection step of detecting an image of the object to be recognized from a captured image that includes the object to be recognized, A registration information acquisition step of acquiring registration information registered by an information processing device according to any one of claims 1 to 13, Based on the registration information obtained in the registration information acquisition step, an extraction step is performed to extract feature information from the image of the object to be recognized, A matching step is performed to determine whether the recognition target is the registration target or not, using the feature information extracted in the extraction step. An information processing method characterized by having the following features.
Computers, A first extraction means performs a first extraction process on an image to be registered to extract first feature information representing the characteristics of the registered image, A second extraction means performs a second extraction process on the image to be registered to extract second feature information that can be compared with the first feature information, A comparison means for comparing the first characteristic information and the second characteristic information, A registration means that registers registration information associated with the registration target, which of the first extraction process or the second extraction process to be used for the matching process based on the results of the comparison by the comparison means, A program that allows the device to function as an information processing device, including the necessary components.
Computers, A detection means for detecting an image of the object to be recognized from a captured image that includes the object to be recognized, A means for acquiring registration information that acquires registration information registered by an information processing device according to any one of claims 1 to 13, An extraction means for extracting feature information from the image of the object to be recognized based on the registration information acquired by the registration information acquisition means, A matching means that uses the feature information extracted by the extraction means to verify whether the recognized target is the registered target, A program that allows the device to function as an information processing device, including the necessary components.

Description

This invention relates to the registration of information used for matching, and to information processing technology for matching. In recent years, image recognition technology based on deep learning has become increasingly common in person recognition, such as matching individuals in images to registered profiles. Deep learning-based image recognition technology uses a learning model composed of a neural network (hereinafter abbreviated as NN) to extract feature information from facial images of people. In particular, the larger and more complex the learning model composed of NN, the higher the likelihood of extracting highly expressive and accurate feature information from facial images. However, the larger and more complex the learning model, the longer the processing time required for image recognition. On the other hand, using a small-scale learning model can shorten the processing time for image recognition, but the feature information extracted from facial images may have low expressiveness and undesirable recognition accuracy. Patent Document 1 discloses a multi-stage matching technique using a low-accuracy but high-speed matching means and a high-accuracy but low-speed matching means. Specifically, Patent Document 1 discloses a technique in which the low-accuracy but high-speed matching means is used to narrow down the target of recognition, and then the high-accuracy but low-speed matching means is used to perform the matching (recognition). Japanese Patent Publication No. 2010-92119 This figure shows an example of a system configuration including an information processing device.This is a functional block diagram of the registration device and the recognition device.This is a flowchart showing the registration process.This is a diagram illustrating an example of registration information.This is a flowchart showing the recognition process flow.This diagram illustrates an example of the registration screen in the second embodiment. The embodiments of the present invention will be described below with reference to the drawings. The embodiments described below are not limiting to the present invention, and not all combinations of features described in these embodiments are essential to the solutions of the present invention. The configuration of the embodiments may be modified or changed as appropriate depending on the specifications and various conditions (usage conditions, usage environment, etc.) of the device to which the present invention is applied. Furthermore, parts of each embodiment described later may be combined as appropriate. In the following embodiments, the same components will be denoted by the same reference numerals. <System Configuration Example> Figure 1 is a diagram showing an example configuration of a recognition system including an information processing device according to the first embodiment. The information processing device 110 includes a system control unit 111, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 113, an HDD (Hard Disk Drive) 114, and a communication unit 115. The system control unit 111 has, for example, a CPU (Central Processing Unit) and reads control programs stored in the ROM 112 to execute various processes. A GPU (Graphics Processing Unit) may be used instead of the CPU. The RAM 113 is used as the main memory, work area, and other temporary storage areas of the system control unit 111. The HDD 114 stores various data and various programs. It is assumed that the information processing programs related to the information processing device 110 of this embodiment are stored in the ROM 112 or the HDD 114. That is, each function and process according to this embodiment, which will be described later, is realized by the system control unit 111 reading and executing the information processing programs stored in the ROM 112 or the HDD 114. The communication unit 115 is configured to communicate with the server 100 via the network 120. Server 100 comprises a system control unit 101, ROM 102, RAM 103, HDD 104, communication unit 105, and a database (DB) 106. The system control unit 101 has a CPU and reads control programs stored in ROM 102 to execute various processes. RAM 103 is used as the main memory and temporary storage area for the system control unit 101, such as a work area. HDD 104 stores various data and programs. DB 106 stores necessary data to be managed. Note that the data in DB 106 may also be stored in the HDD. The communication unit 105 is capable of communicating with the information processing device 110 via the network 120. Here, the recognition system of this embodiment, as an example, performs a person matching process to confirm whether the person is a registered person by performing a person recognition process using the person's facial image when a person passes through a security gate for entry and exit management. For this reason, in addition to the information processing device 110 and server 100 described above, the recog