Search

JP-7857333-B2 - Information processing device, control method for information processing device, and program

JP7857333B2JP 7857333 B2JP7857333 B2JP 7857333B2JP-7857333-B2

Inventors

  • 影山 雄一

Assignees

  • キヤノン株式会社

Dates

Publication Date
20260512
Application Date
20240325

Claims (17)

  1. A determination means for determining a confidentiality area in which personal information is concealed from the first image, A means for performing a concealment process on the first image based on the concealment area, A means for assigning label information to the aforementioned confidential area, A display means that superimposes and displays the label information onto a second image, which is a concealed image on which the concealment process has been performed. A learning means that performs learning using the first image described above, An information processing device characterized by comprising:
  2. The information processing apparatus according to claim 1, characterized in that the label information includes at least one region label among the face label, pupil label, and mouth label of the person included in the first image.
  3. The information processing device according to claim 1, characterized in that the label information includes at least one classification label from among the category label, gender label, and orientation label of the person included in the first image.
  4. The information processing apparatus according to claim 1, further comprising management means for managing a plurality of images including the first image and a plurality of confidential images including the second image.
  5. The system further comprises an image similarity calculation means for calculating the image similarity between the confidential area of the first image and the confidential area of another image managed by the management means, The information processing apparatus according to claim 4, characterized in that the display means acquires and displays an image whose image similarity is equal to or greater than a threshold from among the other images managed by the management means.
  6. The system further comprises a label similarity calculation means for calculating the label similarity between the label information assigned to the confidential area of the first image and the label information assigned to other images managed by the management means, The information processing apparatus according to claim 4 , characterized in that the display means acquires and displays an image from among the other images managed by the management means in which the label similarity is equal to or greater than a threshold.
  7. The system further comprises a similar image generation means for converting the confidential area into a similar image, The information processing apparatus according to claim 1, characterized in that the display means displays the second image in which the confidential area has been converted into the similar image.
  8. The system further comprises a calculation means for calculating the image similarity between the first image and the second image in which the concealed region has been converted into a similar image, The information processing apparatus according to claim 7, characterized in that the display means displays the second image in which the concealed area has been converted into the similar image when the image similarity is greater than or equal to a first threshold and less than or equal to a second threshold greater than the first threshold.
  9. The first image mentioned above is associated with learning usage information. The system further comprises a score calculation means for calculating a learning usage recommendation score based on the learning usage information of the first image, The information processing apparatus according to claim 1, wherein the display means further displays the learning usage information and the learning usage recommendation score.
  10. The information processing apparatus according to claim 9, characterized in that the learning utilization information includes at least one of the following: the accuracy improvement rate when the first image was used for learning, the number of times the first image was used for learning, and the number of high ratings for the first image.
  11. The information processing apparatus according to claim 1, further comprising a map display means for displaying a model output map obtained as a result of inputting the first image into the model and performing training.
  12. The system further comprises a conversion means for converting the model output map into an image based on the confidential region of the first image, The information processing apparatus according to claim 11, characterized in that the map display means displays the model output map converted by the conversion means.
  13. A calculation means for calculating the similarity between the first image and the model output map, A parameter determination means that determines the conversion parameters used by the conversion means so that the similarity is below a threshold, The information processing apparatus according to claim 12, further comprising:
  14. The information processing apparatus according to claim 13, characterized in that the map display means determines whether or not to display the model output map according to the label information assigned to the first image.
  15. The information processing apparatus according to claim 1, characterized in that the display means displays the second image to the user when the user performs learning using the first image.
  16. A method for controlling an information processing device, A decision-making process for determining a confidentiality area to conceal personal information in the first image, A concealment step in which concealment processing is performed on the first image based on the aforementioned concealment area, A step of assigning label information to the confidential area, A display step of superimposing the label information onto a second image, which is a concealed image on which the concealment process has been performed, A learning process that performs learning using the first image described above, A control method for an information processing device, characterized by having the following features.
  17. A program for causing a computer to function as an information processing device according to any one of claims 1 to 15.

Description

This invention relates to an information processing device, a control method for the information processing device, and a program. In recent years, research in the field of image recognition has been flourishing, and various methods for recognizing object regions in images using convolutional neural networks (CNNs) have been proposed. In machine learning, to obtain a machine learning model with high generalization performance, it is recommended to train the model using various image patterns. The number and variety of training images significantly impact accuracy. In particular, when it comes to human faces, there are numerous combinations of factors such as race, gender, age, facial expression, face orientation, and lighting conditions. Therefore, a wide variety of images are necessary to improve the performance of a machine learning model that recognizes human faces. Furthermore, in recent years, awareness of personal information protection has been increasing, making anonymization necessary and making it difficult to collect training image data without consent. Personal information includes not only people's faces, but also documents containing personal names and house nameplates. Such images require image processing, such as blacking out or blurring, to protect personal information. With such personal information-concealed images, users can upload images without fear of personal information leakage. For example, in online communities that share images for machine learning, this can stimulate image uploads from users, allowing machine learning engineers to ensure a variety of training images. Patent Document 1 discloses a technology for generating images that conceal personal information of individuals and for using these concealed images in machine learning. Japanese Patent Publication No. 2019-79357 A diagram showing an example of the hardware configuration of an information processing device according to one embodiment.A diagram showing an example of the software configuration of an information processing device according to one embodiment.(a)-(c) Diagrams illustrating the detailed configuration of the information processing device according to embodiments 2, 3, and 4.(a)-(f) Diagram illustrating Embodiment 1.(a) and (b) flowcharts showing the procedure for the image registration process according to Embodiment 1.A flowchart illustrating the steps of the learning process according to one embodiment.(a) and (b) flowcharts showing the procedure for the display screen generation process according to Embodiment 1.A diagram illustrating Embodiment 2.(a)-(d) Flowcharts showing the procedure for the display screen generation process according to Embodiment 2.A diagram illustrating Embodiment 3.(a) and (b) A flowchart showing the procedure for the display screen generation process according to Embodiment 3.A diagram illustrating Embodiment 4.(a) and (b) A flowchart showing the procedure for the output map verification process according to Embodiment 4. The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While multiple features are described in the embodiments, not all of these features are necessarily essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted. (Embodiment 1: Label information is displayed superimposed) In this embodiment, a hidden image is displayed to the user during learning, and the original image is used for learning. For example, an example is described in which label information (face label, pupil label, mouth label, category label, gender label, orientation label, etc.) is displayed on or together with the hidden image. <Hardware Configuration> Figure 1 shows an example of the hardware configuration of an information processing device according to one embodiment. The information processing device 200 includes a CPU (Central Processing Unit) 100, a ROM (Read Only Memory) 110, a RAM (Random Access Memory) 120, and an HDD 130. The information processing device 200 further includes an input unit 140, an information display unit 150, and a communication unit 160. The CPU 100 is a central processing unit that performs calculations and logical decisions for various processes. The ROM 110 stores the control program. The RAM 120 is used as the CPU 100's main memory and temporary storage area, such as the work area. The HDD 130 is a hard disk for storing electronic data and programs according to this embodiment. An external storage device may be used to perform a similar role. Here, the external storage device can be implemented, for example, by a media (recording medium) and an external storage drive for accessing the media. Examples of such media include flexible disks (FD), CD-ROMs, DVDs, USB memory, MO