CN-116645314-B - Teacher data generation device, teacher data generation method, and recording medium containing program

Abstract

A teacher data generation device (4) is provided with an image receiving unit (41) for receiving, from an inspection device (2) that images an object to detect a defect, a defect image of a predetermined size including a detection region of the defect and defect information indicating a range of the detection region in the defect image, a cut image generation unit (42) for cutting out, from the defect image, a region including the detection region as a cut image based on the defect information, a display control unit (43) for displaying at least a part of the defect image on a display (35), a determination result receiving unit (44) for receiving an input of a determination result of a defect type of the defect image displayed on the display (35) by an operator, and a teacher data generation unit (45) for generating teacher data by marking the determination result on the cut image. This makes it possible to easily generate teacher data including an image in which unnecessary areas other than the defective area are reduced.

Inventors

• SHIOMI JUNICHI

Assignees

• 株式会社斯库林集团

Dates

Publication Date

20260505

Application Date

20230120

Priority Date

20220222

Claims (10)

1. 1. A teacher data generation device for generating teacher data, comprising: An image receiving unit that receives, from an inspection device that images an object to detect a defect, a defect image of a predetermined size including a detection region of the defect and defect information indicating a range of the detection region in the defect image; A cutout image generation unit that cuts out an area including the detection area from the defect image as a cutout image based on the defect information; A display control unit that displays at least a part of the defect image on a display; A determination result receiving unit for receiving an input of a determination result of a defect type by an operator for the defect image displayed on the display, and A teacher data generation unit configured to generate teacher data by labeling the determination result to the cut image, Each position of the object belongs to one of a plurality of region classes, The defect information includes area category information indicating an area category to which the detection area belongs, The cutout image generation unit stores the expansion amounts set for the respective region types, and includes the region in which the detection region is expanded by the expansion amounts determined using the region type information in the cutout image.
2. 2. The teacher data generation device according to claim 1, characterized in that, The object is a printed circuit board, and the plurality of region categories include at least a plating region and a solder resist region.
3. 3. A teacher data generation device for generating teacher data, comprising: An image receiving unit that receives, from an inspection device that images an object to detect a defect, a defect image of a predetermined size including a detection region of the defect and defect information indicating a range of the detection region in the defect image; A cutout image generation unit that cuts out an area including the detection area from the defect image as a cutout image based on the defect information; A display control unit that displays at least a part of the defect image on a display; A determination result receiving unit for receiving an input of a determination result of a defect type by an operator for the defect image displayed on the display, and A teacher data generation unit configured to generate teacher data by labeling the determination result to the cut image, One of a plurality of inspection sensitivities is set for each position of the object, The defect information contains inspection sensitivity information indicating an inspection sensitivity used at the time of detection of the detection area, The cutout image generation unit stores the expansion amounts set for the respective inspection sensitivities, and includes the detection region expanded region in the cutout image by the expansion amounts determined by using the inspection sensitivity information.
4. 4. The teacher data generation device according to any one of claims 1 to 3, characterized in that, Each position of the object belongs to one of a plurality of region classes, The defect information includes area category information indicating an area category to which the detection area belongs, In addition to the determination result, the teacher data generation section marks the cut image with a region type to which the detection region belongs.
5. 5. A teacher data generation method for generating teacher data, comprising: a) A step of receiving a defect image of a predetermined size including a detection region of a defect and defect information indicating a range of the detection region in the defect image from an inspection apparatus that images an object to detect the defect; b) Cutting out an area including the detection area from the defect image as a cut-out image according to the defect information; c) A step of displaying at least a part of the defect image on a display; d) A step of receiving input of a determination result of a defect type by an operator for the defect image displayed on the display, and E) A step of generating teacher data by labeling the cut image with the determination result, wherein each position of the object belongs to one of a plurality of region categories, The defect information includes area category information indicating an area category to which the detection area belongs, In the step b), an expansion amount set for each region type is prepared, and a region in which the detection region is expanded by the expansion amount determined using the region type information is included in the cutout image.
6. 6. The teacher data generation method of claim 5, wherein, The object is a printed circuit board, and the plurality of region categories include at least a plating region and a solder resist region.
7. 7. A teacher data generation method for generating teacher data, comprising: a) A step of receiving a defect image of a predetermined size including a detection region of a defect and defect information indicating a range of the detection region in the defect image from an inspection apparatus that images an object to detect the defect; b) Cutting out an area including the detection area from the defect image as a cut-out image according to the defect information; c) A step of displaying at least a part of the defect image on a display; d) A step of receiving input of a determination result of a defect type by an operator for the defect image displayed on the display, and E) A step of generating teacher data by labeling the determination result on the cut image, setting one of a plurality of inspection sensitivities for each position of the object, The defect information contains inspection sensitivity information indicating an inspection sensitivity used at the time of detection of the detection area, In the step b), an expansion amount set for each inspection sensitivity is prepared, and an area in which the detection area is expanded by the expansion amount determined using the inspection sensitivity information is included in the cutout image.
8. 8. The teacher data generation method according to any one of claims 5 to 7, characterized in that, Each position of the object belongs to one of a plurality of region classes, The defect information includes area category information indicating an area category to which the detection area belongs, In the step e), in addition to the determination result, the cut image is marked with the region type to which the detection region belongs, A plurality of teacher data labeled with one region class are used to generate a learned model for defect classification of the one region class.
9. 9. A recording medium having recorded thereon a program for causing a computer to generate teacher data, the program being executed by the computer and causing the computer to execute: a) A step of receiving a defect image of a predetermined size including a detection region of a defect and defect information indicating a range of the detection region in the defect image from an inspection apparatus that images an object to detect the defect; b) A step of cutting out an area including the detection area from the defect image as a cut-out image based on the defect information; c) A step of displaying at least a part of the defect image on a display; d) A step of receiving input of a determination result of a defect type by an operator for the defect image displayed on the display, and E) A step of generating teacher data by labeling the determination result on the cut image, Each position of the object belongs to one of a plurality of region classes, The defect information includes area category information indicating an area category to which the detection area belongs, In the step b), an expansion amount set for each region type is prepared, and a region in which the detection region is expanded by the expansion amount determined using the region type information is included in the cutout image.
10. 10. A recording medium having recorded thereon a program for causing a computer to generate teacher data, the program being executed by the computer and causing the computer to execute: a) A step of receiving a defect image of a predetermined size including a detection region of a defect and defect information indicating a range of the detection region in the defect image from an inspection apparatus that images an object to detect the defect; b) A step of cutting out an area including the detection area from the defect image as a cut-out image based on the defect information; c) A step of displaying at least a part of the defect image on a display; d) A step of receiving input of a determination result of a defect type by an operator for the defect image displayed on the display, and E) A step of generating teacher data by labeling the determination result on the cut image, One of a plurality of inspection sensitivities is set for each position of the object, The defect information contains inspection sensitivity information indicating an inspection sensitivity used at the time of detection of the detection area, In the step b), an expansion amount set for each inspection sensitivity is prepared, and an area in which the detection area is expanded by the expansion amount determined using the inspection sensitivity information is included in the cutout image.

Description

Teacher data generation device, teacher data generation method, and recording medium containing program Technical Field The present invention relates to a technique for generating teacher data. Background In an inspection apparatus for detecting a defect by imaging an object, when the defect is detected, a defect image of a predetermined size including a defect region is output. Classification of defect categories represented by such defect images by a learned model (classifier) is considered. In this case, the operator determines (that is, annotates) the defect type of the defect image prepared in advance, generates teacher data obtained by labeling the defect image with one defect type, and learns using a plurality of pieces of teacher data to generate the learned model. Japanese patent application laid-open No. 2019-87078 (document 1) discloses a method in which an operator inputs a region including a defect in an image, corrects the outer edge of an extended region so that pixels included in the region exceed a predetermined amount, and associates the corrected region with the image to generate learning data. However, the defect image outputted from the inspection apparatus is of a fixed size and includes a large number of unnecessary areas other than the defective area. Therefore, even if learning is performed using teacher data including such a defective image, it is difficult to obtain a high-precision learned model. As in the method of document 1, it is also considered that an image with reduced unnecessary areas can be obtained by inputting an area including a defect by an operator, but the operation load becomes large. Therefore, a method of easily generating teacher data including an image in which unnecessary areas other than a defective area are reduced is required. Disclosure of Invention The present invention is directed to a teacher data generation device for generating teacher data, and is aimed at easily generating teacher data including an image in which unnecessary areas other than a defective area are reduced. A teacher data generation device is provided with an image receiving unit that receives, from an inspection device that images an object to detect a defect, a defect image of a predetermined size including a detection region of the defect and defect information indicating a range of the detection region in the defect image, a cut image generation unit that cuts, as a cut image, a region including the detection region from the defect image based on the defect information, a display control unit that displays at least a part of the defect image on a display, a determination result receiving unit that receives input of a determination result of a type of defect performed by an operator for the defect image displayed on the display, and a teacher data generation unit that marks the determination result on the cut image to generate teacher data. According to the present invention, teacher data including an image in which unnecessary areas other than a defective area are reduced can be easily generated. Preferably, each position of the object belongs to one of a plurality of region types, the defect information includes region type information indicating a region type to which the detection region belongs, the cutout image generation unit stores an expansion amount set for each region type, and the cutout image generation unit includes a region in which the detection region is expanded by the expansion amount determined using the region type information. Preferably, the object is a printed circuit board, and the plurality of region categories include at least a plating region and a solder resist region. Preferably, one of a plurality of inspection sensitivities is set for each position of the object, the defect information includes inspection sensitivity information indicating an inspection sensitivity used at the time of detection of the detection region, the cutout image generation unit stores an expansion amount set for each inspection sensitivity, and the cutout image generation unit includes a region in which the detection region is expanded by the expansion amount determined using the inspection sensitivity information. Preferably, each position of the object belongs to one of a plurality of region types, the defect information includes region type information indicating a region type to which the detection region belongs, and the teacher data generation unit marks the region type to which the detection region belongs on the cut image in addition to the determination result. The invention also provides a teacher data generation method for generating teacher data. The teacher data generation method includes a) a step of receiving a defect image of a predetermined size including a detection region of a defect and defect information indicating a range of the detection region in the defect image from an inspection device that images an object to detect the defect, b) a step of cutting