Search

US-12626497-B2 - Information processing device for selectively transmitting image data to be sorted to a network

US12626497B2US 12626497 B2US12626497 B2US 12626497B2US-12626497-B2

Abstract

Disclosed herein are method, device and computer program to facilitate collaboration between different places using a network while reducing the consumption of communication resources to reduce cost. An edge device having a storage unit, a determination unit and an output control unit. The storage unit holds an AI model into which image data are sequentially input and which outputs a sorting result of each of the products. The determination unit determines whether the sorting result output from the AI model in response to the input image data satisfies a predetermined condition. When the predetermined condition is satisfied, the output control unit outputs the image data identified as being a defective product, together with a first text data indicating the determination result; and when the predetermined condition is not satisfied, the output control unit outputs a second text data indicating the determination result.

Inventors

  • Hiro ONISHI

Assignees

  • HUTZPER INC.

Dates

Publication Date
20260512
Application Date
20211207
Priority Date
20201208

Claims (8)

  1. 1 . An information processing device configured to selectively transmit image data to be sorted over a network comprising: a camera configured to acquire image data; and a first processor coupled to a first storage unit, the first processor being configured to use a first model stored in the first storage unit on the image data, wherein the information processing device is communicatively connected with a server via the network, the server comprising a second processor coupled to a second storage unit, the second processor being configured to use a second model stored in the second storage unit, wherein the first processor is configured to cause the information processing device to perform a method comprising: using the camera, sequentially assigning each of a plurality of articles to be processed and sequentially acquiring image data for each of the plurality of articles; inputting the image data to be processed for each of the plurality of articles into the first model, the first model being configured to provide, based on the image data, a processing result output that indicates whether each of the plurality of articles satisfies a sorting condition; determining, for each of the plurality of articles to be processed, whether the processing result output from the first model satisfies the sorting condition; transmitting, to the server via the network, a first text data, corresponding identification information, and the image data to be processed in response to a first determination that is determined to satisfy the sorting condition; transmitting, to the server via the network, a second text data and corresponding identification information, without the image data to be processed in response to a second determination that is determined not to satisfy the sorting condition, wherein the image data is configured to be accepted by the second processor of the server for re-learning against the second model, and receiving, at a predetermined timing, the second model that has re-learned, and updating the first model, wherein at the information processing device, the first processor is configured to cause the information processing device to perform the method using the first model updated to the second model that has re-learning after the information processing device receives the second model that has re-learned.
  2. 2 . The information processing device according to claim 1 , wherein the first model is configured to output, as the processing result, a category to which the article belongs among a plurality of categories, and in the determining, for each of the plurality of articles to be processed, the first processor is configured to cause the information processing device to determine whether the sorting condition is satisfied, using a condition of belonging to a predetermined category as the sorting condition.
  3. 3 . The information processing device according to claim 2 , wherein the plurality of categories includes a first category indicating a non-defective product and a second category indicating a defective product, and in the determining, for each of the plurality of articles to be processed, the first processor is configured to cause the information processing device to determine whether the sorting condition is satisfied, using a first condition of belonging to the second category as the sorting condition.
  4. 4 . The information processing device according to claim 3 , wherein the plurality of categories further includes a third category indicating that the non-defective product and the defective product are difficult to be distinguished, in the determining, for each of the plurality of articles to be processed, the first processor is configured to cause the information processing device to determine whether the sorting condition is satisfied, using a second condition of belonging to the third category in addition to the first condition as the sorting condition, and wherein in the transmitting, to the server via the network, the first text data, at least one of information of the second category that satisfies the first condition and information of the third category that satisfies the second condition is included in the first text data.
  5. 5 . The information processing device according to claim 1 , wherein the first processor is configured to cause the information processing device to receive, from an outside via the network: an evaluation to the first text data, the corresponding identification information, and the image data to be processed, or a change in the sorting condition associated with the first text data, the corresponding identification information, and the image data to be processed, to promote re-learning for the second model.
  6. 6 . The information processing device according to claim 5 , wherein the evaluation of the first text data, the corresponding identification information, and the image data to be processed, or the change in the sorting condition, is configured to be accepted via a graphical user interface provided on the server or another information processing device.
  7. 7 . An information processing method executed by an information processing device configured to selectively transmit image data to be sorted over a network, the method comprising: retaining a first model to which the image data regarding an article is input and from which a processing result for the article is output, wherein the information processing device is communicatively connected with a server via the network, the server retaining a second model for updating the first model; sequentially assigning each of a plurality of articles to be processed and sequentially acquiring image data for each of the plurality of articles; inputting the image data to be processed for each of the plurality of articles into the first model, the first model being configured to provide, based on the image data, a processing result output that indicates whether each of the plurality of articles satisfies a sorting condition; determining, for each of the plurality of articles to be processed, whether the processing result output from the first model satisfies the sorting condition; transmitting, to the server via the network, a first text data, corresponding identification information, and the image data to be processed in response to a first determination that is determined to satisfy the sorting condition; transmitting, to the server via the network, a second text data and corresponding identification information, without the image data to be processed in response to a second determination that is determined not to satisfy the sorting condition, wherein the image data is accepted by the server for re-learning against the second model; and receiving, at a predetermined timing, the second model that has re-learned, and updating the first model, wherein at the information processing device, the information processing method is executed using the first model that has been updated to the second model that has been re-learned.
  8. 8 . A non-transitory computer readable medium storing a program causing a computer, which controls an information processing device, to execute a control processing comprising: retaining a first model to which image data regarding an article is input and from which a processing result for the article is output; wherein the information processing device is communicatively connected with a server via a network, the server retaining a second model for updating the first model, sequentially assigning each of a plurality of articles to be processed and sequentially acquiring image data for each of the plurality of articles; inputting the image data to be processed for each of the plurality of articles into the first model, the first model being configured to provide, based on the image data, a processing result output that indicates whether each of the plurality of articles satisfies a sorting condition; determining, for each of the plurality of articles to be processed, whether the processing result output from the first model satisfies the sorting condition; transmitting, to the server via the network, a first text data, corresponding identification information, and the image data to be processed in response to a first determination that is determined to satisfy the sorting condition; transmitting, to the server via the network, a second text data and corresponding identification information, without the image data to be processed in response to a second determination that is determined not to satisfy the sorting condition, wherein the image data is accepted by the server for re-learning against the second model, and receiving, at a predetermined timing, the second model that has re-learned, and updating the first model, wherein at the information processing device, the control processing is executed using the first model that has been updated to the second model that has been re-learned.

Description

NOTICE OF COPYRIGHTS AND TRADE DRESS A portion of the disclosure of this patent document contains material which is subject to copyright protection. This patent document may show and/or describe matter which is or may become trade dress of the owner. The copyright and trade dress owner has no objection to the facsimile reproduction by anyone of the patent disclosure as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright and trade dress rights whatsoever. RELATED APPLICATION INFORMATION This patent claims priority from International PCT Patent Application No. PCT/JP2021/045008, filed Dec. 7, 2021 entitled, “INFORMATION PROCESSING DEVICE”, which claims priority to Japanese Patent Application No. 2020-203752, filed Dec. 8, 2020, all of which are incorporated herein by reference in their entirety. TECHNICAL FIELD The present invention relates to an information processing device. BACKGROUND Conventionally, image data captured by a camera is sent to a cloud server through a network, and the image data is sorted by an AI model on the cloud server (for example, see Patent Document 1, Japanese Unexamined Patent Application, Publication No. 2020-160966). SUMMARY OF THE INVENTION Problems to be Solved by the Invention However, in this case, when the volume of image data to be sorted is large, not only is a load applied to the network, but also the network traffic increases, resulting in an increase in cost. Further, it is necessary to collect sufficient image data to construct an AI model for sorting, but such work takes a lot of time, which delays improvement in sorting accuracy. Furthermore, while articles for which image data to be sorted can be obtained are located at a production site, a location of production management is often located away from the production site, and thus it is essential to cooperate between remote locations via a network. An object of the present invention is to reduce consumption of communication resources, reduce costs, and improve sorting accuracy while performing cooperation between different locations using a network. Means for Solving the Problems In order to achieve the above object, an aspect of the present invention provides an information processing device including: a model retaining unit that retains a model to which image data regarding an article is input and from which a predetermined processing result for the article is output;an image acquisition unit that acquires, as image data to be sorted, image data regarding an article to be processed;a determination unit that determines whether the predetermined processing result output from the model as a result of inputting the image data to be processed to the model satisfies a predetermined condition; andan output control unit that executes control to output the image data to be processed to an external device together with a determination result when the determination unit determines that the predetermined condition is satisfied, and to output only a determination result to the external device when the determination unit determines that the predetermined condition is not satisfied. Thus, it is possible to perform data cooperation by transmitting data for articles acquired at the production site to an external device, for example, a manager terminal or a server installed at a place for production management, using a network. Further, in an inspection task for sorting out products as an example of articles, data mainly transmitted to the network is text data indicating normal products, and thus the volume of data flowing through the network can be reduced and the load and use of communication resources can be reduced compared with a case where image data of each article is sent every time. Further, since predetermined image data to be learned, for example, only image data sorted as a defective product as a result of inspection of product is automatically collected, machine learning of the AI model can be accelerated. As a result, it is possible to reduce consumption of communication resources, reduce costs, and improve sorting accuracy while performing cooperation between different locations using a network. An information processing method and a program corresponding to the information processing device according to an aspect of the present invention are also provided as an information processing method and a program according to an aspect of the present invention. Effects of the Invention According to the present invention, it is possible to reduce consumption of communication resources, reduce costs, and improve sorting accuracy while performing cooperation between different locations using a network. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a functional block diagram showing an example of functional configurations of an edge device, a server, and a manager terminal in an information processing system according to an embodiment of the present invention; FIG. 2 is a bloc