US-12620243-B2 - Information terminal, character recognition method and character recognition program

US12620243B2US 12620243 B2US12620243 B2US 12620243B2US-12620243-B2

Abstract

An information terminal includes a controller. The controller is configured to: repeat a process of acquiring a frame image that has been captured and a process of storing a character recognition result in a storage, the character recognition result being obtained by performing character recognition of the frame image and being a character string that is determined to be written in accordance with a naming rule; and when a predetermined operation to the information terminal to end capturing of the frame image is received and the character recognition result is not stored in the storage based on a frame image acquired when the predetermined operation is received, finalize the character recognition result to be the character string that is stored in the storage based on a frame image acquired prior to the frame image when the predetermined operation is received.

Inventors

Satoshi YAMAGAMI
So YANAGIMOTO

Assignees

DAIKIN INDUSTRIES, LTD.

Dates

Publication Date: 20260505
Application Date: 20250227
Priority Date: 20220905

Claims (11)

1 . An information terminal comprising: a controller, wherein the controller is configured to: repeat a process of acquiring a frame image that has been captured and a process of storing a character recognition result in a storage, the character recognition result being obtained by performing character recognition of the frame image and being a character string that is determined to be written in accordance with a naming rule, thereby storing a plurality of character recognition results of a plurality of frame images in the storage; and when a predetermined operation to the information terminal to end capturing of the frame image is received, finalize, as a final character recognition result, (i) in a case where the character recognition result of the frame image that is last captured is obtained, the character recognition result of the frame image that is last captured among the plurality of frame images, and (ii) in a case where the character recognition result of the frame image that is last captured is not obtained, the character recognition result of the frame image that is captured earlier than the frame image that is last captured.
2 . The information terminal according to claim 1 , wherein when the frame image that has been captured is displayed in real time, the character recognition result obtained by the character recognition is superimposed and displayed.
3 . The information terminal according to claim 2 , wherein the controller is configured to: update, at a first time interval, the frame image that is displayed; and update, at a second time interval longer than the first time interval, the character recognition result that is superimposed and displayed.
4 . The information terminal according to claim 1 , wherein the controller is configured to: when the frame image that has been captured includes a plurality of items, each of the plurality of items being to be stored as the character recognition result, store the character recognition result of each item obtained by the character recognition in the storage by each item; and when the predetermined operation to the information terminal to end capturing of the frame image is received, finalize, by each item, as a final character recognition result, (i) in a case where the character recognition result of the frame image that is last captured is obtained, the character recognition result of the frame image that is last captured among the plurality of frame images, and (ii) in a case where the character recognition result of the frame image that is last captured is not obtained, the character recognition result of the frame image that is captured earlier than the frame image that is last captured.
5 . The information terminal according to claim 1 , wherein the controller is configured to store a corrected character recognition result in the storage when the final character recognition result that is displayed is corrected in response to a display unit displaying the final character recognition result.
6 . The information terminal according to claim 1 , wherein the controller is configured to perform the character recognition of the frame image in which a nameplate of equipment is captured and to obtain a model name and a serial number as the character recognition result.
7 . The information terminal according to claim 1 , wherein the controller is configured to: store the plurality of character recognition results obtained by the character recognition in a first storage; and store the final character recognition result in a second storage.
8 . The information terminal according to claim 7 , wherein the controller is configured to update the plurality of character recognition results stored in the first storage each time a character recognition result is obtained by performing the character recognition.
9 . The information terminal according to claim 7 , wherein the controller is configured to: store, in the first storage, each of the plurality of frame images in association with a corresponding one of the plurality of character recognition results; and store, in the second storage, the frame image from which the final character recognition result is obtained in association with the final character recognition result.
10 . A character recognition method, wherein a controller of an information terminal executes: a step of repeating a process of acquiring a frame image that has been captured and a process of storing a character recognition result in a storage, the character recognition result being obtained by performing character recognition of the frame image and being a character string that is determined to be written in accordance with a naming rule, thereby storing a plurality of character recognition results of a plurality of frame images in the storage; and when a predetermined operation to the information terminal to end capturing of the frame image is received, a step of finalizing, as a final character recognition result, (i) in a case where the character recognition result of the frame image that is last captured is obtained, the character recognition result of the frame image that is last captured among the plurality of frame images, and (ii) in a case where the character recognition result of the frame image that is last captured is not obtained, the character recognition result of the frame image that is captured earlier than the frame image that is last captured.
11 . A non-transitory computer-readable recording medium storing a character recognition program for causing a controller of an information terminal to execute: a step of repeating a process of acquiring a frame image that has been captured and a process of storing a character recognition result in a storage, the character recognition result being obtained by performing character recognition of the frame image and being a character string that is determined to be written in accordance with a naming rule, thereby storing a plurality of character recognition results of a plurality of frame images in the storage; and when a predetermined operation to the information terminal to end capturing of the frame image is received, a step of finalizing, as a final character recognition result, (i) in a case where the character recognition result of the frame image that is last captured is obtained, the character recognition result of the frame image that is last captured among the plurality of frame images, and (ii) in a case where the character recognition result of the frame image that is last captured is not obtained, the character recognition result of the frame image that is captured earlier than the frame image that is last captured.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation application of International Application No. PCT/JP2023/030468 filed on Aug. 24, 2023 and designated the U.S., which is based upon and claims priority to Japanese Patent Application No. 2022-140707, filed on Sep. 5, 2022, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD The present disclosure relates to an information terminal, a character recognition method, and a character recognition program. BACKGROUND ART There is a known technology that acquires equipment data of on-site equipment by image capturing, by using an information terminal, equipment nameplates attached to various on-site equipment such as air conditioning equipment and performing a character recognition process. According to this technology, for example, a maintenance worker can manage the equipment data of on-site equipment that has been inspected on site only by capturing images of the equipment nameplates. PRIOR ART DOCUMENTS Patent Documents Patent Document 1: Japanese Laid-Open Patent Publication No. 2020-091748 On the other hand, in the case of image capturing on site, depending on image capturing conditions, the character recognition process is not performed properly and misrecognition occurs, and the situation may occur that the correct equipment data cannot be acquired for part or all of the equipment data. In such a case, the maintenance worker has to redo the image capturing, and a workload for the maintenance worker is high. SUMMARY The present disclosure reduces a workload of an operator when acquiring equipment data of on-site equipment by image capturing. An aspect of the present disclosure is an information terminal including: a controller, whereinthe controller is configured to:repeat a process of acquiring a frame image that has been captured and a process of storing a character recognition result in a storage, the character recognition result being obtained by performing character recognition of the frame image and being a character string that is determined to be written in accordance with a naming rule; andwhen a predetermined operation to the information terminal to end capturing of the frame image is received and the character recognition result is not stored in the storage based on a frame image acquired when the predetermined operation is received, finalize the character recognition result to be the character string that is stored in the storage based on a frame image acquired prior to the frame image when the predetermined operation is received. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating an application example of an information terminal. FIG. 2 is a diagram illustrating an example of character recognition results obtained by performing a 10 character recognition process on each frame image. FIG. 3 is a diagram illustrating an example of a hardware configuration of an information terminal. FIG. 4 is a first diagram illustrating an example of a functional configuration of an information terminal. FIG. 5 is a diagram illustrating an operation example of the entire information terminal. FIG. 6 is a diagram illustrating a specific example of processing from a recognition unit to a extraction unit. FIG. 7 is a diagram illustrating a specific example of processing by a determination unit. FIG. 8 is a flowchart illustrating a process flow by a first storage control unit. FIG. 9 is a flowchart illustrating a process flow by a second storage control unit. FIG. 10A is a first diagram illustrating a display example of frame images and bounding boxes displayed by a display unit. FIG. 10B is a second diagram illustrating a display example of frame images and bounding boxes displayed by the display unit. FIG. 11 is a flowchart illustrating a flow of the character recognition process by the information terminal. FIG. 12 is a second diagram illustrating an example of a functional configuration of the information terminal. DESCRIPTION OF EMBODIMENTS Each embodiment will be described below with reference to the attached drawings. In the present specification and the drawings, components having substantially the same functional configuration will be denoted by the same reference numerals and thus duplicate descriptions will be omitted. First Embodiment <Application Example of Information Terminal> First, an application example of an information terminal according to a first embodiment will be described. FIG. 1 is a diagram illustrating an application example of the information terminal. As illustrated on the left side of FIG. 1, an information terminal 120 is used, for example, in a scenario in which equipment data is read from an equipment nameplate 111 attached to the side of the on-site equipment 110. According to the information terminal 120, for example, when a maintenance worker 130 conducts an on-site inspection and registers the inspection result in a server device (not illustrated), it is possib