Search

EP-4220532-B1 - STRUCTURE REPAIR ASSISTANCE DEVICE, METHOD, AND PROGRAM

EP4220532B1EP 4220532 B1EP4220532 B1EP 4220532B1EP-4220532-B1

Inventors

  • OZEKI, MAKOTO

Dates

Publication Date
20260506
Application Date
20210921

Claims (12)

  1. A construction repair support apparatus (1) comprising a processor (10), the processor (10) being configured to perform an information acquisition process of acquiring construction information concerning a construction, a repair design information generation process of generating repair design information concerning a repair of damage in the construction on the basis of the construction information and damage information concerning the damage in the construction, a determination basis generation process of generating information that contributes to generation of the repair design information, as determination basis information for the repair design information, and a display process of causing a display device to display the repair design information and the determination basis information, wherein the processor (10) is configured to acquire positional information about the damage in the construction, and cause the display device to display the repair design information in association with the positional information, the construction information includes three-dimensional information that indicates the entire construction, the processor (10) is configured to cause the display device to display the construction three-dimensionally on the basis of the three-dimensional information, and cause the repair design information to be displayed at a corresponding position on the three-dimensionally displayed construction, on the basis of the positional information about the damage, the processor (10) is configured to perform a process of accepting switching between overall display and local display of the construction, and the processor (10) is configured to in response to accepting switching from the overall display to the local display and the positional information about the damage, switch display on the display device from the overall display of the construction based on the three-dimensional information to the local display that includes an image of a position indicated by the positional information about the damage, and cause the display device to display the determination basis information associated with the positional information about the damage, and in response to accepting switching from the local display to the overall display, switch display on the display device to the overall display, and cause the display device to display the repair design information in association with the positional information about the damage.
  2. The construction repair support apparatus (1) according to claim 1, further comprising a database (12) that stores the construction information and the damage information, wherein the processor (10) is configured to perform a damage information generation process of generating the damage information on the basis of a two-dimensional image of the construction included in the construction information, and store the damage information in the database (12) in association with the construction information, and in the information acquisition process, the construction information and the damage information associated with the construction information are acquired from the database (12).
  3. The construction repair support apparatus (1) according to claim 1, further comprising a database (12) that stores the construction information, wherein in the information acquisition process, the construction information is acquired from the database (12), and in the repair design information generation process, the damage information is generated on the basis of a two-dimensional image of the construction included in the construction information, the construction information being acquired in the information acquisition process, and the repair design information concerning a repair of the damage in the construction is generated on the basis of the construction information and the damage information.
  4. The construction repair support apparatus (1) according to any one of claims 1 to 3, wherein in response to acquiring a plurality of pieces of determination basis information including the determination basis information, the processor (10) is configured to calculate pieces of degree-of-contribution information that respectively indicate percentages of contribution of the plurality of pieces of determination basis information to generation of the repair design information, and cause the display device to display the pieces of degree-of-contribution information respectively corresponding to the plurality of pieces of determination basis information.
  5. The construction repair support apparatus (1) according to any one of claims 1 to 4, wherein the determination basis information includes region information about a region, on the construction, to which attention is to be paid.
  6. The construction repair support apparatus (1) according to any one of claims 1 to 5, wherein in the repair design information generation process, the repair design information is generated on the basis of pieces of damage information at a plurality of time points, and the determination basis information includes a degree of a change over time in the pieces of damage information between the plurality of time points.
  7. The construction repair support apparatus (1) according to any one of claims 1 to 6, wherein the processor (10) is configured to perform a process of accepting specifying of the repair design information by a user, and in response to accepting specifying of the repair design information, cause the display device to display the determination basis information corresponding to the repair design information, and/or the processor (10) is configured to perform a process of accepting specifying of the determination basis information by a user, and in response to accepting specifying of the determination basis information, cause the display device to display the repair design information corresponding to the determination basis information.
  8. The construction repair support apparatus (1) according to any one of claims 1 to 7, wherein the processor (10) includes a first learning model configured to perform the repair design information generation process, and the first learning model outputs the repair design information in response to input of the construction information or input of the construction information and the damage information.
  9. The construction repair support apparatus (1) according to claim 8, wherein in the determination basis generation process performed by the processor (10), a calculation process for an output result of the first learning model is traced back and the determination basis information that affects the output result is extracted, and for example, in the determination basis generation process performed by the processor (10), information visualizing a region to which attention is to be paid of the first learning model, is generated corresponding to information input to the first learning model, as the determination basis information, and preferably, in the determination basis generation process performed by the processor (10), a heat map is generated as the information visualizing a region to which attention, and more preferably, in the determination basis generation process performed by the processor (10), the heat map is generated using Grad-CAM, CAM or Attention.
  10. The construction repair support apparatus (1) according to claim 2, wherein the processor (10) includes a second learning model configured to perform the damage information generation process, and the second learning model outputs the damage information about the construction in response to input of a two-dimensional image of the construction.
  11. A construction repair support method for a processor to perform a step of acquiring construction information concerning a construction, a step of generating repair design information concerning a repair of damage in the construction on the basis of the construction information and damage information concerning the damage in the construction, a step of generating information that contributes to generation of the repair design information, as determination basis information for the repair design information, and a step of causing a display device to display the repair design information and the determination basis information, the method further comprising: acquiring positional information about the damage in the construction, and causing the display device to display the repair design information in association with the positional information, the construction information including three-dimensional information that indicates the entire construction; causing the display device to display the construction three-dimensionally on the basis of the three-dimensional information, and causing the repair design information to be displayed at a corresponding position on the three-dimensionally displayed construction, on the basis of the positional information about the damage; performing a process of accepting switching between overall display and local display of the construction; in response to accepting switching from the overall display to the local display and the positional information about the damage, switching display on the display device from the overall display of the construction based on the three-dimensional information to the local display that includes an image of a position indicated by the positional information about the damage, and causing the display device to display the determination basis information associated with the positional information about the damage; and in response to accepting switching from the local display to the overall display, switching display on the display device to the overall display, and causing the display device to display the repair design information in association with the positional information about the damage.
  12. A non-transitory computer-readable recording medium to which a program for causing a computer to execute the construction repair support method according to claim 11 is recorded.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a construction repair support apparatus, a construction repair support method, and a construction repair support program and specifically relates to a technique for presenting the determination basis for repair design information for a construction when the repair design information is automatically generated. 2. Description of the Related Art To address labor shortages and increased costs caused by obligated inspections of constructions including bridges and tunnels, ICT (Information and Communication Technology) are being increasingly used in maintenance of constructions. For example, automatic generation of repair design information by using artificial intelligence (AI) and by learning structural data, damage data, and repair data of constructions is being studied. When repair design information is automatically generated by using a computer, it is difficult to search for the determination basis for the repair design information, and the details of processing specifically in machine learning and AI are a black box, and therefore, the process of determination is unknown and the user is unable to understand and be convinced of the repair design information, which is a problem. In the related art, an inference apparatus that infers a class among predetermined classes to which an input image belongs, by inference using a neural network has been proposed (JP2019-82883A). The inference apparatus includes: an input unit; a frequently appearing feature value database in which frequently appearing feature values that frequently appear in an inference process in a neural network are classified into classes and stored; an inference unit that infers a class to which an input image belongs, by inference using the neural network; a representative feature value extraction unit that extracts feature values appearing in an inference process in the inference and extracts feature values, among the feature values, that satisfy a predetermined condition as representative feature values; a basis feature value extraction unit that extracts basis feature values on the basis of the frequently appearing feature values and the representative feature values; and an output unit that outputs the basis feature values together with the inferred class. The basis feature value extraction unit extracts the intersection of two sets, namely, the set of the frequently appearing feature values and the set of the representative feature values, as the basis feature values. JP 2020 085546 A discloses a system for supporting inspection and repair of a structure, that automatically extracts a region of interest as an inspection range appropriate for inspection, from images containing damaged parts photographed by an inspector, and then displays the region of interest. SUMMARY OF THE INVENTION For the inference apparatus described in JP2019-82883A, the frequently appearing feature value database in which frequently appearing feature values that frequently appear are classified into classes and stored needs to be prepared. Further, JP2019-82883A does not describe automatic generation of repair design information for a construction or indicate a new issue that, specifically when repair design information is automatically generated, the user is unable to understand and be convinced of the determination basis for the repair design information. In one embodiment of the technique of the present disclosure, there are provided a construction repair support apparatus, a construction repair support method, and a construction repair support program with which repair design information for a construction can be automatically generated and the determination basis for the repair design information can be presented to the user. The present invention is defined by independent claim 1 as appended. Further preferable embodiments are given in the dependent claims. According to claim 1, a construction repair support apparatus is provided which includes a processor, the processor being configured to perform an information acquisition process of acquiring construction information concerning a construction, a repair design information generation process of generating repair design information concerning a repair of damage in the construction on the basis of the construction information and damage information concerning the damage in the construction, a determination basis generation process of generating information that contributes to generation of the repair design information, as determination basis information for the repair design information, and a display process of causing a display device to display the repair design information and the determination basis information. In the construction repair support apparatus, when repair design information concerning a repair of damage in a construction is automatically generated, determination basis information that is information contri