Search

EP-4343695-B1 - INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING PROGRAM

EP4343695B1EP 4343695 B1EP4343695 B1EP 4343695B1EP-4343695-B1

Inventors

  • HATSUTANI, Taro
  • ICHINOSE, Akimichi

Dates

Publication Date
20260506
Application Date
20230912

Claims (11)

  1. An information processing apparatus (10) comprising at least one processor (21), wherein the processor (21) is configured to: acquire (s10) a medical image (T,T10); display (s14), on a display, a figure indicating a first region of interest (A1) included in the medical image (T,T10) in a superimposed manner on the medical image (T,T10); receive (s16) a correction instruction for at least a part of the figure; and specify (s18) a second region of interest (A2) that at least partially overlaps with the first region of interest (A1) based on an image feature of the medical image (T,T10) and the correction instruction; characterised in that the processor (21) is configured to specify the second region of interest (A2) by using a first learning model (40) trained in advance to receive the medical image (T,T10), the first region of interest (A1), and the correction instruction as inputs and output the second region of interest (A2).
  2. The information processing apparatus (10) according to claim 1, wherein the processor (21) is configured to display, on the display (s20), a figure indicating the second region of interest (A2) in a superimposed manner on the medical image (T,T10).
  3. The information processing apparatus (10) according to claim 1, wherein the processor (21) is configured to receive (s16), as the correction instruction, correction of at least one point of points forming the figure.
  4. The information processing apparatus (10) according to claim 3, wherein the processor (21) is configured to specify, as the second region of interest (A2), a region of interest in which at least one point forming the figure after correction is located within a predetermined range from an outer edge of the region of interest among the regions of interest included in the medical image (T,T10).
  5. The information processing apparatus (10) according to claim 1, wherein the processor (21) is configured to receive, as the correction instruction, an instruction in a language representing a change in a shape of the figure.
  6. The information processing apparatus (10) according to claim 1, wherein the processor (21) is configured to: generate a feature map of the medical image (T,T10) by using a second learning model (42) trained in advance to receive a medical image (T,T10) as an input and output a feature map of the input medical image (T,T10); and specify the second region of interest (A2) by using a third learning model (44) trained in advance to receive the feature map, the first region of interest (A1), and the correction instruction as inputs and output the second region of interest (A2).
  7. The information processing apparatus (10) according to claim 6, wherein the processor (21) is configured to specify the first region of interest (A1) based on the feature map.
  8. The information processing apparatus (10) according to claim 1, wherein the figure is at least one of a bounding box (B1, B2, BB), a mask, or a mesh.
  9. The information processing apparatus (10) according to claim 1, wherein: the first region of interest (A1) and the second region of interest (A2) are at least one of a region of a structure included in the medical image (T,T10) or a region of a lesion included in the medical image (T,T10).
  10. A computer implemented information processing method comprising: acquiring a medical image (T,T10); displaying, on a display, a figure indicating a first region of interest (A1) included in the medical image (T,T10) in a superimposed manner on the medical image (T,T10); receiving a correction instruction for at least a part of the figure; and specifying a second region of interest (A2) that at least partially overlaps with the first region of interest (A1) based on an image feature of the medical image (T,T10) and the correction instruction; characterised in that the second region of interest (A2) is specified by using a first learning model (40) trained in advance to receive the medical image (T,T10), the first region of interest (A1), and the correction instruction as inputs and output the second region of interest (A2).
  11. A computer-readable storage medium storing an information processing program for causing a computer to execute a process comprising: acquiring a medical image (T,T10); displaying, on a display, a figure indicating a first region of interest (A1) included in the medical image (T,T10) in a superimposed manner on the medical image (T,T10); receiving a correction instruction for at least a part of the figure; and specifying a second region of interest (A2) that at least partially overlaps with the first region of interest (A1) based on an image feature of the medical image (T,T10) and the correction instruction; characterised in that the second region of interest (A2) is specified by using a first learning model (40) trained in advance to receive the medical image (T,T10), the first region of interest (A1), and the correction instruction as inputs and output the second region of interest (A2).

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present disclosure relates to an information processing apparatus, a computer implemented information processing method, and a computer-readable storage medium. 2. Description of the Related Art In the related art, image diagnosis is performed using medical images obtained by imaging apparatuses such as computed tomography (CT) apparatuses and magnetic resonance imaging (MRI) apparatuses. In addition, medical images are analyzed via computer aided detection/diagnosis (CAD) using a discriminator in which learning is performed by deep learning or the like, and regions of interest including structures, lesions, and the like included in the medical images are detected and/or diagnosed. The medical images and analysis results via CAD are transmitted to a terminal of a healthcare professional such as a radiologist who interprets the medical images. The healthcare professional such as a radiologist interprets the medical image by referring to the medical image and analysis result using his or her own terminal and creates an interpretation report. In addition, various methods for supporting the interpretation of medical images have been proposed. For example, JP2019-153250A discloses a technique for creating an interpretation report based on a keyword input by a radiologist and an analysis result of a medical image. In the technique disclosed in JP2019-153250A, a sentence to be included in the interpretation report is created by using a recurrent neural network trained to generate a sentence from input characters. Further, for example, JP2000-308619A discloses a technique for, in a case of correcting the shape of a region of interest in a medical image, arranging multi-node line segments or point sequences at equal intervals and dragging one of them to follow and move other adjacent multi-node line segments or point sequences in accordance with a predetermined tension. US 2020/118274 Al discloses a medical image processing device, an endoscope system, a diagnosis support device, and a medical service support device that can provide appropriate diagnosis support information from a region of interest by appropriately extracting the region of interest. An image acquisition unit acquires a medical image obtained from the image pickup of an object to be observed. A region-of-interest extraction section extracts a first region of interest as a region of interest from the medical image. A region-of-interest change section performs correction processing for correcting the first region of interest to a second region of interest. A user interface receives an instruction given to the region-of-interest change section. The correction processing includes the enlargement, the reduction, or the position change of the first region of interest. SUMMARY OF THE INVENTION In the related art, in a case where a region of interest is detected from a medical image via CAD, there is a case that the region of interest may not be detected correctly due to inclusion of an extra peripheral range or omission of detection of a peripheral portion. In the case of using the detected region of interest (for example, in the case of highlighting the region of interest in the medical image, in the case of generating comments on findings regarding the region of interest, and the like), a user is required to manually correct the region of interest to the correct one. However, a technique that can reduce the time and effort in this case is desired. In the technique disclosed in JP2000-308619A, another point adjacent to the dragged point moves in accordance with a predetermined tension, and thus it may be difficult to perform correction accurately in accordance with a correct region of interest. The present disclosure provides an information processing apparatus, a computer implemented information processing method, and a computer-readable storage medium capable of supporting interpretation of images. According to a first aspect of the present disclosure, there is provided an information processing apparatus according to claim 1 of the appended claims. According to a second aspect of the present disclosure, in the above first aspect, the processor may be configured to display, on the display, a figure indicating the second region of interest in a superimposed manner on the image. According to a third aspect of the present disclosure, in the above first aspect or second aspect, the processor may be configured to receive, as the correction instruction, correction of at least one point of points forming the figure. According to a fourth aspect of the present disclosure, in the above third aspect, the processor may be configured to specify, as the second region of interest, a region of interest in which at least one point forming the figure after correction is located within a predetermined range from an outer edge of the region of interest among the regions of interest included in the image. According