Search

JP-7856443-B2 - Information processing device, information processing method, and information processing program

JP7856443B2JP 7856443 B2JP7856443 B2JP 7856443B2JP-7856443-B2

Inventors

  • 中村 佳児
  • 桝本 潤

Assignees

  • 富士フイルム株式会社

Dates

Publication Date
20260511
Application Date
20220203

Claims (9)

  1. Equipped with at least one processor, The aforementioned processor, Obtain a document describing the subject, Extract document findings information that shows the findings of the subject contained in the aforementioned document, Among multiple types of finding extraction processes for extracting image finding information showing multiple different types of findings that may be included in the first image obtained by photographing the subject, a finding extraction process for extracting image finding information showing the findings indicated by the document finding information from the first image is specified . The first image is obtained, By performing the multiple types of finding extraction processes on the first image, the image finding information indicating at least one type of finding contained in the first image is extracted. The results of extracting document findings information and the results of extracting image findings information for the same area of interest are associated with each other. The findings included in both the extracted document findings information and the extracted image findings information, and the findings included in either one, are presented in a way that allows for identification. Information processing device.
  2. Equipped with at least one processor, The aforementioned processor, Obtain a document describing the subject, Extract document findings information that shows the findings of the subject contained in the aforementioned document, Among multiple types of finding extraction processes for extracting image finding information showing multiple different types of findings that may be included in the first image obtained by photographing the subject, a finding extraction process for extracting image finding information showing the findings indicated by the document finding information from the first image is specified . The first image is obtained, By performing the multiple types of finding extraction processes on the first image, the image finding information indicating at least one type of finding contained in the first image is extracted. The results of extracting the document findings information are associated with the results of extracting the image findings information obtained by performing the same type of findings extraction process on the first image as the findings extraction process identified for the document findings information. The findings included in both the extracted document findings information and the extracted image findings information, and the findings included in either one, are presented in a way that allows for identification. Information processing device.
  3. The aforementioned processor, For findings included in the document findings information extraction results but not included in the image findings information extraction results, the possibility of omissions due to the findings extraction process will be presented. The information processing apparatus according to claim 1 or claim 2 .
  4. The aforementioned document describes a second image obtained by photographing the subject at a time prior to the time the first image was taken. The aforementioned processor, For findings included in the extraction results of the aforementioned document findings information, and also included in the extraction results of the aforementioned image findings information, a presentation will be made indicating that follow-up is being conducted. An information processing apparatus according to any one of claims 1 to 3 .
  5. The aforementioned document describes a second image obtained by photographing the subject at a time prior to the time the first image was taken. The aforementioned processor, For findings that are not included in the extraction results of the aforementioned document findings information, but are included in the extraction results of the aforementioned image findings information, a presentation will be made indicating that they are new. An information processing apparatus according to any one of claims 1 to 4 .
  6. The information processing apparatus according to any one of claims 1 to 5 , wherein the document is a document describing a second image obtained by photographing the subject at a time prior to the time the first image was taken.
  7. The first image mentioned above is a medical image, The aforementioned document findings information and the aforementioned image findings information are information indicating at least one of the name, characteristics, measured values, location, and estimated disease name related to the region of interest included in the medical image. The information processing apparatus according to any one of claims 1 to 6 , wherein the region of interest is at least one of the region of a structure included in the medical image and the region of an abnormal shadow included in the medical image.
  8. Obtain a document describing the subject, Extract document findings information that shows the findings of the subject contained in the aforementioned document, Among multiple types of finding extraction processes for extracting image finding information showing multiple different types of findings that may be included in the first image obtained by photographing the subject, a finding extraction process for extracting image finding information showing the findings indicated by the document finding information from the first image is specified . The first image is obtained, By performing the multiple types of finding extraction processes on the first image, the image finding information indicating at least one type of finding contained in the first image is extracted. The results of extracting document findings information and the results of extracting image findings information for the same area of interest are associated with each other. The findings included in both the extracted document findings information and the extracted image findings information, and the findings included in either one, are presented in a way that allows for identification. An information processing method in which a computer performs the processing.
  9. Obtain a document describing the subject, Extract document findings information that shows the findings of the subject contained in the aforementioned document, Among multiple types of finding extraction processes for extracting image finding information showing multiple different types of findings that may be included in the first image obtained by photographing the subject, a finding extraction process for extracting image finding information showing the findings indicated by the document finding information from the first image is specified . The first image is obtained, By performing the multiple types of finding extraction processes on the first image, the image finding information indicating at least one type of finding contained in the first image is extracted. The results of extracting document findings information and the results of extracting image findings information for the same area of interest are associated with each other. The findings included in both the extracted document findings information and the extracted image findings information, and the findings included in either one, are presented in a way that allows for identification. An information processing program that causes a computer to perform a task.

Description

This disclosure relates to an information processing device, an information processing method, and an information processing program. Traditionally, medical diagnosis has been performed using medical images obtained from imaging devices such as CT (Computed Tomography) and MRI (Magnetic Resonance Imaging) scanners. Furthermore, medical images are analyzed using CAD (Computer-Aided Detection/Diagnosis) with classifiers trained using deep learning, etc., to detect and/or diagnose regions of interest, including structures and lesions, contained within the medical images. The medical images and the CAD analysis results are transmitted to the terminals of medical professionals, such as radiologists, who interpret the medical images. These medical professionals use their terminals to refer to the medical images and analysis results, interpret the images, and create interpretation reports. In other words, the results of CAD analysis are included in the radiology report only after being reviewed by a radiologist. For example, Patent Document 1 discloses a technology that supports physicians in reviewing radiology findings by comparing CAD findings obtained from analyzing a subject's test data with the physician's interpretation of that data. Japanese Patent Publication No. 2013-041428 This figure shows an example of the schematic configuration of an information processing system.This figure shows an example of a medical image.This figure shows an example of a medical image.This is a block diagram showing an example of the hardware configuration of an information processing device.This is a block diagram showing an example of the functional configuration of an information processing device.This figure shows an example of a medical imaging report.This figure shows an example of document findings information.This figure shows an example of the findings extraction process.This figure shows an example of a screen displayed on a display.This is a flowchart illustrating an example of the first information processing step.This figure shows an example of image findings information.This figure shows an example of the results of matching document findings with image findings.This figure shows an example of a pattern based on document findings and image findings.This figure shows an example of a screen displayed on a display.This is a flowchart illustrating an example of the second type of information processing.This figure shows an example of a medical imaging report.This figure shows an example of document findings information.This figure shows an example of image findings information.This figure shows an example of the results of matching document findings with image findings. The embodiments of this disclosure will be described below with reference to the drawings. [First Embodiment] First, the configuration of the information processing system 1 to which the information processing device of this disclosure is applied will be described. Figure 1 is a diagram showing the schematic configuration of the information processing system 1. The information processing system 1 shown in Figure 1 performs imaging of the area to be examined of a subject and stores the medical images obtained by imaging, based on examination orders from physicians in clinical departments using a known ordering system. It also performs medical image interpretation work by radiologists and the creation of interpretation reports, and allows physicians in the requesting clinical departments to view the interpretation reports. As shown in Figure 1, the information processing system 1 includes an imaging device 2, an image interpretation terminal (Image Interpretation WS/Workstation) 3, a medical examination WS 4, an image server 5, an image database (DB) 6, a report server 7, and a report database 8. The imaging device 2, image interpretation WS 3, medical examination WS 4, image server 5, image database 6, report server 7, and report database 8 are connected to each other via a wired or wireless network 9, enabling communication between them. Each device is a computer on which an application program is installed to function as a component of the information processing system 1. The application program may be distributed on recording media such as DVDs (Digital Versatile Discs) and CD-ROMs (Compact Disc Read Only Memory), and installed on the computer from these recording media. Alternatively, it may be stored in a storage device or network storage on a server computer connected to network 9, accessible from the outside, and downloaded and installed on the computer upon request. The imaging device 2 is a modality that generates a medical image T representing the area to be diagnosed by imaging the area of the subject. Specifically, this includes plain X-ray imaging devices, CT scanners, MRI scanners, and PET (Positron Emission Tomography) scanners. The medical image generated by the imaging device 2 is transmitted to the image server 5 and stored in the ima