JP-2026514267-A - Technology for automatically tracking surgical procedures

Abstract

A particular embodiment provides a method for performing an ophthalmic surgical procedure. The method includes collecting and preparing preoperative and intraoperative data related to a patient's eye for further processing. In a particular embodiment, the method further includes integrating the preoperative and intraoperative data to generate context-dependent data for further processing. The method also includes classifying and annotating the preoperative data, intraoperative data, and context-dependent data. The method also includes extracting one or more actionable inferences from the preoperative data, intraoperative data, context-dependent data, and the classified and annotated data. The method further includes triggering one or more actions on an imaging system or surgical system based on one or more actionable inferences. [Selection Diagram] Figure 2

Inventors

• アショク バートン トリパシ
• ルー イン
• ラメシュ サランガパニ

Assignees

• アルコン インコーポレイティド

Dates

Publication Date

20260508

Application Date

20231026

Priority Date

20221027

Claims (16)

1. An ophthalmic surgical system for automatically tracking surgical procedures performed on anatomical objects of patients, Memory containing executable instructions, A processor configured to execute the aforementioned executable instructions, the processor To acquire imaging data of the anatomical objects of the patient captured during the period, Based on the imaging data, a unique identifier is automatically generated corresponding to at least one surgical procedure performed on the anatomical object during the period. To automatically provide the user interface with the visual representation associated with the at least one surgical procedure and the generated unique identifier, Upon receiving confirmation from the user to verify the aforementioned unique identifier, the unique identifier is automatically transmitted to the second device for automated processing. An ophthalmic surgery system configured to automatically overwrite the unique identifier upon receiving user input that is inconsistent with or rejected by the unique identifier, and to transmit a second unique identifier provided by the user via the user interface to the second device for automated processing.
2. The aforementioned ophthalmic surgical system, During the aforementioned period, the imaging data of the anatomical object of the patient is to be captured, The ophthalmic surgery system according to claim 1, further comprising a digital camera configured to output the imaging data to at least one processor.
3. The aforementioned at least one processor, The ophthalmic surgical system according to claim 1, further configured to cause the ophthalmic surgical system to automatically identify one or more surgical instruments used on the anatomical object in the imaging data, and at least one of one or more surgical products used on the anatomical object in the imaging data.
4. The ophthalmic surgical system according to claim 3, wherein the at least one processor is further configured to cause the ophthalmic surgical system to automatically identify the at least one surgical procedure performed on the anatomical object based on the one or more surgical instruments identified in the imaging data and at least one of the one or more surgical products identified in the imaging data.
5. In order to automatically identify the at least one surgical procedure performed on the anatomical object, the at least one processor, To generate a confidence score for the at least one surgical procedure performed on the anatomical object in the imaging data, based on the one or more surgical instruments or the one or more surgical products identified in the imaging data, wherein the confidence score indicates a level of confidence that the identification of the at least one surgical procedure is correct. The ophthalmic surgical system according to claim 4, configured to automatically identify the at least one surgical procedure performed on the anatomical object based on the confidence score.
6. The ophthalmic surgical system according to claim 5, further configured to cause the ophthalmic surgical system to automatically identify the at least one surgical procedure based on the fact that the confidence score is equal to or greater than a confidence threshold for at least a threshold time period.
7. The aforementioned at least one processor, In the aforementioned imaging data, the target surgical site of the anatomical object in which one or more surgical instruments or one or more surgical products are used is automatically identified. The ophthalmic surgery system according to claim 4, further configured to cause the ophthalmic surgery system to automatically identify the at least one surgical procedure performed on the anatomical object based on the target surgical site of the anatomical object identified in the imaging data.
8. The ophthalmic surgery system according to claim 4, wherein the at least one processor is configured to cause the ophthalmic surgery system to automatically identify the at least one surgical procedure based on a machine learning (ML) model trained to identify the surgical procedure performed in the imaging data.
9. The ophthalmic surgical system according to claim 1, wherein the at least one processor is configured to cause the ophthalmic surgical system to automatically generate the unique identifier corresponding to the at least one surgical procedure based on a machine learning (ML) model trained to generate a unique identifier for the surgical procedure performed in the imaging data.
10. The aforementioned at least one processor, The acquisition of a training dataset, wherein the training dataset associates past imaging data related to various surgical procedures with corresponding unique identifiers. The ophthalmic surgery system according to claim 9, configured to train the ML model based on the training dataset and to generate the unique identifier corresponding to the at least one surgical procedure based on the imaging data.
11. The imaging data includes a plurality of image frames captured during the period, The ophthalmic surgical system according to claim 1, wherein the at least one processor is further configured to cause the ophthalmic surgical system to select at least one representative image frame and a representative video clip that demonstrate the performance of the at least one surgical procedure.
12. The ophthalmic surgery system according to claim 11, wherein the at least one processor is configured to select at least one of the representative image frame and the representative video clip based on a confidence score being equal to or greater than a confidence threshold, and the confidence score indicates a level of confidence that the at least one surgical procedure is demonstrated in the selected representative image frame or representative video clip.
13. The ophthalmic surgical system according to claim 11, wherein the at least one processor is further configured to cause the ophthalmic surgical system to automatically transmit to the second device at least one of the representative image frames and representative video clips demonstrating the execution of the at least one surgical procedure.
14. In order to automatically transmit the unique identifier, as well as at least one of the representative image frame and the representative video clip, to the second device, the at least one processor is further configured to cause the ophthalmic surgery system to generate a patient record. The ophthalmic surgery system according to claim 13, wherein the patient record includes a display of the at least one surgical procedure, the unique identifier corresponding to the at least one surgical procedure, and at least one of the representative image frame and the representative video clip demonstrating the performance of the at least one surgical procedure.
15. The ophthalmic surgery system according to claim 14, wherein at least one processor is further configured to cause the device to include a timestamp indicating when the representative image frame or representative video clip was captured in the patient record.
16. The visual representation provided on the user interface further includes the selected representative image frame or representative video clip, In order to automatically transmit the representative image frame or representative video clip to the second device, at least one processor, Upon receiving confirmation from the user to verify the unique identifier, the system automatically transmits the representative image frame or representative video clip to the second device for automated processing. The apparatus according to claim 13, further configured to automatically overwrite the representative image frame or representative video clip upon receiving user input that contradicts or rejects the representative image frame or representative video clip, and to transmit a second representative image frame or representative video clip provided by the user via the user interface to the second apparatus for automatic processing.

Description

This invention relates to a technique for automatically tracking surgical procedures. Various eye-related diseases or symptoms can be treated by ophthalmic surgical procedures. Examples of ophthalmic surgical procedures include vitreoretinal surgery, cataract surgery, glaucoma surgery, and laser ophthalmic surgery (LASIK). Vitreoretinal surgery is a type of ophthalmic surgery that treats problems with the retina or vitreous humor. Vitreoretinal surgery can be performed to treat conditions such as diabetic tractional retinal detachment, diabetic vitreous hemorrhage, macular hole, retinal detachment, epiretinal membrane, and many other ophthalmic conditions. Cataract surgery involves emulsifying the patient's lens with an ultrasonic handpiece and aspirating it from the eye. An intraocular lens (IOL) is then implanted into the lens capsule of the eye. During the above-mentioned vitreoretinal, cataract, and other types of surgery, as known to those skilled in the art, various malfunctions can negatively affect the surgical outcome, efficiency and effectiveness, as well as the ease with which the surgeon can perform the operation. Furthermore, in certain cases, these can cause harm to the patient's optical and anatomical structures, etc. Examples of digital recognition systems (hereinafter referred to as "digital recognition systems") comprising digital recognition technology, according to several embodiments, are shown below.This describes exemplary operation for use by ophthalmic surgical systems, such as digital recognition systems, according to a specific embodiment.This shows multiple image frames of imaging data representing various surgical procedures performed on a patient's eye according to a specific embodiment.This shows multiple image frames of imaging data representing various surgical procedures performed on a patient's eye according to a specific embodiment.An exemplary computing device according to a specific embodiment is shown. For the purpose of facilitating understanding, the same reference numerals are used wherever possible to indicate identical elements common to the drawings. Elements and features of a particular embodiment are intended to be advantageously incorporated into other embodiments without further mention. While the features of the present invention may be discussed below with reference to specific embodiments and drawings, all embodiments of the present invention may include one or more of the advantageous features discussed herein. In other words, one or more embodiments may be discussed as having specific advantageous features, and one or more such features may be used according to various other embodiments discussed herein. Similarly, exemplary embodiments may be discussed below as apparatus, apparatus, or methods, and such exemplary embodiments should be understood as being implementable in various apparatus, apparatus, and methods. Digital Recognition Surgical System Specific embodiments of this specification describe a digital recognition surgical system configured, among other things, to automatically track one or more surgical procedures performed on a patient, including identifying one or more surgical procedures, capturing imaging data (e.g., photographic and/or video data) of one or more surgical procedures, generating one or more unique identifiers associated with one or more surgical procedures, transmitting information including photographic evidence and one or more unique identifiers to an EMR database, and/or other operations as described in more detail below. The digital recognition surgical system described herein has at least four key technical capabilities, including (1) the ability to analyze data in real time; (2) the ability to process multi-model data (i.e., data generated and/or received simultaneously in different formats such as surgical video, numerical data, audio data, text, images, and signals); (3) the ability to process data received simultaneously from a single source or multiple sources (e.g., images captured by a camera, internal sensor data, and audio recordings from a microphone); and (4) the ability to perform inferences using the received and processed data relating to the state or stage of a surgical procedure, the instrumentation of surgical instruments, the state of the patient or the patient's eyes, and the control of surgical instruments. Digital recognition technologies as described herein can provide smart functions for surgical systems. Smart functions for ophthalmic surgical systems can take multiple forms in the operating room (OR), including image-guided operation, patient monitoring, virtual assistants for surgeons, and/or service automation. Incorporating the smart functions described in the embodiments herein results in numerous improvements to existing surgical systems. The improved surgical systems described herein can help surgeons perform surgical tasks with greater precision, efficiency, and/or safety, ultimately leadi