US-20260126901-A1 - INTELLIGENT SURGICAL DISPLAY SYSTEM AND METHOD

US20260126901A1US 20260126901 A1US20260126901 A1US 20260126901A1US-20260126901-A1

Abstract

An integrated and intelligent surgical display system comprising: an image processing module couplable to at least one surgical camera and configured for receiving images from the at least one surgical video camera; a processor coupled to the image processor, the processor being couplable to a network; an audio subsystem coupled to the processor, the audio subsystem further comprising at least one microphone and at least one speaker; a visualization subsystem coupled to the processor, the visualization subsystem further comprising at least one camera; a display coupled to the image processing module and the processor; wherein the processor is configured to receive data from at least one of the audio subsystem and the visualization subsystem to authenticate a user; and wherein the display is configured to display images from the image processing module and on-screen information from the processor.

Inventors

Bruce Laurence Kennedy

Assignees

SoftAcuity, Inc.

Dates

Publication Date: 20260507
Application Date: 20251231

Claims (20)

1 . A display system comprising: an image processing module couplable to at least one camera and configured for receiving video from the at least one camera; a processor coupled to the image processing module, the processor being couplable to a network; an audio subsystem coupled to the processor, the audio subsystem further comprising at least one microphone and at least one speaker; a visualization subsystem coupled to the processor, the visualization subsystem further comprising at least one room camera; and a display coupled to the image processing module and the processor; wherein the image processing module is configured to provide a live video stream to the display without requiring processing by the processor.
2 . The display system of claim 1 wherein the system is configured to alter the size and position of displayed images from the image processing module and on-screen information depending on operation context or workflow state.
3 . The display system of claim 2 wherein the system is configured so that overlay content is only presented at the bottom of the display in a tray in an intra-operation state.
4 . The display system of claim 2 wherein the system is configured to scale the live feed so it remains unobstructed while reserving a side region for a virtual table or for apps.
5 . The display system of claim 1 wherein the image processing module further comprises at least one output providing a wireless video signal to a wearable device.
6 . The display system of claim 5 wherein the wearable device is at least one device from the group consisting of smart glasses and smart goggles.
7 . The display system of claim 1 wherein the audio subsystem comprises at least two microphones; and wherein the visualization subsystem comprises at least two room cameras.
8 . The display system of claim 7 wherein the visualization subsystem further comprises stereo room cameras or room cameras for forming a three-dimensional image.
9 . The display system of claim 7 wherein one of the at least two room cameras is a time of flight (TOF) camera.
10 . The display system of claim 1 wherein the processor further comprises at least one network interface from the group consisting of: a wired network interface, a wireless network interface and a cellular network interface.
11 . The display system of claim 10 wherein the processor is configured to encode video and communicate video through the at least one network interface.
12 . The display system of claim 10 wherein the processor is configured to receive video through the at least one network interface and communicate the received video to the image processing module for display.
13 . The display system of claim 10 wherein the processor is configured to communicate with a user database through the at least one network interface and obtain user specific settings for surgical devices or operating room parameters.
14 . The display system of claim 13 wherein the processor is configured to identify and track each of the people in an operating room.
15 . The display system of claim 13 wherein the processor is configured to automatically download authenticated user settings for at least one of: operating room music, operating room temperature, operating room lighting, and operating room humidity.
16 . The display system of claim 1 further comprising: a temperature sensor coupled to the processor; a humidity sensor coupled to the processor; and a smoke sensor coupled to the processor; and wherein the processor is configured to record images from the at least one camera, images from the visualization subsystem, audio from the audio subsystem and information from at least one of the temperature sensor, humidity sensor and smoke sensor.
17 . A display system comprising: an image processing module couplable to at least one camera and configured for receiving video from the at least one camera and modifying the received video for display; a processor coupled to the image processing module, the processor being couplable to a network and configured for running a plurality of apps and for providing on-screen information for display; an audio subsystem coupled to the processor, the audio subsystem further comprising at least two microphones and at least one speaker; a visualization subsystem coupled to the processor, the visualization subsystem further comprising at least two room cameras; and a touchscreen display coupled to the image processing module and the processor; and wherein the image processing module further comprises at least one output providing a wireless video signal to a wearable device.
18 . The display system of claim 17 wherein the wearable device is at least one device from the group consisting of smart glasses and smart goggles.
19 . The display system of claim 18 wherein the system is configured to display video received by the image processing module regardless of whether the processor is operational.
20 . The display system of claim 19 wherein the plurality of apps link to at least one of cloud services and local services.

Description

CROSS REFERENCE TO RELATED APPLICATION This application is a continuation of U.S. application Ser. No. 18/170,475 filed on Feb. 16, 2023, entitled INTELLIGENT SURGICAL DISPLAY SYSTEM AND METHOD which claims priority to U.S. Provisional Ser. No. 63/311,916 , filed on Feb. 18, 2022, entitled INTELLIGENT SURGICAL DISPLAY SYSTEM AND METHOD, the entire contents of which are hereby incorporated herein by reference. BACKGROUND The present disclosure relates to devices used in surgery and, more particularly, to interactive and intelligent surgical display devices. Technology has enhanced surgery but has also made it more complicated. Moreover, in order to maximize profits, surgeons are facing increasing pressures to be as efficient as possible and to obtain the best clinical outcomes in the shortest amount of time. Surgeons have to juggle between directing and coordinating support staff, collecting and synthesizing operating room information, and delivering patient care. Often a surgeon has several different touch control panels to deal with complex machines as well as control pedals on the floor. Commonly, surgeons have to use printed patient records and radiological data. There is therefore a need for a system and method that minimizes the distractions of directing and coordinating support staff and collecting and synthesizing operating room information so that a surgeon can better focus on patient care. Additionally, there is a need for a system and method that allows for secure authentication and tracking of operating room personnel. SUMMARY The present application is directed to an integrated, interactive, and intelligent surgical display system that remedies the shortcomings of the prior art. In an implementation, a surgical display system has: an image processing module couplable to at least one surgical camera and configured for receiving images from the at least one surgical video camera; a processor coupled to the image processor, the processor being couplable to a network. The display system also has an audio subsystem coupled to the processor, the audio subsystem further comprising at least one microphone and at least one speaker; a visualization subsystem coupled to the processor, the visualization subsystem further comprising at least one camera; and a display coupled to the image processing module and the processor. The processor is configured to receive data from at least one of the audio subsystem and the visualization subsystem to authenticate a user. The display is configured to display images from the image processing module and on-screen information from the processor. Optionally, the system is configured to alter the size and position of displayed images from the image processing module and the on-screen information depending on operation context or workflow state. The image processing module may have at least one input from the group consisting of: an HDMI interface, a DisplayPort interface, a Serial Digital Interface and video over IP network interface for receiving images from the at least one surgical camera. The image processing module may have at least one output from the group consisting of: an HDMI interface, a DisplayPort interface and a Serial Digital Interface for transmitting images to the display. The display may be a two dimensional display or a three dimensional display. The display may be a touchscreen. Optionally, the audio subsystem comprises at least two microphones; and the visualization system comprises at least two cameras. The visualization system may have stereo cameras or cameras for forming a three dimensional image. Additionally, one of the at least two cameras may be a time of flight (TOF) camera. The processor may have at least one network interface from the group consisting of: a wired network interface, a wireless network interface and a cellular network interface. Optionally, the processor is configured to encode video and communicate video through the at least one network interface. Optionally, the processor is configured to receive video through the at least one network interface and communicate the received video to the image processing module for display. In an implementation, the processor has a Bluetooth connection for coupling the intelligent surgical display system to at least one of input devices, display device, and portable computing devices. The processor may be configured to communicate with a user database through the at least one network interface and obtain user specific settings for surgical devices or operating room parameters. The processor may also be configured to identify and track each of the people in an operating room. The processor may also be configured to automatically download authenticated user settings for at least one of: operating room music, operating room temperature, operating room lighting, and operating room humidity. In an implementation, the system 10 also has a temperature sensor coupled to the processor; a humidity senso