US-12619062-B2 - Integrated optical device and related diagnostic imaging method

US12619062B2US 12619062 B2US12619062 B2US 12619062B2US-12619062-B2

Abstract

An integrated optical device comprising an optical instrument for producing real images comprising in turn eyepieces, an optical body, a binocular body and a support arm, and an instrumentation for producing virtual images, wherein said instrumentation for producing virtual images comprises at least a display ( 1 ) for projecting said virtual images, a lens ( 2 ) for adjusting the focus, a plurality of prisms ( 3 ) for inserting, directing, and mixing said virtual images, and a plurality of mirrors ( 4 ) and first cameras ( 5 ) for directing and positioning said virtual images so as to superimpose said virtual images on said real images in the eyepieces of said optical instrument.

Inventors

Giulia DAL PONT
Franco DAL PONT

Dates

Publication Date: 20260505
Application Date: 20230630
Priority Date: 20220701

Claims (8)

1 . An integrated optical device, comprising: an optical instrument for producing real images and virtual images to a first operator, a computer or smartphone ( 32 ) for receiving and displaying concurrent real images and virtual images of the optical instrument to a second operator, wherein the computer or smartphone ( 32 ) operates remotely with respect to said first operator and receives real-time input for said first operator from said second operator, wherein said optical instrument for producing real images comprises, in turn, eyepieces, an optical body, a binocular body, a support arm and an instrumentation for producing virtual images, wherein said instrumentation for producing virtual images comprises at least a display ( 1 ) for projecting said virtual images, a lense ( 2 ) for adjusting the focus, a plurality of prisms ( 3 ) for inserting, directing, and mixing said virtual images and a plurality of mirrors ( 4 ) and first cameras ( 5 ) for directing and positioning said virtual images so as to superimpose said virtual images on said real images in the eyepieces of said optical instrument available to said first operator, said integrated optical device being characterized by comprising a pointer ( 31 ) that is visible in the eyepieces of said optical instrument available to said first operator and said pointer ( 32 ) is concurrently visible on a display of the computer or smartphone ( 32 ) and is controlled by said second operator through said computer or smartphone ( 32 ) so that said second operator is able to interact in real time with said virtual images that are superimposed to said real images.
2 . The integrated optical device according to claim 1 , characterized in comprising a plurality of beam splitters ( 10 ) for the projection, transmission and mixing of said virtual images and said real images, each of said beam splitters ( 10 ) comprising two prisms ( 3 ) with a triangular base positioned in contact, so as to separate a beam of light into a transmitted beam and a reflected beam, control electronics and a plurality of mirrors ( 4 ) for the formation of optical paths.
3 . The integrated optical device according to claim 2 , characterized in that said beam splitters ( 10 ) are positioned in a multi-level structure wherein: in a first zone of the first level are positioned first beam splitters ( 10 ) and first mirrors ( 4 ) to intercept virtual images from the main optical paths and share them with said first cameras ( 5 ) and a third camera for sharing a monitor; in a second zone of the first level are placed said first beam splitters ( 10 ) and second mirrors ( 4 ) for sending to said eyepieces the virtual images coming from said displays ( 1 ) mixed with the real images of the main optical channels; in a second level, a second beam splitter ( 10 ) is positioned to intercept the image of the pupil of the right eye of the first operator coming from said eyepieces and convey it to a fourth camera capable of detecting its movement.
4 . The integrated optical device according to claim 1 , characterized in comprising a dual aperture to allow depth of field and dimming or brightness enhancement of said real images.
5 . The integrated optical device according to claim 1 , characterised in comprising a foot pedal or a cursor or other instrument operable by said first operator, so as to allow said first operator to interact with said integrated optical device without distracting the view of said first operator from an operating field.
6 . The integrated optical device according to claim 1 , characterized in comprising a laser galvanometer device, which projects a laser beam, said laser beam being deflected toward said operating field by means of an optical system consisting of two mirrors ( 4 ), angled to each other, of said set of mirrors ( 4 ), said prisms ( 3 ) and specific optical filters, which prevent deflections of the laser beam toward said eyepieces of said first operator.
7 . The integrated optical device according to claim 6 , characterized in that said laser beam is guided to point and draw and to perform surgical applications, via an internal software application, such as Microscope Desktop®, and via a remote software application, such as Microscope Connect®.
8 . The integrated optical device according to claim 1 , characterized in comprising two blue filters antepose to said first cameras ( 5 ).

Description

RELATED APPLICATIONS This application is a United States National Stage Application filed under 35 U.S.C § 371 of PCT Patent Application Serial No. PCT/IT2023/050158, filed Jun. 30, 2023, which claims priority to Italian Patent Application No. 102022000014020, filed Jul. 1, 2022, the disclosure of all of which are hereby incorporated by reference in their entirety. The present invention concerns an integrated optical device and a related method for creating augmented reality. The invention is in the technical field of machinery and technology present in hospital and non-hospital operating rooms, particularly in the technical field of operating microscopes. Electronic and digital technologies have become an integral part of many areas and sectors, whether industrial or mechanical or health care and/or typical of every individual's daily life. The importance of the interconnection of electronic tools and software, already recognized in the industrial world, represents the so called medicine 4.0 that is the transposition of industry 4.0 to the medical field. The use of these digital technologies comprises 3D printers and the robotics, so as to achieve fast exchanges of information, not only between doctor and patient, but also between doctors from different departments and hospitals with the main goal of increasingly improving the patient-centred medicine. In particular, considerable importance is being gained by the technological sector related to virtual reality, which, starting with video games, is being incorporated into a multitude of different applications. The surgical world in recent decades has increasingly converted to the use of visual systems that allow a magnification and improvement of the view of the surgical field so as to have a better view of anatomical structures where the type of surgery requires it. This development allows a reduction in iatrogenic damage, postoperative complications, and health care costs. New technologies to aid surgery include the possibility of using virtual reality and augmented reality as additional visual aids for better surgery through, for example, the use of virtual helmets or visors. The possibility of integrating images from the computer with images from the operating field is opening a new research frontier for surgery. Imaging has also undergone a profound transformation by completing the conversion from analog to digital and from two-dimensional to three-dimensional. New technologies have complemented to traditional optical instruments to implement and improve, for example, radiological images, increasing them with information useful for the planning of surgery and the needs of different cases. Specifically, in the field of maxillofacial surgery, the state of the art essentially comprises two different technologies. More in detail, these technologies comprise Head-Mounted Systems (HMS) and Camera-Display Based Systems. The second technology aims to achieve a better association of virtual images with real images, since the cameras, unlike HMS, are not on the head of the surgeon but are placed elsewhere in the operating room. However, this better association comes at the cost of increasing virtual reality, as the cameras no longer have the same point of view as the surgeon but, for example, the point of view of the operating lamp. Another disadvantage is that the surgeon will see the augmented reality content projected on a screen and not looking directly at the patient. A more recent technology, which is an evolution of HMS, is Video and Optical See Through Augmented Reality Surgical Systems (VOSTARS). Such technology has improved features compared with HMS but has some critical issues due to system stability and image projection. The system, in this case, is integrated into a viewer worn by the surgeon and is therefore mobile according to the movements of the surgeon, which, for long or demanding operations, may be frequent and shaky due to fatigue or other factors. As for image projection, HMS and VOSTARS project onto a screen also worn by the surgeon and not directly onto the viewer or the lenses themselves creating additional discomfort and inconvenience to the surgeon. Relevant prior art also comprises the patent applications WO2021/090335A1, US2015/46472A1, EP3561795A1 and WO2016/130424A1. Therefore, is the aim of the present invention to provide an integrated optical device and a related method, which are capable of solving the above-mentioned inconveniences and criticalities. Specifically, is the aim of the present invention to provide an integrated optical device and a related method capable of combining the advantages of using a microscope with those typical of augmented reality. Another aim of the present invention is to provide an integrated optical device and a related method that are capable of introducing a new and greater level of virtual reality into the operating microscope. Another aim of the present invention is to provide an integrated op