Search

CN-121971014-A - System and display method applicable to endoscope based on AI glasses

CN121971014ACN 121971014 ACN121971014 ACN 121971014ACN-121971014-A

Abstract

The application provides a system and a display method applicable to an endoscope based on AI (advanced technology interface) glasses, and relates to the technical field of crossing of medical instruments and artificial intelligent wearable equipment. The system comprises an endoscope main body, a signal processing and transmitting module and an AI (advanced technology) glasses terminal, wherein the endoscope main body acquires real-time pictures of a target part, the signal processing and transmitting module wirelessly transmits the pictures after coding and processing, the AI glasses terminal receives, decodes and displays the pictures, and meanwhile, a built-in AI processing unit is used for realizing target identification and auxiliary prompt, so that the integration of visual operation and AI auxiliary diagnosis and treatment is achieved. The display method realizes high-efficiency and accurate endoscope operation through the steps of picture acquisition, coding transmission, decoding display, AI auxiliary identification and brightness self-adaptive adjustment. The application breaks through the defects of limited display equipment, unstable transmission and low AI fusion degree of the traditional endoscope, liberates the operation field of view of doctors, improves the diagnosis and treatment precision and efficiency, and is suitable for endoscope operation scenes such as operation rooms of hospitals, endoscope centers and the like.

Inventors

  • PENG JUN
  • LIU CUNDONG
  • CHEN KEQUAN
  • LU YUNDI

Assignees

  • 广东微医光电科技有限公司

Dates

Publication Date
20260505
Application Date
20260127

Claims (10)

  1. 1. A system for endoscope based AI glasses comprising: an endoscope body for inserting a target site and collecting a real-time picture of the site; the signal processing transmission module is connected with the endoscope main body in a data way and is used for receiving the real-time picture, performing coding compression and anti-interference processing and then transmitting the picture in a wireless communication way; And the AI glasses terminal is in wireless pairing communication with the signal processing transmission module and is used for receiving and decoding the encoded real-time picture, and the real-time picture is visualized and presented through the built-in display component, and the AI glasses terminal is internally provided with an AI processing unit for carrying out target structure identification, region marking and operation auxiliary prompt on the real-time picture so as to realize the integration of visualization of endoscope operation and AI auxiliary diagnosis and treatment.
  2. 2. The AI-based eyewear system of claim 1, wherein the endoscope body comprises a disposable soft lens end, a flexible conduit, and a hand-held operating handle, the soft lens end being fixedly connected to the hand-held operating handle by the flexible conduit; The soft lens end is internally provided with a high-definition camera, a light supplementing assembly and an angle adjusting assembly, wherein the high-definition camera is used for collecting real-time pictures, the light supplementing assembly is used for providing a shooting light source, and the angle adjusting assembly is used for adjusting shooting angles; The surface of the hand-held operating handle is provided with a control key, a data transmission line is arranged in the hand-held operating handle, the control key is electrically connected with the light supplementing component and the angle adjusting component and used for controlling the working state of the component, and the data transmission line is connected with the signal processing transmission module through an end interface.
  3. 3. The system for endoscope based on the AI glasses according to claim 2, wherein the soft lens end is made of medical grade disposable polymer material, a waterproof anti-fog coating is arranged on the surface of the soft lens end, the resolution of the high-definition camera is more than or equal to 1080P, the frame rate is more than or equal to 30fps, the light supplementing component is an LED light supplementing lamp, and the angle adjusting component can achieve deflection adjustment of +/-180 degrees.
  4. 4. The AI-glasses-based system for endoscopy of claim 1, wherein the signal processing transmission module is a freestanding transmission source box, built-in video encoding chip, dual-frequency wireless communication module, anti-interference processing unit and power supply assembly; the video coding chip is used for compressing the real-time picture into an H.265 coding format; The dual-frequency wireless communication module comprises a 2.4G/5GWiFi module and a Bluetooth 5.3 module, and can be switched alternatively or automatically to carry out wireless transmission; The anti-interference processing unit is used for filtering electromagnetic interference signals and ensuring that the transmission delay is less than or equal to 50ms; the power supply assembly is a rechargeable lithium battery, the battery capacity is more than or equal to 5000mAh, and the duration is more than or equal to 4 hours.
  5. 5. The system for endoscope-based AI glasses of claim 4 wherein said emitter box has a physical dimension of 10cm x 8cm x 3cm or less and is of lightweight portable design, said emitter box being removably connected to said handle end interface of said endoscope body by a Type-C connection line.
  6. 6. The AI-glasses-based system of claim 1, wherein the AI-glasses terminal comprises a micro-display optical module, an edge AI processor, a wireless receiving module, an environmental perception component, and an audio output component; The micro-display optical module is a holographic waveguide lens and is used for projecting the decoded real-time picture, the display resolution is more than or equal to 720P, and the viewing angle is more than or equal to 40 degrees; The computing power of the edge AI processor is more than or equal to 8TOPS, and the edge AI processor is used for running a preset target recognition model and carrying out semantic segmentation recognition on a real-time picture; The environment sensing component is an ambient light sensor and is used for detecting the intensity of ambient light; The audio output component is a bone conduction earphone and is used for outputting voice prompt information.
  7. 7. The system for endoscope based on AI glasses according to claim 6, wherein the preset target recognition model is a digestive tract structure semantic segmentation model, the tissue region for recognition comprises esophagus, stomach and duodenum, the mark of the tube placement target position and the dangerous region, the light intensity signal detected by the ambient light sensor is used for automatically adjusting the picture brightness of the holographic waveguide lens, the adjusting range is 100-1000cd/m2, and the voice prompt information comprises tube placement path deviation and dangerous region early warning.
  8. 8. The system for endoscope based on AI glasses according to claim 1, wherein the AI glasses terminal is further provided with a device linkage interface supporting to establish communication connection with an external display device, so as to realize synchronous sharing of real-time images, and the external display device is an operating room large screen or a medical monitor.
  9. 9. A display method based on AI glasses suitable for endoscope, characterized in that it is applied to the system based on AI glasses suitable for endoscope according to any one of claims 1-8, comprising the following steps: s1, assembling and debugging a system, connecting a handheld operation handle of an endoscope main body with a signal processing transmission module through a connecting wire, wirelessly pairing an AI (analog input) glasses terminal with the signal processing transmission module, and calibrating picture resolution and display parameters; S2, inserting a soft lens end of the endoscope main body into a target position, starting a high-definition camera and a light supplementing assembly through a control key, and collecting a real-time picture of the target position; s3, the handheld operation handle transmits the real-time picture to the signal processing transmission module, the real-time picture is compressed into an H.265 format through the video coding chip, electromagnetic interference is filtered through the anti-interference processing unit, and the real-time picture is transmitted by the double-frequency wireless communication module; S4, the AI glasses terminal receives the compressed picture through the wireless receiving module, and the picture is visually presented through the holographic waveguide lens after decoding; s5, the edge AI processor runs a preset target recognition model, performs semantic segmentation on the real-time picture, recognizes a target structure, marks a target position and a dangerous area, and outputs a corresponding voice prompt through the bone conduction earphone; And S6, detecting the ambient light intensity in real time by the ambient light sensor, and automatically adjusting the picture brightness of the holographic waveguide lens until the operation is finished.
  10. 10. The display method based on AI glasses suitable for endoscope of claim 9, wherein in step S3, the dual-frequency wireless communication module preferably adopts 5GWiFi modules for transmission, when the transmission delay is detected to be more than or equal to 50ms, the electromagnetic interference is judged to exceed a preset threshold value, and the Bluetooth 5.3 module is automatically switched to carry out low-power transmission, and at the moment, the picture resolution is adaptively adjusted to 480P.

Description

System and display method applicable to endoscope based on AI glasses Technical Field The invention relates to the technical field of crossing of medical instruments and artificial intelligence wearable equipment, in particular to a system and a display method applicable to an endoscope based on AI (advanced technology interface) glasses. Background In clinical medicine, endoscopes (such as disposable auxiliary gastrointestinal tract catheterization mirrors, bronchosoft mirrors and the like) are core devices for operations such as gastrointestinal tract disease diagnosis, catheterization treatment and the like, and the disposable characteristics of the endoscopes effectively solve the problems of high cross infection risk and high disinfection cost of the traditional reusable endoscopes. However, in practical application, the conventional disposable endoscope still has a plurality of defects to be solved in real-time image display and auxiliary diagnosis and treatment functions: The display device has strong limitation that the real-time picture of the traditional disposable endoscope depends on the large screen display or the handheld terminal of an operating room for display, a doctor needs to frequently lift the head to check the large screen or observe the handheld terminal at a low head in the operation process, so that the operation view is split, the body and picture information of a patient cannot be considered, the accuracy of the tube placement and the inspection cannot be directly influenced, meanwhile, the handheld terminal is easily influenced by operation shaking, the picture is fuzzy, and the operation reliability is further reduced. The wireless transmission performance is insufficient, part of the prior art tries to realize wireless transmission of pictures through Bluetooth or WiFi, but Bluetooth transmission has the problems of high delay and low resolution, and cannot meet the requirement of real-time diagnosis and treatment on picture synchronism, wiFi transmission is easily interfered by complex electromagnetic environment of an operating room, has poor signal stability, frequently causes picture blocking and interruption, and seriously affects the diagnosis and treatment flow. The AI technology has low fusion degree, the existing medical AI glasses are mainly applied to simple scenes such as medicine identification, physiological parameter monitoring and the like, are not fused with the disposable endoscope deeply, cannot perform functions such as intelligent identification of a target structure, path planning prompt and the like aiming at the internal picture of a human body acquired by the endoscope, still need to rely on clinical experience of doctors to operate, are not friendly to novice doctors, and are easy to cause operation risks due to human judgment errors. The equipment integrated design is unreasonable, the signal transmitting part of the existing disposable endoscope is integrated with the operation handle into a whole, so that the handle is large in size and heavy in weight, a doctor is easy to fatigue in long-time operation, the flexibility is reduced, and meanwhile, the communication protocol of the transmitting part and the display equipment lacks of unified standard, the suitability is poor, the signal transmitting part is difficult to be compatible with different brands and types of display equipment, and the clinical application range is limited. In summary, the existing disposable endoscope has obvious defects in the aspects of display mode, transmission stability, AI auxiliary function, equipment integration and the like, and a technical scheme capable of realizing light-weight wireless display, stable transmission and AI auxiliary diagnosis and treatment integration is needed to improve the convenience, accuracy and safety of endoscope operation. Disclosure of Invention The invention aims to overcome the defects of the prior art, and provides a system and a display method based on AI glasses suitable for an endoscope, which realize stable wireless transmission of high-definition pictures through an independent signal processing transmission module, combine the wearable characteristic and the edge computing capability of the AI glasses, realize the immersive display of real-time pictures of the endoscope and the auxiliary diagnosis and treatment integration of the AI, liberate the operation field of vision of doctors, reduce the operation difficulty and improve the diagnosis and treatment efficiency and safety. In order to achieve the above object, the present invention is realized by the following technical scheme: in a first aspect, the present invention provides a system for endoscope based AI glasses comprising: an endoscope body for inserting a target site and collecting a real-time picture of the site; the signal processing transmission module is connected with the endoscope main body in a data way and is used for receiving the real-time picture, performin