CN-121985091-A - Method and device for remote teaching and quality control of ultrasonic examination based on audio and video

Abstract

The application provides a method and a device for remote teaching and quality control of ultrasonic examination based on audio and video, wherein the method comprises the steps that an audio and video room server acquires real-time ultrasonic video stream acquired by a consulting room end and doctor camera video stream; the audio-video room server side generates a multi-consulting room real-time monitoring view in a palace lattice layout mode according to the real-time ultrasonic video stream and the doctor camera video stream, when the expert side initiates a guiding request or the consulting room side initiates a help request, the audio-video room server side creates an exclusive audio-video room and accesses a requesting party and a receiving party to the exclusive audio-video room, and the audio-video room server side bidirectionally transmits the audio-video streams of the requesting party and the receiving party through the exclusive audio-video room. An expert can patrol a plurality of consulting rooms in real time through the palace lattice layout view, timely find out the problem of non-standard operation and guide the intervention in real time, realize the process quality control of ultrasonic inspection, and fundamentally improve inspection standardization.

Inventors

• TANG PING
• LI YINGXIN
• Hu Hengwen

Assignees

• 蓝网科技股份有限公司

Dates

Publication Date

20260505

Application Date

20260209

Claims (10)

1. 1. The method is characterized by relating to an expert terminal, a consulting room terminal and an audio-video room server terminal, wherein the expert terminal is used for connecting an expert for remote guidance, the consulting room terminal is used for collecting local video streams, the audio-video room server terminal is used for creating, maintaining and destroying an audio-video room, and the audio-video room is used for subscribing, publishing and forwarding multiparty video streams, and the method comprises the following steps: The audio and video room server acquires real-time ultrasonic video streams acquired by the consulting room end and a doctor camera video stream; the audio and video room server generates a multi-room real-time monitoring view in a grid layout mode according to the real-time ultrasonic video stream and the doctor camera video stream; when the expert terminal initiates a guiding request or the consulting room terminal initiates a help request, the audio-video room server creates an exclusive audio-video room and accesses a requesting party and a receiving party into the exclusive audio-video room; And the audio and video room server side bidirectionally transmits the audio and video streams of the requesting party and the receiving party through the exclusive audio and video room, synchronously records audio and video data, interaction time stamps and operation logs, and generates teaching and quality control records.
2. 2. The method according to claim 1, wherein the step of the av room server obtaining the real-time ultrasound video stream and the physician camera video stream collected by the office server includes: The audio and video room server side receives the real-time ultrasonic video stream and the doctor camera video stream which are acquired and encoded by the consulting room side through a streaming media transmission protocol, wherein the real-time ultrasonic video stream is output by local ultrasonic equipment acquired by the consulting room side, and the doctor camera video stream is output by the local camera equipment acquired by the consulting room side; the audio and video room server decodes the received coded video stream and performs store and forward preprocessing on the decoded video stream.
3. 3. The method of claim 1, wherein the step of generating the multi-room real-time monitoring view by the audio-video room server according to the real-time ultrasound video stream and the physician camera video stream in a grid layout form comprises: When the audio and video room server detects that the expert terminal enters a monitoring page, automatically inquiring all online consulting room information of the audio and video room server which is successfully pushed to the audio and video room server, integrating the consulting room information, generating an online consulting room list according to the consulting room information, and synchronously acquiring a target video stream which is currently checked by the online consulting room terminal; the audio and video room server performs picture adaptation processing on the target video stream, so that a single consulting room can only display one path of target video stream; And the audio and video room server integrates the target video streams in a grid layout mode, pushes the target video streams to the expert, and renders and displays the target video streams in real time through the expert to form a multi-consulting room real-time monitoring view.
4. 4. The method according to claim 1, wherein when the expert initiates a guidance request or a consulting room initiates a help request, the audio-video room server creates a dedicated audio-video room and accesses a requester and a receiver to the dedicated audio-video room, comprising: the audio-video room server receives a guidance request initiated after the expert selects a target consulting room from a multi-consulting room real-time monitoring view, wherein the guidance request comprises an expert identifier, a target consulting room identifier and a guidance requirement description; the audio and video room server creates a dedicated audio and video room according to the instruction request and generates unique room identification information; The audio and video room server side respectively sends the room identification information to the expert side and the target consulting room side, and pushes a guiding call notification containing the room identification information, the expert side identification and the guiding requirement specification to the target consulting room side; And the audio and video room server receives the access request sent by the expert terminal and the target office terminal according to the room identification information, verifies the identification information of the two parties, and accesses the two parties to the exclusive audio and video room after the verification is passed.
5. 5. The method according to claim 1, wherein when the expert initiates a guidance request or a consulting room initiates a help request, the audio-video room server creates a dedicated audio-video room and accesses a requester and a receiver to the dedicated audio-video room, comprising: The audio and video room server receives a help request initiated after the consulting room terminal selects a target expert terminal corresponding to an online expert, wherein the help request comprises a consulting room terminal identifier, a target expert terminal identifier, case basic information and help problem description; the audio/video room server creates a dedicated audio/video room according to the help request and generates unique room identification information; The audio and video room server side respectively sends the room identification information to the consulting room side and the target expert side, and meanwhile pushes help calling notification containing the room identification information, the consulting room side identification, the case basic information and help problem description to the target expert side; and the audio and video room server receives an access request sent by the target expert after receiving the call and an access request sent by the consulting room, verifies the identification information of the two parties, and accesses the two parties to the exclusive audio and video room after the verification is passed.
6. 6. The method of claim 1, wherein the audio-video room server bi-directionally transmits the audio-video streams of the requesting party and the receiving party through the dedicated audio-video room, synchronously records audio-video data, an interaction time stamp and an operation log, and generates teaching and quality control records, comprising: The audio-video room server establishes a low-delay bidirectional communication channel for the requester and the receiver in the exclusive audio-video room; the audio and video room server receives the audio and video stream issued by the requester in real time, decodes, reduces noise and optimizes the synchronization of the audio and video stream, and forwards the decoded audio and video stream to the receiver; The audio and video room server synchronously receives the audio and video stream issued by the receiver, decodes, reduces noise and synchronously optimizes the audio and video stream, and forwards the decoded audio and video stream to the requester; And the audio and video room server synchronously records the audio and video data, the interaction time stamp and the operation log in the room, and generates teaching and quality control records.
7. 7. The method of claim 6, wherein the step of providing the first layer comprises, the audio and video room server side synchronously records audio and video data, interaction time stamps and operation logs in a room, and generates teaching and quality control records, and the method comprises the following steps: the audio and video room server integrates the recorded audio and video data, the interaction time stamp and the operation log in a correlation manner, and encapsulates the integrated audio and video data, the interaction time stamp and the operation log into a standardized teaching and quality control record file according to a preset format; The audio and video room server stores the teaching and quality control record file and supports retrieval and calling according to keywords such as office identification, expert identification, time range, case information and the like.
8. 8. The device for remote teaching and quality control of audio-video-based ultrasonic inspection is characterized in that the device for remote teaching and quality control of audio-video-based ultrasonic inspection is used for realizing the steps of the method for remote teaching and quality control of audio-video-based ultrasonic inspection according to any one of claims 1 to 7, and relates to an expert terminal, a consulting room terminal and an audio-video room service terminal, wherein the expert terminal is used for connecting an expert for remote guidance, the consulting room terminal is used for collecting local video streams, the audio-video room service terminal is used for creating, maintaining and destroying audio-video rooms, and the audio-video rooms are used for subscribing, publishing and forwarding multiparty video streams, and the device comprises: the acquisition module is used for acquiring real-time ultrasonic video streams acquired by the office end and doctor camera video streams by the audio-video room server end; the monitoring view module is used for generating a multi-consulting room real-time monitoring view by the audio and video room server according to the real-time ultrasonic video stream and the doctor camera video stream in a grid layout mode; The special audio/video room module is used for creating a special audio/video room by the audio/video room server and connecting a requesting party and a receiving party into the special audio/video room when the expert terminal initiates a guiding request or a help request by the consulting room terminal; And the bidirectional transmission module is used for the audio and video room server side to bidirectionally transmit the audio and video streams of the requesting party and the receiving party through the exclusive audio and video room, synchronously record audio and video data, interaction time stamps and operation logs, and generate teaching and quality control records.
9. 9. An audio-video based remote teaching and quality control extraction device for ultrasonic inspection, comprising a processor, a memory and a computer program stored on the memory and capable of running on the processor, which when executed by the processor, implements the method for remote teaching and quality control for ultrasonic inspection based on audio-video according to any one of claims 1 to 7.
10. 10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the method for remote teaching and quality control of audio-video based ultrasound inspection according to any one of claims 1 to 7 is implemented.

Description

Method and device for remote teaching and quality control of ultrasonic examination based on audio and video Technical Field The invention relates to the technical field of telemedicine and audio-video communication, in particular to an ultrasonic inspection remote teaching and quality control method and device based on audio-video. Background With the continuous development of medical technology, ultrasonic examination has become one of the essential core means in clinical disease diagnosis by virtue of the advantages of noninvasive, real-time and convenient use, and is widely applied to multiple diagnosis and treatment scenes such as internal medicine, surgery, obstetrics and gynecology, cardiovascular department and the like. The diagnosis accuracy of ultrasonic examination is highly dependent on the skill level of operating doctors, the accurate grasp of standard section and the accumulation of clinical experience, but the doctor level of different-level medical institutions has obvious differences, primary hospitals and young doctors often face capability bottlenecks in complex case treatment, standard operation execution and the like, and the guidance and assistance of high-quality expert resources are urgently needed. Under the traditional mode, the expert needs to visit the consulting room to observe the operation method and the image acquisition flow of doctors, and the real-time working state of a plurality of consulting rooms is difficult to cover simultaneously, so that the problems of nonstandard operation, unqualified section acquisition and the like cannot be corrected in time, and the quality consistency and the medical safety of ultrasonic examination are fundamentally influenced. Meanwhile, high-quality ultrasonic expert resources are highly concentrated in large hospitals, and primary hospitals and community medical institutions are difficult to conveniently acquire expert support, so that the medical service level gap between areas is further enlarged. In the field of medical teaching and talent training, the traditional ultrasonic teaching mode is limited by physical space and time arrangement, and tissue students need to concentrate to on-site observation expert operation, so that the teaching range is narrow, the coverage efficiency is low, and the large-scale and normalized training requirements cannot be met. In addition, when the primary doctor and the young doctor encounter the difficult cases and need to ask for help, the existing consultation system often has complex flow or is only limited to asynchronous transmission images, and the expert cannot remotely and instantly intervene and perform visual communication cooperation operation, so that the problem solving period is long and the communication cost is high. Disclosure of Invention In view of the foregoing, the present application has been developed to provide a method and apparatus for audio-video based ultrasound inspection remote teaching and quality control that overcomes the foregoing or at least partially solves the foregoing problems, including: An audio-video-based ultrasonic examination remote teaching and quality control method relates to an expert terminal, a consulting room terminal and an audio-video room server terminal, wherein the expert terminal is used for connecting an expert for remote guidance, the consulting room terminal is used for collecting local video streams, the audio-video room server terminal is used for creating, maintaining and destroying an audio-video room, and the audio-video room is used for subscribing, publishing and forwarding multiparty video streams, and the method comprises the following steps: The audio and video room server acquires real-time ultrasonic video streams acquired by the consulting room end and a doctor camera video stream; the audio and video room server generates a multi-room real-time monitoring view in a grid layout mode according to the real-time ultrasonic video stream and the doctor camera video stream; when the expert terminal initiates a guiding request or the consulting room terminal initiates a help request, the audio-video room server creates an exclusive audio-video room and accesses a requesting party and a receiving party into the exclusive audio-video room; And the audio and video room server side bidirectionally transmits the audio and video streams of the requesting party and the receiving party through the exclusive audio and video room, synchronously records audio and video data, interaction time stamps and operation logs, and generates teaching and quality control records. Further, the step that the audio-video room server acquires the real-time ultrasonic video stream and the doctor camera video stream acquired by the consulting room end includes: The audio and video room server side receives the real-time ultrasonic video stream and the doctor camera video stream which are acquired and encoded by the consulting room side through a streaming medi