CN-121999537-A - Needling technique identification method and system
Abstract
The invention provides a needling method identification method and system, the method comprises the steps of obtaining a target video stream of a needling area, wherein the target video stream comprises needling equipment for executing needling operation, needling equipment marks are arranged on the tops of the needling equipment, when a user executes needling operation in the needling area, motion information of the needling equipment marks in the target video stream is obtained, the motion information comprises a plurality of motion parameters, each motion parameter at least comprises an inserting parameter and a twisting parameter, the operation process of the needling operation is divided into at least one operation stage based on the motion information, the target motion parameters corresponding to each operation stage in the motion information are obtained, and the needling method corresponding to each operation stage is identified based on each target motion parameter. By applying the needling technique identification method provided by the invention, the automatic identification of the needling technique can be realized.
Inventors
- SUN MINGSHENG
- ZHAO LING
- LIANG FANRONG
- YANG QINGQING
Assignees
- 医纬度智能科技(成都)有限公司
Dates
- Publication Date
- 20260508
- Application Date
- 20260401
Claims (10)
- 1. A method of identifying a needling process, the method comprising: Acquiring a target video stream of a needling area, wherein the target video stream comprises a needling instrument for executing needling operation, and a needling instrument mark is arranged at the top of the needling instrument; When a user performs needling operation in the needling area, acquiring motion information of a needling instrument mark in the target video stream, wherein the motion information comprises a plurality of motion parameters, and each motion parameter at least comprises an inserting parameter and a twisting parameter; dividing the operation process of the needling operation into at least one operation phase based on the motion information; acquiring a target motion parameter corresponding to each operation stage in the motion information; And identifying the corresponding needling method of each operation stage based on each target motion parameter.
- 2. The method of claim 1, wherein the acquiring the target video stream of the needled region comprises: And if the first area of the needling instrument mark is detected in the needling area, triggering a video in the needling area acquired by a preset data acquisition device to acquire a target video stream related to needling operation in the needling area.
- 3. The method of claim 1, wherein the obtaining motion information for a needle identifier in the target video stream comprises: acquiring point location information of the needle mark in each image frame of the target video stream; Based on the point location information of each image frame, calculating the needling parameters including displacement, first frequency and first rhythm index of needling mark movement, wherein the twisting parameters include angle, second frequency, second rhythm index and direction of needling mark rotation.
- 4. A method according to claim 3, wherein said dividing the operation of the needling operation into at least one operation phase based on the movement information comprises: Determining a first variation of the interpolation parameter and a second variation of the twist parameter in each of the time periods; When the first variation of the lifting and inserting parameters in any time period accords with a preset lifting and inserting variation rule, determining that the time period belongs to a lifting and inserting operation stage, constructing a vertical coordinate system taking the surface of a receptor as a zero point and taking the vertical upward direction as a positive direction, determining a stage of increasing the variation of the displacement in the vertical coordinate system in the time period as a lifting needle operation stage, and determining a stage of decreasing the variation of the displacement in the vertical coordinate system in the time period as a contact needle operation stage; When the second variation of the twist parameter in any time period accords with a preset twist transition rule, determining that the time period belongs to a twist operation stage, determining a stage of characterizing the angle change curve in the time period as an angle increasing direction as a right-turn operation stage based on an angle change curve corresponding to the angle in the twist parameter, and determining a stage of characterizing the angle change curve in the time period as a decreasing direction as a left-turn operation stage.
- 5. The method of claim 4, wherein the target motion parameter corresponding to the lift-and-insert operation phase is a velocity calculated from a displacement in the lift-and-insert parameter in a time period corresponding to the lift-and-insert operation phase, and the target motion parameter corresponding to the twist operation phase is an angular velocity calculated from an angle in the twist parameter in a time period corresponding to the twist operation phase; The identifying a needling technique corresponding to each operation stage based on each target motion parameter comprises the following steps: Based on the speed of the lifting and inserting operation stage, calculating the speed characteristic of the lifting and inserting operation stage; Calculating an angular velocity characteristic of a twist operation stage based on an angular velocity of the twist operation stage; and identifying a needling technique at the twisting operation stage based on the angular velocity characteristics.
- 6. The method of claim 5, wherein said calculating a speed characteristic of the lift-and-insert operation stage, and identifying a needling technique of the lift-and-insert operation stage based on the speed characteristic comprises: Calculating a speed average value and speed energy of the needle mark in the lifting and inserting operation stage; Determining a first reinforcing and reducing discriminant function related to reinforcing and reducing methods based on the speed average value, the speed energy and a preset first weight coefficient; when the first reinforcing and reducing discriminant function is larger than a first discriminant threshold, determining that the needling technique in the lifting and inserting operation stage is a lifting and inserting method, wherein the lifting and inserting method characterizes that the force in the lifting and inserting operation stage is lighter than that in the inserting operation stage; And determining that the needling technique in the lifting and inserting operation stage is a lifting and inserting method when the first reinforcing and reducing discriminant function is smaller than the opposite number of the first discriminant threshold, wherein the lifting and inserting method characterizes that the force in the lifting and inserting operation stage is heavier than that in the inserting operation stage.
- 7. The method according to claim 5, wherein calculating the angular velocity characteristic of the twist operation stage, identifying a needling technique of the twist operation stage based on the angular velocity characteristic, comprises: calculating an angular velocity mean value, an angular velocity energy, and an angular acceleration jerk of the needle mark during the twisting operation phase; Determining a second reinforcing and reducing discriminant function related to reinforcing and reducing methods based on the angular velocity mean value, the angular velocity energy, the angular acceleration impact degree, a preset second weight coefficient and a preset third weight coefficient; When the second reinforcing and reducing discriminant function is larger than a second discriminant threshold, determining that the needling technique in the twisting operation stage is a twisting and reducing technique, wherein the twisting and reducing technique characterizes that right-turning operation is used as a main operation direction in the twisting operation stage; And when the second reinforcing and reducing discriminant function is smaller than the opposite number of the second discriminant threshold value, determining that the needling method in the twisting operation stage is a twisting complement method, wherein the twisting complement method characterizes that the left-hand operation is taken as the main operation direction in the twisting operation stage.
- 8. A method according to claim 3, characterized in that the method further comprises: When the operation stage is a lifting and inserting operation stage, acquiring pressure data output in the lifting and inserting operation stage based on a pressure value output by a preset pressure sensor, and acquiring a first displacement change value of the needle mark in the lifting and inserting stage based on a reference displacement value output by a preset displacement sensor; Calculating the displacement fusion amount of the lifting and inserting operation stage based on the first displacement variation value and the displacement in the target motion parameter of the lifting and inserting operation stage; And determining the needling technique of the lifting and inserting operation stage based on the displacement fusion amount and the pressure data.
- 9. The method according to claim 1, wherein the method further comprises: Identifying a hand area from the target video stream, and grabbing time sequence motion information of the hand corresponding to the operation process of the needling operation from the hand area; preprocessing the time sequence motion information to obtain a hand feature sequence, wherein the hand feature sequence comprises hand features of a plurality of time periods; Time-aligning the hand features of each of the time periods with the operational phase of each of the time periods; for any time period, identifying whether the hand characteristics of the time period are matched with the needling technique corresponding to the operation stage of the time period, and outputting a matching result.
- 10. A needling process identification system, said system comprising: The data acquisition equipment is used for acquiring videos of the needling area and sending video streams of the acquired videos to the processing module; the needle mark is arranged at the top of the needle; the processing module executes the needling technique identification method according to any one of the preceding claims 1-9 when the needle identifier is identified in the video stream transmitted by the video acquisition data.
Description
Needling technique identification method and system Technical Field The invention relates to the technical field of needling technique identification, in particular to a needling technique identification method and a needling technique identification system. Background The needling technique is one of the core contents in clinical treatment and teaching of acupuncture. In the traditional teaching mode, students mainly form skill level through teacher demonstration, dictation points, clinical band teaching and repeated practice. Because the needling action is fine, the speed change is fast, the rhythm requirement is strong, the reinforcing and reducing difference depends on comprehensive factors such as 'light and heavy urgency', 'left and right forcefulness', the individual standards of different teachers often deviate due to visual observation and subjective experience evaluation, and in the needling process, the specific manipulation of the user can not be identified due to the fact that the operation amplitude of the user on the needling tool is too small, so that the misidentification of the manipulation is caused. Disclosure of Invention In view of the above, the present invention provides a method and a system for identifying needling techniques, by which needling techniques during needling operations can be automatically identified. A method of identifying a needling technique, the method comprising: Acquiring a target video stream of a needling area, wherein the target video stream comprises a needling instrument for executing needling operation, and a needling instrument mark is arranged at the top of the needling instrument; When a user performs needling operation in the needling area, acquiring motion information of a needling instrument mark in the target video stream, wherein the motion information comprises a plurality of motion parameters, and each motion parameter at least comprises an inserting parameter and a twisting parameter; dividing the operation process of the needling operation into at least one operation phase based on the motion information; acquiring a target motion parameter corresponding to each operation stage in the motion information; And identifying the corresponding needling method of each operation stage based on each target motion parameter. In the above method, optionally, the obtaining the target video stream of the needling area includes: And if the first area of the needling instrument mark is detected in the needling area, triggering a video in the needling area acquired by a preset data acquisition device to acquire a target video stream related to needling operation in the needling area. In the above method, optionally, the obtaining the motion information of the needle identifier in the target video stream includes: acquiring point location information of the needle mark in each image frame of the target video stream; Based on point location information of each image frame, calculating lifting and inserting parameters and twisting parameters of the needle mark in a plurality of time periods corresponding to the operation process of the needling operation, wherein the lifting and inserting parameters comprise displacement, first frequency and first pitch index of needle mark movement, and the twisting parameters comprise angle, second frequency, second rhythm index and direction of needle mark rotation. The method, optionally, the dividing the operation procedure of the needling operation into at least one operation phase based on the motion information includes: Determining a first variation of the interpolation parameter and a second variation of the twist parameter in each of the time periods; When the first variation of the interpolation parameter of any time period exceeds a preset interpolation threshold, determining the time period as an interpolation operation stage, and acquiring a displacement variation curve of the interpolation operation stage based on the interpolation parameter; the method comprises the steps of constructing a vertical coordinate system taking the surface of a receptor as a zero point and taking the vertical direction upwards as a positive direction, determining a stage in which the change of the vertical direction of the displacement in the vertical coordinate system in the time period is increased as a needle lifting operation stage, and determining a stage in which the change of the vertical direction of the displacement in the vertical coordinate system in the time period is reduced as a contact pin operation stage; When the second variation of the twisting parameters in any time period exceeds a preset twisting threshold, determining the time period as a twisting operation stage, acquiring an angle variation curve of the twisting operation stage based on the twisting parameters, determining the twisting operation stage as a right-turning operation stage when the angle variation curve of the twisting operation stage is characteri