Search

EP-4740906-A1 - SCAN IMAGE PROCESSING METHOD OF INTRAORAL SCANNER, DEVICE THEREFOR, AND RECORDING MEDIUM ON WHICH INSTRUCTIONS THEREOF ARE RECORDED

EP4740906A1EP 4740906 A1EP4740906 A1EP 4740906A1EP-4740906-A1

Abstract

A method of the present disclosure includes: arranging a three-dimensional (3D) image of a target oral cavity in a 3D space; receiving an input for selecting a plurality of teeth of the target oral cavity; arranging first library teeth corresponding to the 3D image of the target oral cavity in the 3D space; moving a plurality of second library teeth in the 3D space such that the plurality of second library teeth corresponding to the plurality of teeth among the first library teeth are arranged in a space corresponding to the plurality of teeth among the 3D image of the target oral cavity; and displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other.

Inventors

  • KO, Seunghee

Assignees

  • Medit Corp.

Dates

Publication Date
20260513
Application Date
20240705

Claims (19)

  1. An image processing method performed by an electronic device, the method comprising: arranging a three-dimensional (3D) image of a target oral cavity in a 3D space; receiving an input for selecting a plurality of teeth of the target oral cavity; arranging first library teeth corresponding to the 3D image of the target oral cavity in the 3D space; moving a plurality of second library teeth in the 3D space such that the plurality of second library teeth corresponding to the plurality of teeth among the first library teeth are arranged in a space corresponding to the plurality of teeth among the 3D image of the target oral cavity; and displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other.
  2. The method of Claim 1, further comprising obtaining a plurality of margin lines corresponding to the plurality of teeth respectively, wherein the arranging the first library teeth in the 3D space comprises: based on the plurality of margin lines, arranging the first library teeth in the 3D space, and wherein each of the plurality of margin lines is a boundary at which an intact tooth begins to emerge from a gingival region of the 3D image of the target oral cavity.
  3. The method of Claim 2, wherein the obtaining the plurality of margin lines comprises: based on a boundary between a tooth region and a gingival region obtained as a result of segmentation, obtaining the plurality of margin lines; or based on a user input, obtaining the plurality of margin lines.
  4. The method of Claim 1, wherein the arranging the first library teeth in the 3D space comprises: identifying a tooth number corresponding to a tooth region obtained as a result of segmentation; and based on the tooth number, arranging the first library teeth in the 3D space.
  5. The method of Claim 1, further comprising generating the first library teeth.
  6. The method of Claim 5, wherein the generating the first library teeth comprises: based on mesh information of at least a portion of the first library teeth corresponding to a tooth region among the tooth region and a gingival region included in the 3D image of the target oral cavity, enlarging the first library teeth in a direction of the gingival region.
  7. The method of Claim 6, wherein the generating the first library teeth further comprises: based on the plurality of margin lines, processing the enlarged region in the enlarged first library teeth.
  8. The method of Claim 1, wherein the receiving the input for selecting the plurality of teeth of the target oral cavity comprises: receiving an input for selecting a tooth number for each of the plurality of teeth of the target oral cavity.
  9. The method of Claim 1, wherein the moving the plurality of second library teeth in the 3D space comprises: based on each of the plurality of margin lines, generating first position information including a center point of a first bounding box for each tooth of the plurality of second library teeth; generating second position information including a center point of a second bounding box for each tooth of the 3D image of the target oral cavity; and based on an origin positioned in a dental arch of the target oral cavity, generating a correlation between the first position information and the second position information for each of the plurality of second library teeth.
  10. The method of Claim 9, wherein the generating the correlation comprises: based on the origin, generating a tooth-specific transform matrix indicating a correlation between the first position information of each of the plurality of second library teeth and the second position information having the same tooth numbers as each of the plurality of the second library teeth.
  11. The method of Claim 10, wherein the displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other comprises, based on the tooth-specific transform matrix, displaying the plurality of second library teeth to overlap the 3D image of the target oral cavity having the same tooth numbers as the plurality of second library teeth, respectively, in the 3D space.
  12. The method of Claim 11, wherein the origin is a point between two central incisors in the dental arch.
  13. The method of Claim 1, wherein the displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other comprises, based on a tooth-specific transform matrix corresponding to a removed tooth, displaying a library tooth corresponding to the removed tooth to overlap the 3D image of the target oral cavity.
  14. The method of Claim 13, wherein the tooth-specific transform matrix corresponding to the removed tooth is generated based on second position information including a point in a dental arch that corresponds to the tooth number, and wherein the library tooth corresponding to the removed tooth comprises a dental prosthesis corresponding to the removed tooth.
  15. The method of Claim 1, wherein the displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other comprises, based on a tooth-specific transform matrix corresponding to a prep tooth, displaying a library tooth corresponding to the prep tooth to overlap the 3D image of the target oral cavity.
  16. The method of Claim 15, wherein the tooth-specific transform matrix corresponding to the prep tooth is generated based on second position information of which a center point of a second bounding box is changed based on a difference between a height of a highest point of the prep tooth and a height of a highest point of the library tooth corresponding to the prep tooth, and wherein the library tooth corresponding to the prep tooth comprises a dental prosthesis corresponding to the prep tooth.
  17. The method of Claim 1, wherein the displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other comprises, based on a determination that the plurality of second library teeth corresponding to the plurality of teeth is connected via a connector, displaying the connector between the plurality of second library teeth.
  18. An electronic device comprising: a processor; a network interface communicatively connected to an intraoral scanner; a display; a memory; and a computer program loaded into the memory and executed by the processor, wherein the computer program is configured to: arrange a three-dimensional (3D) image of a target oral cavity in a 3D space; receive an input for selecting a plurality of teeth of the target oral cavity; arrange first library teeth corresponding to the 3D image of the target oral cavity in the 3D space; move a plurality of second library teeth in the 3D space such that the plurality of second library teeth corresponding to the plurality of teeth among the first library teeth are arranged in a space corresponding to the plurality of teeth among the 3D image of the target oral cavity; and display the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other.
  19. A non-transitory computer-readable recording medium recording a computer program to be executed by a processor, the computer program comprising: an instruction for arranging a three-dimensional (3D) image of a target oral cavity in a 3D space; an instruction for receiving an input for selecting a plurality of teeth of the target oral cavity; an instruction for arranging first library teeth corresponding to the 3D image of the target oral cavity in the 3D space; an instruction for moving a plurality of second library teeth in the 3D space such that the plurality of second library teeth corresponding to the plurality of teeth among the first library teeth are arranged in a space corresponding to the plurality of teeth of the 3D image of the target oral cavity; and an instruction for displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other.

Description

TECHNICAL FIELD The present disclosure relates to a scan image processing method of an intraoral scanner, a device therefor, and a recording medium recording instructions thereof. BACKGROUND A three-dimensional (3D) image of an oral cavity refers to scan data obtained via a 3D scanner that scans teeth and an oral cavity, or an object obtained via modeling or reconstructing the same. This may be used for obtaining a 3D image of the oral cavity of a patient so as to design a dental prosthesis or implant or to manufacture an orthodontic appliance during a prosthetic treatment such as an inlay, onlay, crown, implant or the like as well as other dental treatments such as an orthodontic treatment or the like. Conventionally, a dental prosthesis, implant, or orthodontic appliance has been fabricated by hand after manually modeling an oral cavity using alginate or the like. Recently, a digital method that obtains 3D intraoral scan data of a patient using a 3D scanner, designs a dental prosthesis, implant, or orthodontic appliance using a computer, and 3D print the same has been widely used. DISCLOSURE TECHNICAL PROBLEM Various embodiments of the present disclosure provide a method of displaying a plurality of first library teeth selected by a user to overlap a three-dimensional (3D) image of an oral cavity. Various embodiments of the present disclosure provide a method of determining position information of a plurality of library teeth using segmentation and/or margin lines that separate a tooth region and a gingival region in a 3D image of an oral cavity, and arranging the library teeth. Various embodiments of the present disclosure provide a method of displaying a plurality of library teeth in a 3D image of an oral cavity so that a user may edit the plurality of library teeth without switching a screen. Various embodiments of the present disclosure provide a method of forming a customized library tooth using actual tooth data of a patient (3D image of oral cavity). The problems to be solved by the present disclosure are not limited to the above-described problems, and other problems that are not mentioned above will be clearly understood by those skilled in the art from the following description. TECHNICAL SOLUTION In one embodiment, an image processing method performed by an electronic device may include arranging a three-dimensional (3D) image of a target oral cavity in a 3D space; receiving an input for selecting a plurality of teeth of the target oral cavity; arranging first library teeth corresponding to the 3D image of the target oral cavity in the 3D space; moving a plurality of second library teeth in the 3D space such that the plurality of second library teeth corresponding to the plurality of teeth among the first library teeth are arranged in a space corresponding to the plurality of teeth among the 3D image of the target oral cavity; and displaying the 3D image of the target oral cavity and the plurality of second library teeth to overlap each other. In one embodiment, the method further includes obtaining a plurality of margin lines corresponding to the plurality of teeth, respectively, wherein the arranging the first library teeth in the 3D space includes, based on the plurality of margin lines, arranging the first library teeth in the 3D space, and wherein each of the plurality of margin lines is a boundary at which an intact tooth begins to emerge from a gingival region of the 3D image of the target oral cavity. In one embodiment, wherein the obtaining the plurality of margin lines includes, based on a boundary between a tooth region and a gingival region obtained as a result of segmentation, obtaining the plurality of margin lines; or based on a user input, obtaining the plurality of margin lines. In one embodiment, the arranging the first library teeth in the 3D space includes: identifying a tooth number corresponding to a tooth region obtained as a result of segmentation; and based on the tooth numbers, arranging the first library teeth in the 3D space. In one embodiment, the method further includes generating the first library teeth. In one embodiment, the generating the first library teeth includes: based on mesh information of at least a portion of the first library teeth corresponding to a tooth region among the tooth region and a gingival region included in the 3D image of the target oral cavity, enlarging the first library teeth in a direction of the gingival region. In one embodiment, the generating the first library teeth further includes, based on the plurality of margin lines, processing the enlarged region in the enlarged first library teeth. In one embodiment, the receiving the input for selecting the plurality of teeth of the target oral cavity includes receiving an input for selecting a tooth number for each of the plurality of teeth of the target oral cavity. In one embodiment, the moving the plurality of second library teeth in the 3D space includes: based on each of the plurali