Search

CN-122003871-A - System and method for compressing intraoral scan data

CN122003871ACN 122003871 ACN122003871 ACN 122003871ACN-122003871-A

Abstract

An intraoral scanning system (102) includes a handheld intraoral scanning device (104). A handheld intraoral scanning device (104) captures intraoral scan data (110) associated with a user. The intraoral scan data includes texture data (110A) and three-dimensional (3D) data (110B) captured during an intraoral scan process of a user. The handheld intraoral scanning device (104) generates compressed texture data (112A) associated with the texture data (110A) based on applying a first compression operation (502) to the texture data (110A). The handheld intraoral scanning device (104) generates compressed 3D data (112B) associated with the 3D data (110B) based on applying a second compression operation (602) to the 3D data (110B). The handheld intraoral scanning device (104) transmits a combination of compressed texture data (112A) and compressed 3D data (112B) as compressed intraoral scanning data (112) to one or more client devices (106).

Inventors

  • Henrik Ehrend
  • Isaac Mortelson
  • Frederick Yur
  • Soren Knudsby

Assignees

  • 3形状股份有限公司

Dates

Publication Date
20260508
Application Date
20241011
Priority Date
20231011

Claims (15)

  1. 1. An intraoral scanning system (102), comprising: a handheld intraoral scanning device (104), the handheld intraoral scanning device (104) configured to: Capturing intraoral scan data (110) associated with a user, the intraoral scan data (110) comprising texture data (110A) and three-dimensional (3D) data (110B) captured during an intraoral scan process of the user; generating compressed texture data (112A) associated with the texture data (110A) based on applying a first compression operation (502) to the texture data (110A); Generating compressed 3D data (112B) associated with the 3D data (110B) based on applying a second compression operation (602) to the 3D data (110B), wherein the second compression operation (602) is different from the first compression operation (502), and Transmitting the combination of the compressed texture data (112A) and the compressed 3D data (112B) as compressed intraoral scan data (112) to one or more client devices (106).
  2. 2. The intraoral scanning system (102) of claim 1, wherein the first compression operation (502) corresponds to a High Efficiency Video Coding (HEVC) operation.
  3. 3. The intraoral scanning system (102) of any preceding claim wherein the handheld intraoral scanning device (104) further comprises: a monitoring unit (208), the monitoring unit (208) being configured to determine bandwidth information associated with one or more wireless full duplex communication channels between the handheld intraoral scanning device (104) and the one or more client devices (106), And wherein the handheld intraoral scanning device (104) is further configured to: determining a quality factor for the first compression operation (502) based on the determined bandwidth information, and -Generating the compressed texture data (112A) based on applying the first compression operation (502) to the texture data (110A), wherein the texture data (110A) is compressed based on the determined quality factor.
  4. 4. The intraoral scanning system (102) of any preceding claim, wherein the 3D data (110B) associated with the intraoral scanning data (110) comprises depth data (808), amplitude data (810), and color data (812).
  5. 5. The intraoral scanning system (102) of any preceding claim, wherein to apply the second compression operation (602) to the 3D data (110B), the handheld intraoral scanning device (104) is configured to: Generating a first intermediate result (604A) based on applying a first color transformation matrix to the 3D data (110B), wherein the first color transformation matrix is applied to convert color components in the 3D data (110B) from a first color space to a second color space; Generating a second intermediate result (604B) based on modifying each pixel value of the generated first intermediate result (604A) by a predetermined value; generating a third intermediate result based on applying the first transformation operation to the generated second intermediate result (604C); determining one or more transform coefficients based on applying the first transform operation to the third intermediate result, wherein the one or more transform coefficients are associated with the first transform operation; Quantizing the determined one or more transform coefficients, and Generating first intermediate data (606A) based on applying a first encoding operation to the quantized one or more transform coefficients, wherein the compressed 3D data (112B) comprises the first intermediate data (606A).
  6. 6. The intraoral scanning system (102) of claim 5, wherein applying the first color transformation matrix is based on Principal Component Analysis (PCA) associated with the first color space.
  7. 7. The intraoral scanning system (102) of claim 5, wherein the first transform operation corresponds to a Discrete Cosine Transform (DCT) operation.
  8. 8. The intraoral scanning system (102) of claim 5, wherein the first encoding operation corresponds to an arithmetic encoding operation.
  9. 9. The intraoral scanning system (102) of any one of claims 5 to 8, wherein the handheld intraoral scanning device (104) is configured to: Generating a fourth intermediate result (604D) based on applying a second transformation operation to the third intermediate result; generating a fifth intermediate result (604E) based on applying a second color transformation matrix to the generated fourth intermediate result (604D) to convert color components in the generated fourth intermediate result (604D) from the second color space to the first color space; Calculating residual data based on the 3D data (110B) and the generated fifth intermediate result (604E), and Generating second intermediate data (606B) based on applying the first encoding operation to the calculated residual data, wherein the compressed 3D data (112B) comprises the second intermediate data (606B).
  10. 10. The intraoral scanning system (102) of claim 9, wherein the second transformation operation is an inverse of the first transformation operation.
  11. 11. The intraoral scanning system (102) according to any one of claims 9 to 10, wherein the second color transformation matrix is an inverse of the first color transformation matrix.
  12. 12. The intraoral scanning system (102) of any one of claims 9 to 11, wherein the handheld intraoral scanning device (104) is further configured to transmit the first intermediate data (606A) and the second intermediate data (606B) as the compressed 3D data (112B) to the one or more client devices (106).
  13. 13. The intraoral scanning system (102) of any preceding claim, wherein the one or more client devices (106) are at least one of a computer, a display screen, a tablet, or a smartphone.
  14. 14. A method for compressing intraoral scan data (110), comprising: Capturing intraoral scan data (110) associated with a user, the intraoral scan data (110) comprising texture data (110A) and three-dimensional (3D) data (110B) captured during an intraoral scan process of the user; generating compressed texture data (112A) associated with the texture data (110A) based on applying a first compression operation (502) to the texture data (110A); Generating compressed 3D data (112B) associated with the 3D data (110B) based on applying a second compression operation (602) to the 3D data (110B), wherein the second compression operation (602) is different from the first compression operation (502), and Transmitting the combination of the compressed texture data (112A) and the compressed 3D data (112B) as compressed intraoral scan data (112) to one or more client devices (106).
  15. 15. A computer-programmable product comprising a non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by processing circuitry, cause the processing circuitry to perform operations comprising: Capturing intraoral scan data (110) associated with a user, the intraoral scan data (110) comprising texture data and three-dimensional (3D) data (110B) captured during an intraoral scan process of the user; generating compressed texture data (112A) associated with the texture data (110A) based on applying a first compression operation (502) to the texture data (110A); Generating compressed 3D data (112B) associated with the 3D data (110B) based on applying a second compression operation (602) to the 3D data (110B), wherein the second compression operation (602) is different from the first compression operation (502), and Transmitting the combination of the compressed texture data (112A) and the compressed 3D data (112B) as compressed intraoral scan data (112) to one or more client devices (106).

Description

System and method for compressing intraoral scan data Technical Field Example embodiments of the present disclosure relate generally to compression of intra-oral images, and more particularly, to an intra-oral scanning system and a method for compressing intra-oral scanning data. Background Intra-oral scanning has become an indispensable tool in modern dentistry due to its various advantages. Intra-oral scanning provides a non-invasive and comfortable experience for the patient, provides immediate results, and allows accurate measurement and visualization. Typically, intraoral scanners are used for intraoral scanning by users (such as dentists in the dental industry). For example, an intraoral scan of a patient's dental arch captured by an intraoral scanner may be used to generate a digital impression of the patient's mouth. The intraoral scanner includes a light source projected onto the dental arch to capture intraoral scan data. Typically, intraoral scan data includes texture data and three-dimensional (3D) data. The intraoral scan data is further processed to generate 3D information (e.g., a 3D model) of the dental arch, and the 3D model may be displayed on a user device associated with the dentist for examination. Currently, intraoral scan data captured by an intraoral scanner is saved and transmitted to a user device as "raw data". However, such raw data consumes a large amount of storage capacity, and transmitting raw data from an intraoral scanner to a user device also uses a large amount of bandwidth. Disclosure of Invention An intraoral scanning system, a method and a computer programmable product are provided for compressing intraoral scan data. In one aspect, an intraoral scanning system is disclosed. The intraoral scanning system includes a handheld intraoral scanning device that may be configured to capture intraoral scanning data associated with a user. The intraoral scan data includes texture data and three-dimensional (3D) data captured during an intraoral scan process of a user. The handheld intraoral scanning device may also generate compressed texture data associated with the texture data based on applying a first compression operation to the texture data. The handheld intraoral scanning device may also generate compressed 3D data associated with the 3D data based on applying a second compression operation to the 3D data. The second compression operation may be different from the first compression operation. The handheld intraoral scanning device may also transmit a combination of the compressed texture data and the compressed 3D data as compressed intraoral scanning data to one or more client devices. In some embodiments, the first compression operation corresponds to a high-EFFICIENCY VIDEO CODING, HEVC operation. The HEVC compression operation may also be referred to as h.265 and may be a compression standard widely used to encode and decode image or video content. In another example, the first compression operation may be based on a joint photographic experts group (Joint Photographic Experts Group, JPEG) compression protocol. JPEG is a lossy compression but can be compensated by increasing the resolution of the captured texture data. In some embodiments, the handheld intraoral scanning device further comprises a monitoring unit configured to determine bandwidth information associated with one or more wireless full duplex communication channels between the handheld intraoral scanning device and the one or more client devices. The handheld intraoral scanning device may be further configured to determine a quality factor for the first compression operation based on the determined bandwidth information. The handheld intraoral scanning device may be further configured to generate the compressed texture data based on applying the first compression operation to the texture data. The texture data may be compressed based on the determined quality factor. The processor unit may be configured to determine a reliability score for the texture data based on the quality factor. The reliability score may also include the accuracy of the texture data and/or the amount of captured texture data for the region of the scanned object. In some embodiments, the 3D data associated with the intraoral scan data includes color data, amplitude data, and depth data. In some embodiments, to apply the second compression operation to the 3D data, the handheld intraoral scanning device may be configured to generate a first intermediate result based on applying a first color transformation matrix to the 3D data. The first color transformation matrix may be applied to convert color components in the 3D data from a first color space to a second color space. The handheld intraoral scanning device may be further configured to generate a second intermediate result based on modifying each pixel value of the generated first intermediate result by a predetermined value. The handheld intraoral scanning device may be further c