KR-20260064612-A - DEVICE FOR ENCODING GAUSSIAN SPLAT FOR 3D SPACE REPRESENTATION

Abstract

A GS encoding device for three-dimensional spatial representation according to the present disclosure may include: a GS information extraction unit that extracts attributes of GS (Gaussian Splatting) from an input image; a GS conversion unit that converts attributes classified into a first group among the attributes into a 2D image and converts attributes classified into a second group among the attributes into a point cloud; and an image encoding unit that encodes the 2D image and the point cloud.

Inventors

• 오관정
• 이광순
• 오재영
• 장의선

Assignees

• 한국전자통신연구원
• 한양대학교 산학협력단

Dates

Publication Date

20260507

Application Date

20251029

Priority Date

20241030

Claims (1)

1. A GS information extraction unit that extracts attributes of GS (Gaussian Splatting) from an input image; A GS conversion unit that converts attributes classified into a first group among the above attributes into a 2D image and converts attributes classified into a second group among the above attributes into a point cloud; and An apparatus for encoding a Gaussian splat for a three-dimensional spatial representation, comprising an image encoding unit that encodes the above 2D image and the above point cloud.

Description

Device for Encoding Gaussian Splat for 3D Space Representation The present disclosure relates to a method for encoding/decoding a Gaussian splat for a three-dimensional spatial representation and an apparatus for performing the same. 3D GS (Gaussian Splatting) is a technology that models the radiance field of a 3D space as a set of 3D Gaussians and renders the 3D space into a 2D image. In this case, a single GS consists of multiple attribute information, and the amount of data for a single GS is vast. Accordingly, various studies are currently underway to effectively compress this data. Figure 1 shows GS information obtained through a multi-view image and a virtual view rendered based thereon. Figure 2 is a diagram illustrating multiple attributes constituting GS. Figure 3 shows an example in which the attributes of multiple GS are represented as a 2D image. Figure 4 shows an example where the attributes of GS are encoded/decoded by different codecs. Figure 5 illustrates mapping information between a 2D coordinate system and a 3D coordinate system. FIG. 6 shows the configuration of a GS encoder and a GS decoder according to the present disclosure. The present disclosure is subject to various modifications and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present disclosure to specific embodiments, and it should be understood that it includes all modifications, equivalents, and substitutions that fall within the spirit and scope of the present disclosure. Similar reference numerals in the drawings refer to the same or similar functions across various aspects. The shapes and sizes of elements in the drawings may be exaggerated for clearer explanation. The detailed description of exemplary embodiments described below refers to the accompanying drawings, which illustrate specific embodiments as examples. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments. It should be understood that various embodiments are different but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the present disclosure in relation to one embodiment. It should also be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the embodiment. Accordingly, the following detailed description is not intended to be taken in a limiting sense, and the scope of exemplary embodiments is limited only by the appended claims, together with all equivalents to those claimed therein, provided they are properly described. In this disclosure, terms such as first, second, etc. may be used to describe various components, but said components should not be limited by said terms. Such terms are used solely for the purpose of distinguishing one component from another. For example, without departing from the scope of this disclosure, the first component may be named the second component, and similarly, the second component may be named the first component. The term "and/or" includes a combination of a plurality of related described items or any of a plurality of related described items. Where it is stated that any component of the present disclosure is "connected" or "connected" to another component, it should be understood that it may be directly connected or connected to that other component, or that there may be other components in between. On the other hand, where it is stated that a component is "directly connected" or "directly connected" to another component, it should be understood that there are no other components in between. The components shown in the embodiments of the present disclosure are depicted independently to represent different characteristic functions and do not imply that each component consists of separate hardware or a single software unit. That is, each component is listed and included as a separate component for convenience of explanation; however, at least two of the components may be combined to form a single component, or a single component may be divided into multiple components to perform a function, and such integrated and separated embodiments of each component are included within the scope of the rights of the present disclosure as long as they do not depart from the essence of the present disclosure. The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit this disclosure. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this disclosure, terms such as "comprising" or "having" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or