Search

US-20260129245-A1 - METHOD AND APPARATUS FOR RECONSTRUCTING 360-DEGREE IMAGE ACCORDING TO PROJECTION FORMAT

US20260129245A1US 20260129245 A1US20260129245 A1US 20260129245A1US-20260129245-A1

Abstract

Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Inventors

  • Ki Baek Kim

Assignees

  • B1 INSTITUTE OF IMAGE TECHNOLOGY, INC.

Dates

Publication Date
20260507
Application Date
20260105
Priority Date
20161004

Claims (6)

  1. 1 . A method of decoding an image, comprising: reconstructing the image based on encoding information; determining a size of a region in the reconstructed image based on the encoding information; and identifying the region based on the determined size, wherein the region is based on an object included in the reconstructed image.
  2. 2 . The method of claim 1 , wherein a size of the reconstructed image is smaller than a size of an image indicated by the encoding information.
  3. 3 . The method of claim 1 , wherein the encoding information related to the size is obtained from a supplemental enhancement information (SEI) message.
  4. 4 . The method of claim 1 , based on a value of flag included in the encoding information, the size is determined depending on information included in a previous SEI message.
  5. 5 . A method of encoding an image, comprising: reconstructing the image; identifying a region in the reconstructed image; determining a size of the identified region; and generating encoding information indicating the size of the identified region, wherein the region is identified based on an object included in the reconstructed image.
  6. 6 . A method of transmitting a bitstream, comprising: reconstructing the image; identifying a region in the reconstructed image; determining a size of the identified region; generating encoding information indicating the size of the identified region; generating the bitstream including the encoding information; and transmitting the bitstream, wherein the region is identified based on an object included in the reconstructed image.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. patent application Ser. No. 18/972,097 filed on Dec. 6, 2024, which is a continuation of U.S. patent application Ser. No. 18/672,265 filed on May 23, 2024, which is now U.S. Pat. No. 12,244,930, which is a continuation of U.S. patent application Ser. No. 18/466,442 filed on Sep. 13, 2023, which is now U.S. Pat. No. 12,167,138, which is a continuation of U.S. patent application Ser. No. 17/487,277 filed on Sep. 28, 2021, which is now U.S. Pat. No. 11,831,818, which is a continuation of U.S. patent application Ser. No. 16/372,237 filed on Apr. 1, 2019, now U.S. Pat. No. 11,165,958, which is a continuation of International Patent Application Number PCT/KR2017/011143, filed Oct. 10, 2017, which claims priority to Korean Patent Application Number 10-2016-0127878, filed Oct. 4, 2016; Korean Patent Application Number 10-2016-0129382, filed Oct. 6, 2016; and Korean Patent Application Number 10-2017-0090612, filed Jul. 17, 2017. All of these applications are incorporated by reference herein in their entireties. TECHNICAL FIELD The present invention relates to image data encoding and decoding technology, and more particularly, to a method and apparatus for encoding and decoding a 360-degree image for realistic media service. BACKGROUND With the spread of the Internet and mobile terminals and the development of information and communication technology, the use of multimedia data is increasing rapidly. Recently, demand for high-resolution images and high-quality images such as a high definition (HD) image and an ultra high definition (UHD) image is emerging in various fields, and demand for realistic media service such as virtual reality, augmented reality, and the like is increasing rapidly. In particular, since multi-view images captured with a plurality of cameras are processed for 360-degree images for virtual reality and augmented reality, the amount of data generated for the processing increases massively, but the performance of an image processing system for processing a large amount of data is insufficient. As described above, in an image encoding and decoding method and apparatus of the related art, there is a demand for improvement of performance in image processing, particularly, image encoding/decoding. SUMMARY It is an object of the present invention to provide a method for improving an image setting process in initial steps for encoding and decoding. More particularly, the present invention is directed to providing an encoding and decoding method and apparatus for improving an image setting process in consideration of the characteristics of a 360-degree image. According to an aspect of the present invention, there is provided a method of decoding a 360-degree image. Here, the method of decoding a 360-degree image may include receiving a bitstream including an encoded 360-degree image, generating a predicted image with reference to syntax information acquired from the received bitstream, acquiring a decoded image by combining the generated predicted image with a residual image acquired by inversely quantizing and inversely transforming the bitstream, and reconstructing the decoded image into the 360-degree image according to a projection format. Here, the syntax information may include projection format information for the 360-degree image. Here, the projection format information may be information indicating at least one of an Equi-Rectangular Projection (ERP) format in which the 360-degree image is projected into a 2D plane, a CubeMap Projection (CMP) format in which the 360-degree image is projected to a cube, an OctaHedron Projection (OHP) format in which the 360-degree image is projected to an octahedron, and an IcoSahedral Projection (ISP) format in which the 360-degree image is projected to a polyhedron. Here, the reconstructing may include acquiring arrangement information according to region-wise packing with reference to the syntax information and rearranging blocks of the decoded image according to the arrangement information. Here, the generating of the predicted image may include performing image expansion on a reference picture acquired by restoring the bitstream, and generating a predicted image with reference to the reference picture on which the image expansion is performed. Here, the performing of the image expansion may include performing image expansion on the basis of partitioning units of the reference picture. Here, the performing of the image expansion on the basis of the partitioning units may include generating an expanded region individually for each partitioning unit by using the reference pixel of the partitioning unit. Here, the expanded region may be generated using a boundary pixel of a partitioning unit spatially adjacent to a partitioning unit to be expanded or using a boundary pixel of a partitioning unit having image continuity with a partitioning unit to be expanded. Here, the performing