US-20260129179-A1 - SYSTEMS AND METHODS FOR VIDEO PROCESSING WITH PARTIAL PICTURE REPLACEMENT

US20260129179A1US 20260129179 A1US20260129179 A1US 20260129179A1US-20260129179-A1

Abstract

A method is provided for processing a video bitstream which includes a first picture and a sequence parameter set containing information indicating a mode is enabled in which a first area of a picture can be extracted and replaced by a second area of another picture. Using the mode, the first picture is modified by extracting the first area and replacing the extracted area with the second area from the other picture. The modified first picture is stored and a predictor is formed using the modified first picture as a reference picture. A block of a subsequent picture is decoded using the predictor.

Inventors

Hari Kalva
Borivoje Furht
Velibor Adzic

Assignees

OP SOLUTIONS LLC

Dates

Publication Date: 20260507
Application Date: 20251105

Claims (6)

1 . A video encoder configured to: receive a video signal; and generate an encoded bitstream comprising a first picture, a second picture, and a sequence parameter set containing information indicating a mode is enabled in which a first area of a picture can be extracted and replaced by a spatially same sized second area of another picture, the bistream being further configured by the encode to be decoded by a method comprising: use the mode, modify the first picture by extracting the first area of the first picture and replacing the extracted area with the spatially same sized second area of the second picture; store the modified first picture in a decoded picture buffer; form a predictor using the stored modified first picture as a reference picture; and decode a block of a subsequent picture using the predictor.
2 . The video encoder of claim 1 , wherein the first area and the second area are one coding tree unit.
3 . The video encoder of claim 2 , wherein the first area and the second area are rectangular.
4 . The video encoder of claim 1 , wherein the first area and the second area are rectangular.
5 . A video encoder configured to: receive a video signal; and generate a bitstream comprising signaling information and a first coded picture to be used as a long term reference picture and a second coded picture, the second coded picture comprising a first block and a second block, the signaling information including a sequence parameter set (SPS) indicating that a mode is enabled in which a portion of a reference picture can be modified, the bitstream being further configured to be decoded by a method comprising: decode and store the first picture as a long term reference picture; using the mode, modify a portion of the long term reference picture solely in response to information generated by the encoder and included in the bitstream; utilize the modified portion of the long term reference picture as a predictor for the first block of the second picture; decode the first block by adding residual pixels to the predictor; and decode the second block of the second picture using an inverse quantizer and inverse transformer.
6 . A decoder configured to: receive an encoded bitstream comprising signaling information and a first coded picture to be used as a long term reference picture and a second coded picture, the second coded picture comprising a first block and a second block, the signaling information including a sequence parameter set (SPS) indicating that a mode is enabled in which a portion of a reference picture can be modified; decode and store the first picture as a long term reference picture; using the mode, modify a portion of the long term reference picture in response to information included in the bitstream; utilize the modified portion of the long term reference picture as a predictor for the first block of the second picture; decode the first block by adding residual pixels to the predictor; and decode the second block of the second picture using an inverse quantizer and inverse transformer.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of U.S. patent application Ser. No. 18/128,673 filed on Mar. 30, 2023, and titled VIDEO PROCESSING METHOD WITH PARTIAL PICTURE REPLACEMENT, which application is a continuation of U.S. patent application Ser. No. 17/006,529 filed on Aug. 28, 2020, and entitled “ADAPTIVE BLOCK UPDATE OF UNAVAILABLE REFERENCE FRAMES USING EXPLICIT AND IMPLICIT SIGNALING,” which is a continuation of International Application No. PCT/US19/63694, filed on Nov. 27, 2019 and entitled “ADAPTIVE BLOCK UPDATE OF UNAVAILABLE REFERENCE FRAMES USING EXPLICIT AND IMPLICIT SIGNALING,” which claims the benefit of priority of U.S. Provisional Patent Application Ser. No. 62/772,066, filed on Nov. 27, 2018, and titled “ADAPTIVE BLOCK UPDATE OF LONG TERM REFERENCE FRAMES USING EXPLICIT SIGNALING” and U.S. Provisional Patent Application Ser. No. 62/771,941, filed on Nov. 27, 2018, and titled “ADAPTIVE BLOCK UPDATE OF LONG TERM REFERENCE FRAMES USING IMPLICIT SIGNALING,” each of which is hereby incorporated by reference herein in its entirety. FIELD OF THE DISCLOSURE The present disclosure generally relates to the field of video processing, including encoding and decoding. In particular, the disclosure is directed to video processing systems and methods with partial picture replacement. BACKGROUND A video codec can include an electronic circuit or software that compresses or decompresses digital video. It can convert uncompressed video to a compressed format or vice versa. In the context of video compression, a device that compresses video (and/or performs some function thereof) can typically be called an encoder, and a device that decompresses video (and/or performs some function thereof) can be called a decoder. A format of the compressed data can conform to a standard video compression specification. The compression can be lossy in that the compressed video lacks some information present in the original video. A consequence of this can include that decompressed video can have lower quality than the original uncompressed video because there is insufficient information to accurately reconstruct the original video. There can be complex relationships between the video quality, the amount of data used to represent the video (e.g., determined by the bit rate), the complexity of the encoding and decoding algorithms, sensitivity to data losses and errors, ease of editing, random access, end-to-end delay (e.g., latency), and the like. Motion compensation can include an approach to predict a video frame or a portion thereof given a reference frame, such as previous and/or future frames, by accounting for motion of the camera and/or objects in the video. It can be employed in the encoding and decoding of video data for video compression, for example in the encoding and decoding using the Motion Picture Experts Group (MPEG)-2 (also referred to as advanced video coding (AVC) and H.264) standard. Motion compensation can describe a picture in terms of the transformation of a reference picture to the current picture. The reference picture can be previous in time when compared to the current picture, from the future when compared to the current picture, or can include a long-term reference (LTR) frame. When images can be accurately synthesized from previously transmitted and/or stored images, compression efficiency can be improved. Current standards such as H.264 and H.265 allow updating of frames such as long-term reference frames by signaling a newly decoded frame to be saved and made available as a reference frame. Such updates are signaled by the encoder and an entire frame is updated. But updating the entire frame can be costly, particularly where only a small portion of the static background has changed. Partial frame updates are possible but can often involve complex and computationally costly procedures to effect the frame updates. SUMMARY OF THE DISCLOSURE In an aspect, a decoder includes circuitry configured to receive a bitstream including a current coded block, determine a decoded current block, determine that an unavailable reference block update mode is enabled in the bitstream for the current coded block, and update an unavailable reference frame using the decoded current block. In another aspect, a method for processing a video bitstream is provided that includes receiving a bitstream comprising a first picture and a sequence parameter set containing information indicating a mode is enabled in which a first area of a picture can be extracted and replaced by a second area of another picture. Using the mode, modify the first picture by extracting the first area and replacing the extracted area with the second area. The modified first picture is stored and a predictor is formed using the modified first picture as a reference picture. A block of a subsequent picture is decoded using the predictor. In some embodiments, the first area and the second area comprise at least one