EP-4738821-A1 - MOTION SEARCH PROCESSING METHOD, SYSTEM AND DEVICE FOR VIDEO CODING, AND STORAGE MEDIUM

EP4738821A1EP 4738821 A1EP4738821 A1EP 4738821A1EP-4738821-A1

Abstract

Disclosed in the embodiments of the present application are a motion search processing method, system and device for video coding, and a storage medium. The technical solution provided in the embodiments of the present application comprises: during a motion search process of video coding, determining an optimal start point on the basis of an integer pixel search, and performing a sub-pixel search on reference blocks one by one starting from a reference block corresponding to the optimal start point (S110); during the sub-pixel search, calculating gradient information in a direction corresponding to the current reference block, comparing the gradient information with a set gradient threshold value, according to a comparison result, performing skip determination on a sub-pixel search flow in the direction corresponding to the current reference block, and under a first set situation, skipping the sub-pixel search flow in the direction corresponding to the current reference block (S 120); and acquiring a real-time minimum distortion cost of the current reference block and the sum of absolute values of prediction residuals of an optimal mode, performing skip determination on sub-pixel search flows in all directions of the current reference block according to the gradient information, the minimum distortion cost and the sum of the absolute values of the prediction residuals, and skipping the sub-pixel search flows in all directions of the current reference block under a second set situation (S 130). By means of the method, during a pixel search, parts having relatively small gradients are screened out and sub-pixel search flows thereof are skipped, thereby reducing the time consumption of a motion search, and thus improving the video coding efficiency.

Inventors

ZHANG, XU

Assignees

Peninsula Information Technologies Inc

Dates

Publication Date: 20260506
Application Date: 20240614

Claims (11)

A motion search processing method for video coding, comprising: during a motion search for video coding, determining an optimal starting point based on integer-pixel search, and performing sub-pixel search on reference blocks one by one starting from a reference block corresponding to the optimal starting point; during the sub-pixel search, calculating gradient information of a current reference block in a corresponding direction, comparing the gradient information with a predetermined gradient threshold, determining whether to skip a sub-pixel search process for the current reference block in the corresponding direction based on a comparison result, and in a first predetermined case, skipping the sub-pixel search process for the current reference block in the corresponding direction; and acquiring a real-time minimum rate distortion cost and a sum of absolute transformed difference of an optimal mode for the current reference block, determining whether to skip a sub-pixel search process for the current reference block in all directions based on the gradient information, the minimum rate distortion cost, and the sum of absolute transformed difference, and in a second predetermined case, skipping the sub-pixel search process for the current reference block in all directions.
The motion search processing method for video coding according to claim 1, wherein the predetermined gradient threshold is set based on bi-directional prediction information and a height and a width of the current reference block, the corresponding direction comprises a vertical direction and a horizontal direction; and in the first predetermined case, skipping the sub-pixel search process for the current reference block in the corresponding direction comprises: in a case where the gradient information in the vertical direction is less than the predetermined gradient threshold, skipping the sub-pixel search process for the current reference block in the vertical direction; and in a case where the gradient information in the horizontal direction is less than the predetermined gradient threshold, skipping the sub-pixel search process for the current reference block in the horizontal direction.
The motion search processing method for video coding according to claim 1, wherein in the second predetermined case, skipping the sub-pixel search process for the current reference block in all directions comprises: skipping the sub-pixel search process for the current reference block in all directions upon determining that pixels of the current reference block are in a predetermined smooth state based on the gradient information, the minimum rate distortion cost, and the sum of absolute transformed difference.
The motion search processing method for video coding according to claim 1, wherein the sub-pixel search comprises a half-pixel search and a quarter-pixel search, wherein the quarter-pixel search is performed after the half-pixel search, and a determination condition for skipping the sub-pixel search process is updated in real time.
The motion search processing method for video coding according to claim 1, wherein prior to the motion search of video coding, the method further comprises: during a motion search for video pre-coding, comparing a rate distortion cost of a predicted optimal motion vector with a first predetermined cost threshold, and skipping the motion search for video pre-coding in a case where the rate distortion cost is less than or equal to the predetermined cost threshold.
The motion search processing method for video coding according to claim 5, wherein after comparing the rate distortion cost of the predicted optimal motion vector with the first predetermined cost threshold, the method further comprises: performing integer-pixel search on reference blocks one by one, determining a reference block that is in a predetermined smooth motion state, and skipping an integer-pixel search process for a corresponding reference block.
The motion search processing method for video coding according to claim 5, wherein after comparing the rate distortion cost of the predicted optimal motion vector with the first predetermined cost threshold, the method further comprises: performing integer-pixel search on reference blocks one by one, and skipping an integer-pixel search process for a current reference block in a case where a rate distortion cost of an optimal motion vector for the current reference block is less than an optimal intra-frame rate distortion cost for the current reference block and the rate distortion cost is less than a second predetermined cost threshold.
A motion search processing system for video coding, comprising: a motion search module, configured to: during a motion search for video coding, determine an optimal starting point based on integer-pixel search, and perform sub-pixel search on reference blocks one by one starting from a reference block corresponding to the optimal starting point; a first process skipping module, configured to: during the sub-pixel search, calculate gradient information of a current reference block in a corresponding direction, compare the gradient information with a predetermined gradient threshold, determine whether to skip a sub-pixel search process for the current reference block in the corresponding direction based on a comparison result, and in a first predetermined case, skip the sub-pixel search process for the current reference block in the corresponding direction; and a second process skipping module, configured to: acquire a real-time minimum rate distortion cost and a sum of absolute transformed difference of an optimal mode for the current reference block, determine whether to skip a sub-pixel search process for the current reference block in all directions based on the gradient information, the minimum rate distortion cost, and the sum of absolute transformed difference, and in a second predetermined case, skip the sub-pixel search process for the current reference block in all directions.
A motion search processing device for video coding, comprising: a memory and one or more processors; wherein the memory is configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to perform the motion search processing method for video coding as defined in any one of claims 1 to 7.
A computer-readable storage medium, wherein the computer-readable storage medium stores one or more computer-executable instructions, which when executed by a processor of a computer, cause the computer to perform the motion search processing method for video coding as defined in any one of claims 1 to 7.
A computer program product, comprising one or more instructions, wherein the one or more instructions, when executed by a computer or a processor, cause the computer or the processor to perform the motion search processing method for video coding as defined in any one of claims 1 to 7.

Description

The present disclosure claims priority to Chinese Patent Application No. 202310777782.9, filed on June 28, 2023, the entire disclosure of which is incorporated herein by reference. TECHNICAL FIELD Embodiments of the present disclosure relate to the field of video coding technologies, and in particular, relate to a motion search processing method for video coding, a motion search processing system for video coding, a motion search processing device for video coding, and a storage medium. BACKGROUND At present, motion search is employed during video coding to enhance coding information. The basic concept of motion search involves dividing each frame of an image sequence into many non-overlapping macroblocks, and considering that all pixels within a macroblock have the same displacement. Then, for each macroblock, a block most similar to a current block, i.e., a matching block, is identified within a specific search range in a reference frame according to a certain matching criterion. A relative displacement between the matching block and the current block is a motion vector. During video compression, only the motion vector and residual data need to be stored to fully restore the current block. However, related motion search solutions require complex computational procedures to improve video coding performance, which results in a time-consuming process. For some scenarios with high requirements for real-time video coding, the complex motion search process fails to meet the real-time requirements, leading to a relatively poor user experience. SUMMARY Embodiments of the present disclosure provide a motion search processing method for video coding, a motion search processing system for video coding, a motion search processing device for video coding, and a storage medium, which can simplify the motion search process while ensuring video coding quality, improve video coding efficiency, and solve the technical problem that related motion search solutions result in a time-consuming process. In a first aspect, the embodiments of the present disclosure provide a motion search processing method for video coding. The method includes: during a motion search for video coding, determining an optimal starting point based on an integer-pixel search, and performing sub-pixel search on reference blocks one by one starting from a reference block corresponding to the optimal starting point;during the sub-pixel search, calculating gradient information of a current reference block in a corresponding direction, comparing the gradient information with a predetermined gradient threshold, determining whether to skip a sub-pixel search process for the current reference block in the corresponding direction based on a comparison result, and in a first predetermined case, skipping the sub-pixel search process for the current reference block in the corresponding direction; andacquiring a real-time minimum rate distortion cost and a sum of absolute transformed difference of an optimal mode for the current reference block, determining whether to skip a sub-pixel search process for the current reference block in all directions based on the gradient information, the minimum rate distortion cost, and the sum of absolute transformed difference, and in a second predetermined case, skipping the sub-pixel search process for the current reference block in all directions. In a second aspect, the embodiments of the present disclosure provide a motion search processing system for video coding. The system includes: a motion search module, configured to: during a motion search for video coding, determine an optimal starting point based on an integer-pixel search, and perform a sub-pixel search on reference blocks one by one starting from a reference block corresponding to the optimal starting point;a first process skipping module, configured to: during the sub-pixel search, calculate gradient information of a current reference block in a corresponding direction, compare the gradient information with a predetermined gradient threshold, determine whether to skip a sub-pixel search process for the current reference block in the corresponding direction based on a comparison result, and in a first predetermined case, skip the sub-pixel search process for the current reference block in the corresponding direction; anda second process skipping module, configured to: acquire a real-time minimum rate distortion cost and a sum of absolute transformed difference of an optimal mode for the current reference block, determine whether to skip a sub-pixel search process for the current reference block in all directions based on the gradient information, the minimum rate distortion cost, and the sum of absolute transformed difference, and in a second predetermined case, skip the sub-pixel search process for the current reference block in all directions. In a third aspect, the embodiments of the present disclosure provide a motion search processing device for video coding