KR-102962343-B1 - Image processing device and method

Abstract

The present disclosure relates to an image processing apparatus and method capable of suppressing a reduction in encoding efficiency. An upper limit value for the number of bins allocated to a processing target subblock is set by distributing the number of bins among non-zero subblocks, and for the processing target subblock, a syntax element value is derived using count data derived from image data so that the number of bins does not exceed the upper limit value, and the derived syntax element value is encoded to generate encoded data. The present disclosure may be applied, for example, to an image processing apparatus, an image encoding apparatus, an image decoding apparatus, a transmitting apparatus, a receiving apparatus, a transmitting and receiving apparatus, an information processing apparatus, an imaging apparatus, a playback apparatus, an electronic device, an image processing method, or an information processing method.

Inventors

• 야마토 아츠시
• 츠쿠바 다케시

Assignees

• 소니그룹주식회사

Dates

Publication Date

20260511

Application Date

20200206

Priority Date

20190207

Claims (15)

1. Based on the size of a processing target block including multiple sub-blocks and the number of context encoding bins that can be allocated to each of the multiple sub-blocks of the processing target block, an upper limit is set for the number of context encoding bins that can be allocated to the processing target block - the size of the processing target block is larger than the size of each of the multiple sub-blocks of the processing target block - , Select each of the plurality of sub-blocks of the processing target block in order, and A syntax element value derivation unit configured to derive syntax element values for each of the sequentially selected sub-blocks using coefficient data derived from image data, such that the sum of the number of context encoding bins used to encode each syntax element value does not exceed the upper limit of the number of context encoding bins that can be assigned to the processing target block; and An image processing device having an encoding unit that generates encoded data by encoding the derived syntax element values.
2. In paragraph 1, The above-mentioned processing target block is an image processing device that is a CU (Coding Unit) or a TU (Transform Unit).
3. In paragraph 1, The above syntax element value derivation unit is an image processing device configured to set the upper limit value based on the number of the plurality of sub-blocks of the processing target block and the number of context encoding bins that can be assigned to each of the plurality of sub-blocks.
4. In paragraph 1, The image processing device is configured to reduce the upper limit value, and The above syntax element value derivation unit is, Select each of the plurality of sub-blocks of the processing target block in order, and It is configured to derive syntax element values for each of the sequentially selected sub-blocks using coefficient data derived from image data, such that the sum of the number of context encoding bins used to encode each syntax element value does not exceed the reduced upper limit value, and An image processing device configured such that, in response to the above-mentioned reduced upper limit value being determined to be below the threshold, the encoding unit encodes the derived syntax element value according to a bypass mode to generate encoded data.
5. In paragraph 1, The above syntax element value derivation unit is an image processing device that is a sequencer.
6. In paragraph 1, The above encoding unit is an image processing device that is a CABAC (Context Adaptive Binary Arithmetic Coding) unit.
7. Based on the size of a processing target block including multiple sub-blocks and the number of context encoding bins that can be allocated to each of the multiple sub-blocks of the processing target block, an upper limit is set for the number of context encoding bins that can be allocated to the processing target block - the size of the processing target block is larger than the size of each of the multiple sub-blocks of the processing target block - , Select each of the plurality of sub-blocks of the processing target block in order, and Using coefficient data derived from image data, syntax element values for each of the sequentially selected sub-blocks are derived such that the sum of the number of context encoding bins used to encode each syntax element value does not exceed the upper limit of the number of context encoding bins that can be assigned to the processing target block. An image processing method comprising encoding the derived syntax element values to generate encoded data.
8. A decoding unit configured to decode encoded data and generate syntax element values for each of a plurality of sub-blocks; and Based on the size of a processing target block including the plurality of sub-blocks and the number of context encoding bins that can be allocated to each of the plurality of sub-blocks of the processing target block, an upper limit is set for the number of context encoding bins that can be allocated to the processing target block, and - the size of the processing target block is larger than the size of each of the plurality of sub-blocks of the processing target block - , Select each of the plurality of sub-blocks of the processing target block in order, and An image processing device comprising a coefficient data derivation unit configured to derive coefficient data corresponding to image data for each of the selected sub-blocks using the generated syntax element values, wherein the sum of the number of context encoding bins used to decode each of the generated syntax element values does not exceed the upper limit of the number of context encoding bins that can be assigned to the processing target block.
9. In paragraph 8, The above-mentioned processing target block is an image processing device that is a CU (Coding Unit) or a TU (Transform Unit).
10. In paragraph 8, The image processing device configured such that the coefficient data derivation unit sets the upper limit value based on the number of the plurality of sub-blocks of the processing target block and the number of context encoding bins that can be assigned to each of the plurality of sub-blocks.
11. In paragraph 8, The image processing device is configured to determine that the upper limit value has been reduced and to determine that the reduced upper limit value is below a threshold. The above decoding unit is configured to decode encoded data according to a bypass mode and generate syntax element values for each of the plurality of subblocks, and The coefficient data derivation unit is configured to sequentially select each of the plurality of sub-blocks of the processing target block and to derive coefficient data corresponding to image data for each of the selected sub-blocks using the generated syntax element value. An image processing device in which the sum of the number of context encoding bins used to decode each of the generated syntax element values does not exceed the reduced upper limit of the number of context encoding bins that can be assigned to the processing target block.
12. In paragraph 8, The above-mentioned decoding unit is an image processing device that is a CABAC (Context Adaptive Binary Arithmetic Coding) unit.
13. In paragraph 8, The above coefficient data derivation unit is a parser image processing device.
14. Decoding encoded data to generate syntax element values for each of multiple sub-blocks, and Based on the size of a processing target block including the plurality of subblocks and the number of context encoding bins that can be allocated to each of the plurality of subblocks of the processing target block, an upper limit is set for the number of context encoding bins that can be allocated to the processing target block - the size of the processing target block is larger than the size of each of the plurality of subblocks of the processing target block - , Select each of the plurality of sub-blocks of the processing target block in order, and An image processing method comprising deriving count data corresponding to image data for each of the selected sub-blocks using the generated syntax element values, wherein the sum of the number of context encoding bins used to decode each of the generated syntax element values does not exceed the upper limit of the number of context encoding bins that can be assigned to the processing target block.
15. delete

Description

Image processing device and method The present disclosure relates to an image processing apparatus and method, and in particular to an image processing apparatus and method capable of suppressing a reduction in encoding efficiency. Conventionally, in CABAC for image encoding, as the number of context-coded bins used to represent syntax element values increases, encoding efficiency improves and image quality degradation can be suppressed. However, as the number of context-coded bins increases, throughput increases, so a method of imposing a constraint on the number of context-coded bins at the sub-block level has been proposed (e.g., Non-patent Literature 1). Figure 1 is a drawing explaining the subblock. Figure 2 is a diagram illustrating Method #1. Figure 3 is a diagram illustrating an application example of Method #1. FIG. 4 is a block diagram illustrating a main configuration example of an encoding device. Figure 5 is a block diagram illustrating a main configuration example of CABAC. Figure 6 is a flowchart illustrating an example of the flow of encoding processing. Figure 7 is a flowchart illustrating an example of the flow of the syntax element value derivation process. Figure 8 is a drawing illustrating an example of syntax. FIG. 9 is a drawing following FIG. 8, illustrating an example of syntax. FIG. 10 is a drawing following FIG. 9, illustrating an example of syntax. FIG. 11 is a drawing following FIG. 10, illustrating an example of syntax. Figure 12 is a flowchart illustrating an example of the flow of CABAC processing. FIG. 13 is a block diagram illustrating a main configuration example of a decoding device. FIG. 14 is a block diagram illustrating a main configuration example of CABAC. Figure 15 is a flowchart illustrating an example of the flow of decoding processing. Figure 16 is a flowchart illustrating an example of the flow of CABAC processing. Figure 17 is a flowchart illustrating an example of the flow of coefficient data derivation processing. Figure 18 is a diagram illustrating Method #2. FIG. 19 is a diagram illustrating an example of the application of Method #2. Figure 20 is a flowchart illustrating an example of the flow of the syntax element value derivation process. Figure 21 is a drawing illustrating an example of syntax. FIG. 22 is a drawing following FIG. 21, illustrating an example of syntax. FIG. 23 is a drawing following FIG. 22, illustrating an example of syntax. FIG. 24 is a drawing following FIG. 23, illustrating an example of syntax. Figure 25 is a flowchart illustrating an example of the flow of the coefficient data derivation process. Figure 26 is a diagram illustrating Method #3. Figure 27 is a diagram illustrating an example of the application of Method #3. Figure 28 is a flowchart illustrating an example of the flow of the syntax element value derivation process. Figure 29 is a drawing illustrating an example of syntax. FIG. 30 is a drawing following FIG. 29, illustrating an example of syntax. FIG. 31 is a drawing following FIG. 30, illustrating an example of syntax. FIG. 32 is a drawing following FIG. 31, illustrating an example of syntax. Figure 33 is a flowchart illustrating an example of the flow of coefficient data derivation processing. Figure 34 is a diagram illustrating method #4. Figure 35 is a diagram illustrating an example of the application of Method #4. Figure 36 is a flowchart illustrating an example of the flow of the syntax element value derivation process. FIG. 37 is a flowchart following FIG. 36, illustrating an example of the flow of the syntax element value derivation process. Fig. 38 is a drawing illustrating an example of syntax. FIG. 39 is a drawing following FIG. 38, illustrating an example of syntax. FIG. 40 is a drawing following FIG. 39, illustrating an example of syntax. FIG. 41 is a drawing following FIG. 40, illustrating an example of syntax. Figure 42 is a flowchart illustrating an example of the flow of coefficient data derivation processing. Figure 43 is a flowchart following Figure 42, illustrating an example of the flow of the process for deriving coefficient data. Figure 44 is a diagram illustrating Method #5. Figure 45 is a diagram illustrating an example of the application of Method #5. Figure 46 is a diagram illustrating method #6. Figure 47 is a diagram illustrating an example of the application of Method #6. Figure 48 is a diagram illustrating method #7. Figure 49 is a diagram illustrating an example of the application of Method #7. Figure 50 is a flowchart illustrating an example of the flow of the syntax element value derivation process. Fig. 51 is a drawing illustrating an example of syntax. FIG. 52 is a drawing following FIG. 51, illustrating an example of syntax. FIG. 53 is a drawing following FIG. 52, illustrating an example of syntax. Figure 54 is a flowchart illustrating an example of the flow of the coefficient data derivation process. Fig. 55 is a diagram illustrating method #8. Figure 56 is a diagram illustrating a