KR-20260064313-A - An electronic apparatus and a method thereof

KR20260064313AKR 20260064313 AKR20260064313 AKR 20260064313AKR-20260064313-A

Abstract

An electronic device according to the present disclosure comprises a decoder that decodes an input stream to acquire an image, a frame rate converter that converts the frame rate (Frames Per Second, FPS) of the decoded image, a display unit that outputs the image, a memory that stores one or more instructions, and at least one processor including a processing circuit. When one or more instructions are executed individually or collectively by at least one processor, the decoder acquires an image by adjusting the number of frame repetitions based on a changed frame acquisition pattern corresponding to the frame rate of the input stream before the change and the frame rate of the input stream after the change, when the frame rate of the input stream is changed, under the control of the processor; the frame rate converter converts the frame rate of the image acquired by adjusting the number of frame repetitions under the control of the processor; and the display unit outputs an image in which the frame rate has been converted by the frame rate converter under the control of the processor.

Inventors

송원석
정유선
박운성

Assignees

삼성전자주식회사

Dates

Publication Date: 20260507
Application Date: 20241031

Claims (18)

In an electronic device (100), A decoder (133) that decodes an input stream to obtain an image; A frame rate conversion unit (134) that converts the frame rate (Frames Per Second, FPS) of the above-decoded video; A display unit (140) that outputs an image; Memory (120) for storing one or more instructions; and It includes at least one processor (110) including a processing circuit, and When the one or more instructions are executed individually or collectively by the at least one processor, The above decoder, under the control of the above processor, When the frame rate of the input stream is changed, the number of frame repetitions is adjusted based on a changed frame acquisition pattern corresponding to the frame rate of the input stream before the change and the frame rate of the input stream after the change to acquire the image, and The above frame rate conversion unit converts the frame rate of the image obtained by adjusting the number of frame repetitions according to the control of the processor, and An electronic device in which the display unit outputs an image with a frame rate converted by the frame rate conversion unit under the control of the processor.
In claim 1, when the one or more instructions are executed individually or collectively by the at least one processor, An electronic device wherein the decoder obtains FPS information of the input stream from the header of the input stream under the control of the processor, and identifies that the frame rate of the input stream has changed based on the FPS information of the input stream.
In claim 2, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor An electronic device that decodes the input stream to obtain the image having a fixed frame rate, and transmits the FPS information of the image having the fixed frame rate and the input stream to the frame rate converter.
In claim 3, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor The image is acquired according to a frame acquisition pattern corresponding to the input stream, which is determined according to the frame rate of the input stream and the fixed frame rate, and An electronic device that acquires an image by adjusting the number of frame repetitions according to a changed frame acquisition pattern, which is different from the frame acquisition pattern, when the frame rate of the input stream is changed.
In claim 4, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor An electronic device that identifies a change frame acquisition pattern stored in correspondence with the frame rate of the input stream before change and the frame rate of the input stream after change from a matrix or mapping table stored in the memory.
In claim 4 or 5, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor An electronic device that controls the number of frame repetitions of an image by using a pull-down method selected according to the difference in frame rates between the input stream frame rate and the fixed frame rate as the frame acquisition pattern when the fixed frame rate is higher than the frame rate of the input stream.
In any one of claims 4 to 6, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor An electronic device that acquires an image by increasing the number of repetitions of a repeating frame according to a first change frame acquisition pattern when the frame rate of the input stream changes from a first input frame rate to a second input frame rate, and the second input frame rate is higher than the first input frame rate.
In any one of claims 4 to 6, when the one or more instructions are executed individually or collectively by the at least one processor, The above decoder is under the control of the above processor An electronic device that acquires an image by skipping a repeating frame according to a second change frame acquisition pattern when the frame rate of the input stream changes from a first input frame rate to a second input frame rate, if the second input frame rate is lower than the first input frame rate.
In any one of claims 3 to 8, when the one or more instructions are executed individually or collectively by the at least one processor, The above frame rate converter, according to the control of the processor Receive FPS information of the image and the input stream from the decoder, and An electronic device that adds interpolated frames to the image using FPS information of the input stream and the fixed frame rate.
In the method of operating an electronic device, A step of acquiring an image by decoding an input stream; and It includes a step of converting the frame rate (Frames Per Second, FPS) of the above-decoded video, and The step of acquiring the above image includes, when the frame rate of the input stream is changed, the step of acquiring the above image by adjusting the number of frame repetitions based on a changed frame acquisition pattern corresponding to the frame rate of the input stream before the change and the frame rate of the input stream after the change. The above method includes the step of converting the frame rate of the image obtained by adjusting the number of frame repetitions; and A method of operating an electronic device, further comprising the step of outputting an image with the above-mentioned frame rate converted.
In claim 10, the step of obtaining FPS information of the input stream from the header of the input stream; and A method of operating an electronic device, further comprising the step of identifying that the frame rate of the input stream has changed based on the FPS information of the input stream.
A method of operation of an electronic device according to claim 10 or 11, wherein the step of acquiring the image comprises the step of decoding the input stream to acquire the image having a fixed frame rate.
In claim 12, the step of acquiring the image A step of acquiring the image according to a frame acquisition pattern corresponding to the input stream, which is determined according to the frame rate of the input stream and the fixed frame rate; and A method of operation of an electronic device comprising the step of acquiring the image by adjusting the number of frame repetitions according to the changed frame acquisition pattern, which is different from the frame acquisition pattern, when the frame rate of the input stream is changed.
A method of operation of an electronic device according to claim 13, further comprising the step of identifying, from a previously stored matrix or mapping table, a change frame acquisition pattern stored in correspondence with the frame rate of the input stream before change and the frame rate of the input stream after change.
In claim 13 or 14, the step of acquiring the image A method of operation of an electronic device comprising the step of adjusting the number of frame repetitions of an image using a pull-down method selected according to the difference in frame rates between the frame rate of the input stream and the fixed frame rate as the frame acquisition pattern when the fixed frame rate is higher than the frame rate of the input stream.
In any one of claims 13 to 15, the step of acquiring the image A method of operation of an electronic device comprising the step of acquiring an image by increasing the number of repetitions of a repeating frame according to a first change frame acquisition pattern when the frame rate of the input stream changes from a first input frame rate to a second input frame rate, if the second input frame rate is higher than the first input frame rate.
In any one of claims 13 to 15, the step of acquiring the image A method of operating an electronic device comprising the step of acquiring an image by skipping a repeating frame according to a 2 change frame acquisition pattern when, at the time when the frame rate of the input stream changes from a first input frame rate to a second input frame rate, the second input frame rate is lower than the first input frame rate.
A computer-readable recording medium having a program recorded thereon for performing the method of any one of claims 10 to 17 on a computer.

Description

An electronic apparatus and a method thereof The various disclosed embodiments relate to an electronic device and a method of operating the same, and more specifically, to an electronic device for removing motion judder of an input image and a method of operating the same. Motion judder is a phenomenon in which video movement does not appear continuous and smooth, but rather appears choppy or shaky; it primarily occurs when playing videos with a low frame rate. To eliminate motion judder, products such as TVs and monitors perform a frame rate conversion operation. This conversion operation can be a method of outputting a high-frame-rate video by adding interpolated frames, generated using frame interpolation technology for low-frame-rate input video, between the input frames. Motion judder can be eliminated through this method. Figure 1 is a diagram illustrating the frame output timing when converting a 60 FPS input stream into a 120 FPS output image when converting the frame rate based on frame interpolation technology. Figure 2 is a diagram illustrating the frame output timing when converting a 30 FPS input stream into a 120 FPS output video when converting the frame rate based on frame interpolation technology. Figure 3 is a diagram illustrating the frame output timing when converting a 30 FPS input stream into a fixed FPS video and then acquiring a 120 FPS output video when converting the frame rate based on frame interpolation technology. Figure 4 is a diagram illustrating the frame output timing when converting an input that changes from 30 FPS to 60 FPS to 120 FPS when converting the frame rate based on frame interpolation technology. Figure 5 illustrates a method of applying a long delay regardless of the original FPS to resolve frame delay changes when the original FPS changes. FIG. 6 is a block diagram of an electronic device according to an embodiment. Figure 7 is a diagram for explaining the image processing unit of Figure 6 in more detail. FIG. 8 illustrates a case where the encoder converts the original FPS to a fixed FPS according to an embodiment. FIG. 9 is a block diagram of a frame rate conversion unit according to an embodiment. FIG. 10 is an internal block diagram of an electronic device according to an embodiment. FIG. 11 is a diagram illustrating, according to an embodiment, that when the FPS of an input stream changes, the decoder adjusts the number of frame repetitions and transmits them to the frame rate converter, thereby allowing frames to be output from the frame rate converter at regular intervals. FIG. 12 is a diagram illustrating how, according to an embodiment, when the FPS of an input stream changes, the decoder adjusts the number of frame repetitions so that frames are output from the frame rate converter at regular intervals. FIG. 13 is a diagram illustrating how, according to an embodiment, when the FPS of an input stream changes, the decoder adjusts the number of frame repetitions so that frames are output from the frame rate converter at regular intervals. FIG. 14 is a diagram illustrating how, according to an embodiment, when the FPS of an input stream changes, the decoder adjusts the number of frame repetitions so that frames are output from the frame rate converter at regular intervals. FIG. 15 is a flowchart illustrating the operation method of an electronic device according to an embodiment. In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof. Embodiments of the present disclosure are described below in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. The terms used in this disclosure are described in their current, general form considering the functions mentioned herein; however, they may refer to various other terms depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Accordingly, the terms used in this disclosure should not be interpreted solely by their names, but should be interpreted based on the meaning of the terms and the overall content of this disclosure. Furthermore, the terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit this disclosure. Throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other components in between. The terms “above” and similar designations used in this specification, particularly in the claims, may indicate both singular and plural forms. Furthermore, unless there is a description explicitly specifying the order of the steps describing the method according to