EP-4742008-A1 - ELECTRONIC DEVICE AND CONTROL METHOD THEREFOR

EP4742008A1EP 4742008 A1EP4742008 A1EP 4742008A1EP-4742008-A1

Abstract

An electronic device is disclosed. A processor of the device controls a projection unit to project a content image onto a projection surface, identifies, on the basis of a sensing value of at least one of a plurality of sensors, a point touched by a user with respect to the content image projected onto the projection surface, calculates an error value of the identified point on the basis of an error value of a grid point comprising the identified point among a plurality of grids, and recognizes an actual touch point by correcting the identified point on the basis of the error value and coordinate values of the identified point.

Inventors

KANG, Heungsuk
EOM, Gimun
HAHM, CHEULHEE

Assignees

Samsung Electronics Co., Ltd.

Dates

Publication Date: 20260513
Application Date: 20240925

Claims (15)

An electronic apparatus comprising: a projection part; a plurality of sensors; memory storing error map data including a plurality of grids set for correction of a touch point and error values of each corner point of the grids; and a processor, wherein the processor is configured to: control the projection part to project a content image onto a projection surface, identify a touch point of a user for the content image projected onto the projection surface based on sensing values of the plurality of sensors, calculate an error value of the identified touch point based on error values of each corner point of a grid including the identified touch point among the plurality of grids, and recognize an actual touch point by correcting the identified touch point based on coordinate values of the identified touch point and the error value of the identified touch point.
The electronic apparatus of claim 1, wherein the memory further stores a test image including a plurality of sample points, and the processor is configured to: based on a calibration function being executed, control the projection part to project the test image, based on the plurality of sample points being sequentially touched, identify a touched point, calculate error values by comparing coordinate values of each of the plurality of sample points and the coordinate values of the identified touch point, while the test image and the plurality of grids are matched, identify corner points of a grid enclosing each of the plurality of sample points to calculate weights according to distances between the identified corner points and the plurality of sample points, calculate error values of each corner point of the grid by accumulating the calculated error values and the weights for each of the plurality of sample points, and adjust the error values of each corner point of the grid stored in the memory to the calculated error values.
The electronic apparatus of claim 2, wherein the processor is configured to: calculate a weight of the sample point by using a formula such as 1 − a − ga W 1 − b − gb H , and in the formula, W is a width of one grid, H is a height of the one grid, a is an x coordinate value of the sample point, b is a y coordinate value of the sample point, ga is an x coordinate value of the corner point, and gb is a y coordinate value of the corner point.
The electronic apparatus of claim 2, wherein the processor is configured to: calculate an error value of a corner point of the grid by using a formula such as ∑ i = 1 n w i ∑ j = 1 n w j × ex i , ∑ i = 1 n w i ∑ j = 1 n w j × ey i , and in the formula, for an ith sample point among n sample points, ex i is an x coordinate error value, ey i is a y coordinate error value, and w i is a weight.
The electronic apparatus of claim 1, wherein the processor is configured to: calculate error values (ex, ey) of the identified touch point by using a formula such as e x = 1 − x − l W 1 − y − t H ex 1 + r − x W 1 − y − t H ex 2 + 1 − x − l W b − y H ex 3 + r − x W b − y H ex 4 e y = 1 − x − l W 1 − y − t H ey 1 + r − x W 1 − y − t H ey 2 + 1 − x − l W b − y H ey 3 + r − x W b − y H ey 4 identify the actual touch point by correcting the coordinate values of the identified point by subtracting the error values from the coordinate values of the identified point, and in the formula, e x is an x coordinate error value, e y is a y coordinate error value, and l, b, r, t are x and y coordinate values of four adjacent corner points.
The electronic apparatus of claim 1, wherein the projection part is configured to: project the content image in a direction of a bottom surface on which the electronic apparatus is placed, and the plurality of sensors comprise: an infrared (IR) sensor configured to emit an IR signal in a direction parallel to the bottom surface; and a camera configured to perform photographing in a direction of the bottom surface, and the processor is configured to: identify the touch point of the user based on a detection result of the IR sensor and a photographing result of the camera while the content image is projected onto the bottom surface.
The electronic apparatus of claim 1, wherein the plurality of grids are arranged in a form of a square matrix, corner points arranged in a center part within the square matrix have error values for sample points within four adjacent grids, corner points arranged in edge parts within the square matrix have error values for sample points within two adjacent grids, and corner points arranged in corner parts within the square matrix have error values for sample points within one grid.
The electronic apparatus of claim 2, wherein the number of the plurality of grids is set differently according to a size of the display, and the number of the sample points within the test image is fewer than the number of sample points used for generation of the error map data stored in the memory.
A control method for an electronic apparatus, the method comprising: projecting a content image onto a projection surface; identifying a point touched by a user for the content image projected onto the projection surface; calculating an error value of the identified touch point based on pre-stored error map data; and recognizing an actual touch point by correcting the identified touch point based on coordinate values of the identified touch point and the error value of the identified touch point, wherein the error map data comprises: a plurality of grids set for correction of a touch point and error values of each corner point of the grids.
The control method of claim 9, comprising: based on a calibration function being executed, projecting a test image including a plurality of sample points onto the projection surface; based on the plurality of sample points being sequentially touched, identifying a touched point; calculating error values by comparing coordinate values of each of the plurality of sample points and the coordinate values of the identified touch point; while the test image and the plurality of grids are matched, identifying corner points of a grid enclosing each of the plurality of sample points to calculate weights according to distances between the identified corner points and the plurality of sample points; calculating error values of each corner point of the grid by accumulating the calculated error values and the weights for each of the plurality of sample points; and adjusting the error values of each corner point of the grid to the calculated error values.
The control method of claim 10, wherein the calculating weights according to the distances between the identified corner points and the plurality of sample points comprises: calculating a weight of the sample point by using a formula such as 1 − a − ga W 1 − b − gb H , and in the formula, W is a width of one grid, H is a height of the one grid, a is an x coordinate value of the sample point, b is a y coordinate value of the sample point, ga is an x coordinate value of the corner point, and gb is a y coordinate value of the corner point.
The control method of claim 10, wherein the calculating error values of each corner point of the grid by accumulating the calculated error values and the weights for each of the plurality of sample points comprises: calculating an error value of a corner point of the grid by using a formula such as ∑ i = 1 n w i ∑ j = 1 n w j × ex i , ∑ i = 1 n w i ∑ j = 1 n w j × ey i , and in the formula, for an ith sample point among n sample points, ex i is an x coordinate error value, ey i is a y coordinate error value, and w i is a weight.
The control method of claim 9, wherein the recognizing the actual touch point by correcting the identified touch point based on coordinate values of the identified touch point and the error value of the identified point comprises: calculating error values (ex, ey) of the identified touch point by using a formula such e x = 1 − x − l W 1 − y − t H ex 1 + r − x W 1 − y − t H ex 2 + 1 − x − l W b − y H ex 3 + r − x W b − y H ex 4 as e y = 1 − x − l W 1 − y − t H ey 1 + r − x W 1 − y − t H ey 2 + 1 − x − l W b − y H ey 3 + r − x W b − y H ey 4 ; identifying the actual touch point by correcting the coordinate values of the identified touch point by subtracting the error values from the coordinate values of the identified touch point, and in the formula, e x is an x coordinate error value, e y is a y coordinate error value, and l, b, r, t are x and y coordinate values of four adjacent corner points.
The control method of claim 9, wherein the plurality of grids are arranged in a form of a square matrix, corner points arranged in a center part within the square matrix have error values for sample points within four adjacent grids, corner points arranged in edge parts within the square matrix have error values for sample points within two adjacent grids, and corner points arranged in corner parts within the square matrix have error values for sample points within one grid.
A non-transitory computer-readable recording medium storing computer instructions which, when executed by a processor of an electronic apparatus, cause the electronic apparatus to perform operations, wherein the operations comprise: projecting a content image onto a projection surface; identifying a point touched by a user for the content image projected onto the projection surface; calculating an error value of the identified touch point based on pre-stored error map data; and recognizing an actual touch point by correcting the identified touch point based on coordinate values of the identified touch point and the error value of the identified touch point, and wherein the error map data comprises: a plurality of grids set for correction of a touch point and error values of each corner point of the grids.

Description

[TECHNICAL FIELD] The disclosure relates to an electronic apparatus and a control method therefor. [BACKGROUND ART] Fueled by the development of electronic technologies, use of not only a conventional display device, but also an electronic apparatus that projects an image onto a projection surface without including a display in itself such as a projector is increasing. A projector can implement a large screen easily compared to other types of display devices by implementing an image by projecting a light onto a screen. For controlling a conventional projector, a user had to manipulate a button of a remote control or a body of a projector in most cases. Accordingly, there is a rising need for a technology that enables more convenient control of a projector from a user's stance. [DISCLOSURE OF INVENTION] [SOLUTION TO PROBLEM] According to at least one embodiment of the disclosure, an electronic apparatus includes a projection part, a plurality of sensors, memory storing error map data including a plurality of grids set for correction of a touch point and error values of each corner point of the grids, and a processor. The processor may control the projection part to project a content image onto a projection surface, identify a touch point of a user for the content image projected onto the projection surface based on sensing values of the plurality of sensors, and calculate an error value of the identified point based on error values of each corner point of a grid including the identified touch point among the plurality of grids, and recognize an actual touch point by correcting the identified touch point based on coordinate values of the identified touch point and the error value of the identified touch point. A control method for an electronic apparatus according to at least one embodiment of the disclosure includes the steps of projecting a content image onto a projection surface, identifying a point touched by a user for the content image projected onto the projection surface, calculating an error value of the identified touch point based on pre-stored error map data, and recognizing an actual touch point by correcting the identified touch point based on coordinate values and the error value of the identified touch point. The error map data includes a plurality of grids set for correction of a touch point and error values of each corner point of the grids. According to at least one embodiment of the disclosure, in a non-transitory computer-readable recording medium storing a program for performing a method of generating error map data, the method includes the steps of projecting a test image including a plurality of sample points onto a projection surface, based on the plurality of sample points being sequentially touched, identifying a touched point, calculating error values by comparing coordinate values of each of the plurality of sample points and coordinate values of the identified touch point, while the test image and the plurality of grids are matched, identifying corner points of a grid enclosing each of the plurality of sample points to calculate weights according to distances between the identified corner points and the plurality of sample points, calculating error values of each corner point of the grid by accumulating the calculated error values and the weights for each of the plurality of sample points, and adjusting the error values of each corner point of the grid stored in the memory to the calculated error values. [DESCRIPTION OF DRAWINGS] FIG. 1 is a diagram for illustrating an electronic apparatus according to at least one embodiment of the disclosure;FIG. 2 is a block diagram illustrating a configuration of an electronic apparatus according to at least one embodiment of the disclosure;FIG. 3 is a diagram for illustrating a user touch for an electronic apparatus according to at least one embodiment of the disclosure;FIG. 4 is a diagram for illustrating a method of generating error map data of an electronic apparatus according to at least one embodiment of the disclosure;FIG. 5 is a diagram for illustrating a process of correcting a user touch point according to at least one embodiment of the disclosure;FIG. 6 is a diagram for illustrating a calibration method according to at least one embodiment of the disclosure;FIG. 7 is a flow chart for illustrating a control method for an electronic apparatus according to at least one embodiment of the disclosure; andFIG. 8 is a flow chart for illustrating a method of performing a calibration function of an electronic apparatus according to at least one embodiment of the disclosure. [MODE FOR INVENTION] As terms used in the various embodiments of the disclosure, general terms that are currently used widely were selected as far as possible, in consideration of the functions described in the disclosure. However, the terms may vary depending on the intention of those skilled in the art who work in the pertinent field or previous court decisions, or emer