US-20260126905-A1 - ELECTRONIC APPARATUS AND CONTROLLING METHOD THEREOF

Abstract

An electronic apparatus may include: memory that stores instructions; a communication interface configured to connect with a terminal device; a display; and at least one processor including processing circuitry, wherein the instructions, when executed individually or collectively by the at least one processor, cause the electronic apparatus to: control the display to display a screen including a plurality of objects and a pointer user interface (UI); receive, via the communication interface, touch data from the terminal device operating in a first mode or motion data from the terminal device operating in a second mode; based on the touch data being received, perform a function corresponding to the touch data; and based on the motion data being received, control the display to move the pointer UI based on the motion data, wherein the terminal device operates in the second mode based on a pre-set event.

Inventors

• Sangyoon Lee
• Sunmin SON
• Jingun JUNG
• YoonYoung Kim
• Joosun Moon
• Soyoung Yun
• Eunjoo CHO
• Gippeum Choi

Assignees

• SAMSUNG ELECTRONICS CO., LTD.

Dates

Publication Date

20260507

Application Date

20251231

Priority Date

20240726

Claims (20)

1. 1 . An electronic apparatus, comprising: memory that stores instructions; a communication interface configured to connect with a terminal device; a display; and at least one processor comprising processing circuitry, wherein the instructions, when executed individually or collectively by the at least one processor, cause the electronic apparatus to: control the display to display a screen comprising a plurality of objects and a pointer user interface (UI); receive, via the communication interface, touch data from the terminal device operating in a first mode or motion data from the terminal device operating in a second mode; based on the touch data being received, perform a function corresponding to the touch data; and based on the motion data being received, control the display to move the pointer UI based on the motion data, wherein the terminal device operates in the second mode based on a pre-set event.
2. 2 . The electronic apparatus of claim 1 , wherein the instructions, when executed individually or collectively by the at least one processor, further cause the electronic apparatus to: receive a notification from the terminal device via the communication interface, the notification indicating that an application for controlling the electronic apparatus has been executed; and based on the notification being received, control the display to display the pointer UI.
3. 3 . The electronic apparatus of claim 1 , wherein the function corresponding to the touch data comprises at least one of: moving the pointer UI, selecting an object corresponding to a position at which the pointer UI is displayed from the plurality of objects, displaying a home screen, displaying a previous screen, or scrolling a current screen.
4. 4 . The electronic apparatus of claim 3 , wherein the touch data comprises at least one of: a drag signal, a tap signal a long tap signal, a double tap signal, or an edge scroll signal.
5. 5 . The electronic apparatus of claim 1 , wherein the pre-set event comprises at least one of: a pre-set area of a display of the terminal device being touched, a floating UI displayed on the display of the terminal device being touched, an area of the display of the terminal device being touched for a threshold time or more, a pre-set physical button of the terminal device being touched, or a pre-set UI displayed on the display of the terminal device being touched.
6. 6 . The electronic apparatus of claim 1 , wherein the instructions, when executed individually or collectively by the at least one processor, further cause the electronic apparatus to: based on receiving the touch data comprising a user input received through a first area of a display of the terminal device, perform a function corresponding to the touch data; and based on the motion data being received based on a user input received through a second area of the display of the terminal device, control the display for the pointer UI to move based on the motion data.
7. 7 . The electronic apparatus of claim 1 , wherein the instructions, when executed individually or collectively by the at least one processor, further cause the electronic apparatus to: based on receiving the motion data obtained while a user input for selecting a floating UI displayed on the display of the terminal device is received, control the display for the pointer UI to move based on the motion data.
8. 8 . The electronic apparatus of claim 1 , wherein the motion data comprises gyroscope data obtained through a gyroscope sensor in the terminal device or acceleration data obtained through an acceleration sensor in the terminal device.
9. 9 . The electronic apparatus of claim 1 , wherein the instructions, when executed individually or collectively by the at least one processor, further cause the electronic apparatus to: adjust a moving speed of the pointer UI based on movement pattern information of the pointer UI stored in the memory, wherein the movement pattern information of the pointer UI comprises information indicating a pattern by which the pointer UI is moved to select an object.
10. 10 . The electronic apparatus of claim 1 , wherein the instructions, when executed individually or collectively by the at least one processor, further cause the electronic apparatus to: control the display to display identification information corresponding to the terminal device together with the pointer UI.
11. 11 . A method of controlling an electronic apparatus connected with a terminal device, the method comprising: displaying a screen comprising a plurality of objects and a pointer user interface (UI); receiving touch data from the terminal device operating in a first mode or motion data from the terminal device operating in a second mode; based on the touch data being received, performing a function corresponding to the touch data; and based on the motion data being received, controlling the pointer UI to move based on the motion data, wherein the terminal device operates in the second mode based on a pre-set event.
12. 12 . The method of claim 11 , further comprising: receiving a notification from the terminal device, the notification indicating that an application for controlling the electronic apparatus has been executed; and based on the notification being received, displaying the pointer UI.
13. 13 . The method of claim 11 , wherein the function corresponding to the touch data comprises at least one of: moving the pointer UI, selecting an object corresponding to a position at which the pointer UI is displayed from the plurality of objects, displaying a home screen, displaying a previous screen, or scrolling a current screen.
14. 14 . The method of claim 13 , wherein the touch data comprises at least one of: a drag signal, a tap signal a long tap signal, a double tap signal, or an edge scroll signal.
15. 15 . The method of claim 11 , wherein the pre-set event comprises at least one of: a pre-set area of a display of the terminal device being touched, a floating UI displayed on the display of the terminal device being touched, an area of the display of the terminal device being touched for a threshold time or more, a pre-set physical button of the terminal device being touched, or a pre-set UI displayed on the display of the terminal device being touched.
16. 16 . The method of claim 11 , further comprising: based on receiving the touch data comprising a user input received through a first area of a display of the terminal device, performing a function corresponding to the touch data; and based on the motion data being received based on a user input received through a second area of the display of the terminal device, controlling the pointer UI to move based on the motion data.
17. 17 . The method of claim 11 , further comprising: based on receiving the motion data obtained while a user input for selecting a floating UI displayed on the display of the terminal device is received, controlling the pointer UI to move based on the motion data.
18. 18 . The method of claim 11 , wherein the motion data comprises gyroscope data obtained through a gyroscope sensor in the terminal device or acceleration data obtained through an acceleration sensor in the terminal device.
19. 19 . The method of claim 11 , further comprising: adjusting a moving speed of the pointer UI based on movement pattern information of the pointer UI, wherein the movement pattern information of the pointer UI comprises information indicating a pattern by which the pointer UI is moved to select an object.
20. 20 . The method of claim 11 , further comprising: displaying identification information corresponding to the terminal device together with the pointer UI.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application is a bypass continuation of International Application No. PCT/KR2024/004962, filed on Apr. 11, 2025, which is based on and claims priority to Korean Patent Application No. 10-2024-0099574, filed on Jun. 26, 2024, in the Korean Intellectual Property Office, the disclosures of which are incorporated by reference herein in their entireties. TECHNICAL FIELD The disclosure relates to an electronic apparatus and a controlling method thereof. More specifically, the disclosure relates to an electronic apparatus that is controlled remotely according to commands received from an external device and a controlling method thereof. BACKGROUND ART A dedicated remote-control device for controlling an electronic apparatus including a display remotely may be used. A user may control the electronic apparatus through the remote-control device. However, there is a problem of not easily performing touch recognition if the remote-control device does not include the display. If there is a terminal device (e.g., smartphone) that recognizes a touch of a user, a user input may be received using a touch method. The terminal device may transmit a touch signal corresponding to the user input to the electronic apparatus. The electronic apparatus may perform a function corresponding to the user input based on the touch signal. However, there is a problem of moving a pointer displayed on the electronic apparatus being difficult if only the touch method is used. SUMMARY One or more embodiments can improve the above-mentioned problems, and one or more embodiments of the disclosure can provide an electronic apparatus that receives motion data according to a pre-set event from a terminal device, and moves a pointer UI based on the received motion data and a controlling method thereof. According to one or more examples embodiment, an electronic apparatus may include: memory that stores instructions; a communication interface configured to connect with a terminal device; a display; and at least one processor including processing circuitry, wherein the instructions, when executed individually or collectively by the at least one processor, cause the electronic apparatus to: control the display to display a screen including a plurality of objects and a pointer user interface (UI); receive, via the communication interface, touch data from the terminal device operating in a first mode or motion data from the terminal device operating in a second mode; based on the touch data being received, perform a function corresponding to the touch data; and based on the motion data being received, control the display to move the pointer UI based on the motion data, wherein the terminal device operates in the second mode based on a pre-set event. The instructions, when executed individually or collectively by the at least one processor, may further cause the electronic apparatus to: receive a notification from the terminal device via the communication interface, the notification indicating that an application for controlling the electronic apparatus has been executed; and based on the notification being received, control the display to display the pointer UI. The function corresponding to the touch data may include at least one of: moving the pointer UI, selecting an object corresponding to a position at which the pointer UI is displayed from the plurality of objects, displaying a home screen, displaying a previous screen, or scrolling a current screen. The touch data may include at least one of: a drag signal, a tap signal a long tap signal, a double tap signal, or an edge scroll signal. The pre-set event may include at least one of: a pre-set area of a display of the terminal device being touched, a floating UI displayed on the display of the terminal device being touched, an area of the display of the terminal device being touched for a threshold time or more, a pre-set physical button of the terminal device being touched, or a pre-set UI displayed on the display of the terminal device being touched. The instructions, when executed individually or collectively by the at least one processor, may further cause the electronic apparatus to: based on receiving the touch data including a user input received through a first area of a display of the terminal device, perform a function corresponding to the touch data; and based on the motion data being received based on a user input received through a second area of the display of the terminal device, control the display for the pointer UI to move based on the motion data. The instructions, when executed individually or collectively by the at least one processor, may further cause the electronic apparatus to: based on receiving the motion data obtained while a user input for selecting a floating UI displayed on the display of the terminal device is received, control the display for the pointer UI to move based on the motion data. The motion data may include gyro d