KR-102962525-B1 - ELECTRONIC DEVICE, AND METHOD FOR CONTROLLING AIR POINTER OF STYLUS'S PEN IN ELECTRONIC DEVICE

Abstract

An electronic device according to various embodiments includes a display and a processor, wherein the processor checks an air pointer start event of a stylus pen, displays the air pointer of the stylus pen on the display based on rotation information of the display and information of at least one application running on the electronic device, and when a selection event is received from the stylus pen, checks a first position information among a plurality of position information for the air pointer calculated according to the operation of the selection event, checks a first object set in an area including the first position information on the display based on information of at least one application running on the electronic device, and may be configured to perform a function of the first object corresponding to the selection event. Various other embodiments may be provided.

Inventors

• 권현웅
• 권방현
• 정인형
• 김상헌
• 임연욱

Assignees

• 삼성전자주식회사

Dates

Publication Date

20260511

Application Date

20201127

Claims (20)

1. In electronic devices, display; At least one processor; and It includes memory for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Check the stylus pen's air pointer start event, Based on rotation information of the display and information of at least one application running on the electronic device, the air pointer of the stylus pen is displayed on the display, and When a selection event generated by an input operation of a button provided on the stylus pen and an input release operation of the button is received from the stylus pen, the first position information of the air pointer at the time the button is input and the second position information of the air pointer at the time the button is input released are obtained and stored. When confirming the shape of a movement trajectory indicating that the stylus pen has shaken based on the pattern information of the stylus pen from the time when the first position information is stored to the time when the second position information is stored, the first position information among the first position information and the second position information is confirmed, and Based on information of at least one application running on the electronic device, a first object set in an area including the first location information on the display is identified, and An electronic device configured to perform the function of the first object corresponding to the above selection event.
2. In Article 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device configured to detect the occurrence of an air pointer start event of the stylus pen after the electronic device and the stylus pen are connected via near-field communication.
3. In Article 1, The above display rotation information is an electronic device including horizontal rotation information of the display or vertical rotation information of the display.
4. In Article 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, When checking the horizontal rotation information of the display from the rotation information of the display, the air pointer is displayed on the display while calculating the movement distance of the air pointer by multiplying the horizontal distance value among the movement distance values of the air pointer corresponding to the movement distance of the stylus pen by a fixed constant value. An electronic device configured to display the air pointer on the display while calculating the movement distance of the air pointer by multiplying the vertical distance value among the movement distance values of the air pointer corresponding to the movement distance of the stylus pen by a fixed constant value when checking the vertical rotation information of the display from the rotation information of the display.
5. In Article 1, The information of at least one application currently in execution includes an electronic device comprising type information of the application and information of a first object capable of executing a function.
6. In Article 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the information of at least one application currently running, determine whether the area where the air pointer of the stylus pen is located is the area of a first object capable of executing a function, and An electronic device configured to display the area of the first object as distinct from other areas when the area where the air pointer of the stylus pen is located is identified as the area of the first object.
7. delete
8. delete
9. In Article 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, An electronic device configured to determine whether an area containing the first location information is an area of the first object capable of executing a function, based on the information of at least one application currently in execution.
10. In Article 9, The area of the first object above is an electronic device that includes an area that is expanded by a certain amount compared to an area preset in the application.
11. A method for controlling an air pointer of a stylus pen in an electronic device, Action to check the air pointer start event of a stylus pen; An operation of displaying an air pointer of the stylus pen on the display based on rotation information of the display and information of at least one application running on the electronic device; When receiving a selection event generated by an input operation of a button provided on the stylus pen and an input release operation of the button from the stylus pen, the operation of acquiring and storing a first position information of the air pointer at the time the button is input and a second position information of the air pointer at the time the button is input released; When confirming the shape of a movement trajectory indicating that the stylus pen has shaken based on the pattern information of the stylus pen from the time when the first position information is stored to the time when the second position information is stored, an operation to confirm the first position information among the first position information and the second position information; An operation of identifying a first object set in an area including the first location information on the display based on information of at least one application running on the electronic device; and A method including an operation that performs the function of the first object corresponding to the above selection event.
12. In claim 11, the operation of confirming the air pointer start event is, A method including an operation to confirm the occurrence of an air pointer start event of the stylus pen after the electronic device and the stylus pen are connected via near-field communication.
13. In Article 11, A method in which the above display rotation information includes horizontal rotation information of the display or vertical rotation information of the display.
14. In claim 11, the operation of displaying the air pointer is, When horizontal rotation information of the display is confirmed from the rotation information of the display, an operation of displaying the air pointer on the display while calculating the movement distance of the air pointer by multiplying the horizontal distance value among the movement distance values of the air pointer corresponding to the movement distance of the stylus pen by a fixed constant value; and A method comprising the operation of displaying the air pointer on the display while calculating the movement distance of the air pointer by multiplying the vertical distance value among the movement distance values of the air pointer corresponding to the movement distance of the stylus pen by a fixed constant value when checking the vertical rotation information of the display from the rotation information of the display.
15. In Article 11, A method in which information of at least one application currently in execution includes type information of the application and information of a first object capable of executing a function.
16. In claim 11, the operation of displaying the air pointer is, Based on the information of at least one application currently running, an operation to determine whether the area where the air pointer of the stylus is located is the area of a first object capable of executing a function; and A method comprising the operation of identifying the area where the air pointer of the stylus pen is located as the area of the first object, and then marking the area of the first object to be distinguished from other areas.
17. delete
18. delete
19. In claim 11, the operation of verifying the first object is, A method comprising an operation to determine whether an area containing the first location information is an area of the first object capable of executing a function, based on the information of at least one application currently in execution.
20. In Article 19, The area of the first object above includes an area that is expanded by a certain amount compared to an area pre-set in the application.

Description

ELECTRONIC DEVICE, AND METHOD FOR CONTROLLING AIR POINTER OF STYLUS'S PEN IN ELECTRONIC DEVICE Various embodiments relate to an electronic device capable of clearly indicating pointing by an air pointer of a stylus pen in an electronic device, and a method capable of controlling an air pointer of a stylus pen in an electronic device. An electronic device is being developed to receive various inputs from a user through a specified input device (e.g., a stylus pen) connected to the electronic device via wireless communication. The electronic device can identify a location on the electronic device designated by an input device having pen functionality (hereinafter referred to as a "stylus pen" for convenience of explanation) and can perform a corresponding function. The above-mentioned stylus pen may include wireless communication and provides various functions, such as pressure information of the stylus pen, battery status information, or event information based on button input, through a display of an electronic device linked to the stylus pen. In addition, the stylus pen may provide an air gesture function, and the air gesture function may include a button press function and a gesture function. When a button press occurs on the stylus pen, a function mapped to a single press and/or double press may be executed on the electronic device, and when a gesture occurs on the stylus pen, a function mapped to left/right, up/down, and/or rotation may be executed on the electronic device. For example, while running a camera application on an electronic device, if a gesture operation such as clockwise or counterclockwise occurs on the stylus pen, the electronic device can perform a zoom in/out function. Alternatively, if a single press is detected by a button provided on the stylus pen, the electronic device can perform a camera capture function, and if a double press is detected, it can perform a function to switch between the front and rear cameras. In addition, the above-mentioned stylus pen may be provided with an air pointer that moves according to the movement of the pen, similar to a pointer displayed using a standard mouse, and the air pointer may be displayed differently depending on the type of application running on the electronic device or the type of object included in the running application. FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a perspective view of an electronic device including a stylus pen according to various embodiments. FIG. 3a is a block diagram illustrating a stylus pen according to various embodiments. FIG. 3b is an exploded perspective view of a stylus pen according to various embodiments. FIG. 4 is a block diagram illustrating an electronic device according to various embodiments. FIGS. 5a to 5c are drawings for explaining the operation of processing an event received from a stylus pen in an electronic device according to various embodiments. FIG. 6 is a diagram illustrating the configuration of a software module of an electronic device according to various embodiments. FIG. 7 is a drawing for explaining a Stylus Pointer Movement Manager (SPMM) in an electronic device according to various embodiments. FIG. 8 is a drawing for explaining a first object in an electronic device according to various embodiments. FIGS. 9a and 9b are drawings for illustrating the representation of a plurality of applications in an electronic device according to various embodiments. FIGS. 10a to 10c are drawings for illustrating the execution of a selection event received from a stylus pen in an electronic device according to various embodiments. FIGS. 11a and 11b are drawings for illustrating the selection of a first object in an electronic device according to various embodiments. FIG. 12 is a flowchart illustrating the operation of controlling the air pointer of a stylus pen in an electronic device according to various embodiments. FIG. 13 is a flowchart for explaining the display operation of the air pointer during the operation of controlling the air pointer of a stylus pen in an electronic device according to various embodiments. FIG. 14 is a flowchart for explaining the execution operation of a first object on which the air pointer is located during the operation of controlling the air pointer of a stylus pen in an electronic device according to various embodiments. FIG. 1 is a block diagram (100) of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic devic