Search

KR-20260067937-A - ELECTRONIC DEVICE, METHOD, AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM FOR ESTABLISHING COMMUNICATION LINK WITH EXTERNAL ELECTRONIC DEVICE

KR20260067937AKR 20260067937 AKR20260067937 AKR 20260067937AKR-20260067937-A

Abstract

An electronic device comprises at least one processor including a processing circuit, a display, at least one camera, a communication circuit, and a memory including one or more storage media configured to store one or more programs configured to be executed individually or collectively by said at least one processor, wherein the one or more programs may include instructions that cause said electronic device to establish a communication link by using said at least one camera while displaying a preview image based on detecting an event related to the establishment of a communication link, identifying a first user input to be received to establish a communication link with said external electronic device based on the type of said external electronic device, identifying a second user input received regarding said external electronic device, displaying information guiding said first user input based on said second user input which is different from said first user input, and causing said electronic device to establish said communication link based on said second user input corresponding to said first user input.

Inventors

  • 장유나
  • 김현철
  • 박상현
  • 박정민
  • 이선기

Assignees

  • 삼성전자주식회사

Dates

Publication Date
20260513
Application Date
20241204
Priority Date
20241106

Claims (20)

  1. In the electronic device (200), At least one processor (210) including a processing circuit; Display (240); At least one camera (250); communication circuit (230); and The memory (220) includes one or more programs configured to be executed individually or collectively by at least one processor (210), and includes one or more storage media. The above one or more programs are: Detecting an event related to establishing a communication link using the above at least one camera (250); Based on the above detection, a preview image is displayed through the display (240) using the at least one camera (250) activated based on the event; While displaying the above preview image, identify an external electronic device (205) located within the field of view (FOV) (505) of at least one camera (250); Based on the type of the external electronic device (205), identify a first user input to be received with respect to the external electronic device (205) in order to establish a communication link with the external electronic device (205); While displaying the above preview image, using the at least one camera (250), a second user input received with respect to the external electronic device (205) is identified; Determining whether the second user input identified using the at least one camera (250) while displaying the above preview image corresponds to the first user input identified based on the type of the external electronic device (205); Based on determining the second user input different from the first user input, information (905) guiding the first user input is displayed through the display (240) along with the preview image; and Based on determining the second user input corresponding to the first user input, to establish the communication link with the external electronic device (205), Instructions including those that cause the above electronic device (200), Electronic device (200).
  2. In claim 1, The above one or more programs are: While displaying the above information (905), using the at least one camera (250), a third user input received with respect to the external electronic device (205) is identified; Determining whether the third user input identified using the at least one camera (250) while displaying the above information (905) corresponds to the first user input identified based on the type of the external electronic device (205); Based on determining the third user input which is different from the first user input, other information (1115) guiding a change from the third user input to the first user input is displayed through the display (240) along with the preview image; and Based on determining the third user input corresponding to the first user input, to establish the communication link with the external electronic device (205), Instructions including those that cause the above electronic device (200), Electronic device (200).
  3. In claim 1, The above one or more programs are: Based on the type of the external electronic device (205), identify a first state of the electronic device (200) capable of establishing a communication link with the external electronic device (205); While displaying the above preview image, identify a second state of the electronic device (200) regarding the establishment of a communication link; Determining whether the second state of the electronic device (200) identified while displaying the above preview image corresponds to the first state of the electronic device (200) identified based on the type of the external electronic device (205); Based on determining the second state of the electronic device (200) which is different from the first state of the electronic device (200), other information (705) guiding the first state of the electronic device (200) is displayed through the display (240); and Based on determining the second state of the electronic device (200) corresponding to the first state of the electronic device (200), to identify the first user input, including instructions that cause the above electronic device (200), Electronic device (200).
  4. In claim 1, The above one or more programs are: While determining the second user input corresponding to the first user input, the communication circuit (230) is used to receive an advertised advertising packet from the external electronic device (205); Based on receiving the above advertising packet, using the communication circuit (230), transmit a connection request to the external electronic device (205) to establish the communication link; and Based on transmitting the above connection request, to establish the above communication link, Instructions including those that cause the above electronic device (200), Electronic device (200).
  5. In claim 4, The type of the above external electronic device (205) is, It is Type 1, and The above advertising packet is, Indicating the second type of the above external electronic device (205), The above one or more programs are: Based on receiving the advertising packet, determining whether the second type of the external electronic device (205) indicated by the advertising packet corresponds to the first type of the external electronic device (205) identified using the at least one camera (250); and Based on determining the second type of the external electronic device (205) corresponding to the first type of the external electronic device (205), the communication circuit (230) is used to transmit the connection request to the external electronic device (205). Instructions including those that cause the above electronic device (200), Electronic device (200).
  6. In claim 4, The above advertising packet is, Indicates a first point in time when the above advertising packet was transmitted, and The above one or more programs are: Based on receiving the advertising packet, determining whether the first time point in which the advertising packet indicated by the advertising packet was transmitted corresponds to the second time point in which the second user input corresponding to the first user input was determined; and Based on determining the first time point corresponding to the second time point, the communication circuit (230) is used to transmit the connection request to the external electronic device (205). Instructions including those that cause the above electronic device (200), Electronic device (200).
  7. In claim 1, The above one or more programs are: Based on determining the second user input different from the first user input, a prompt is generated indicating the type of the external electronic device (205), the first user input, and/or the second user input; The above information (905) is obtained by providing the above prompt to the trained model; and In order to display the information (905) together with the preview image through the display (240), Instructions including those that cause the above electronic device (200), Electronic device (200).
  8. In claim 2, The above one or more programs are: Based on determining the third user input different from the first user input, generate a prompt indicating the type of the external electronic device (205), the first user input, and/or the third user input; By providing the above prompt to the trained model, the above other information (1115) is obtained; and To display the other information (1115) together with the preview image through the display (240), Instructions including those that cause the above electronic device (200), Electronic device (200).
  9. In claim 1, The above one or more programs are: Based on determining the second user input which is different from the first user input, the information (905) is superimposed and displayed on the preview image through the display (240). Instructions including those that cause the above electronic device (200), Electronic device (200).
  10. In claim 1, The above one or more programs are: Based on determining the second user input different from the first user input, the preview image and the information (905) are simultaneously displayed in a split view through the display (240). Instructions including those that cause the above electronic device (200), Electronic device (200).
  11. A method to be executed within an electronic device (200) comprising a display (240), at least one camera (250), and a communication circuit (230), wherein the method comprises: An operation to detect an event related to establishing a communication link using at least one camera (250); Based on the above detection, an operation of displaying a preview image through the display (240) using the at least one camera (250) activated based on the event; An operation to identify an external electronic device (205) located within the field of view (FOV) (505) of at least one camera (250) while displaying the above preview image; An operation to identify a first user input to be received with respect to the external electronic device (205) in order to establish a communication link with the external electronic device (205) based on the type of the external electronic device (205); While displaying the above preview image, the operation of identifying a second user input received with respect to the external electronic device (205) using the at least one camera (250); An operation to determine whether the second user input identified using the at least one camera (250) while displaying the above preview image corresponds to the first user input identified based on the type of the external electronic device (205); Based on determining the second user input different from the first user input, the operation of displaying information (905) guiding the first user input together with the preview image through the display (240); and Based on determining the second user input corresponding to the first user input, the operation of establishing the communication link with the external electronic device (205) is included. method.
  12. In claim 11, the method is: An operation to identify a third user input received with respect to the external electronic device (205) using the at least one camera (250) while displaying the above information (905); An operation to determine whether the third user input identified using the at least one camera (250) while displaying the above information (905) corresponds to the first user input identified based on the type of the external electronic device (205); Based on determining the third user input which is different from the first user input, the operation of displaying other information (1115) that guides a change from the third user input to the first user input, together with the preview image, through the display (240); and Based on determining the third user input corresponding to the first user input, the operation of establishing the communication link with the external electronic device (205) is included. method.
  13. In claim 11, the method is: An operation to identify a first state of the electronic device (200) capable of establishing a communication link with the external electronic device (205) based on the type of the external electronic device (205); An operation to identify a second state of the electronic device (200) regarding the establishment of a communication link while displaying the above preview image; An operation to determine whether the second state of the electronic device (200) identified while displaying the above preview image corresponds to the first state of the electronic device (200) identified based on the type of the external electronic device (205); An operation of displaying other information (705) that guides the first state of the electronic device (200) through the display (240), based on determining the second state of the electronic device (200) which is different from the first state of the electronic device (200); and An operation including identifying the first user input based on determining the second state of the electronic device (200) corresponding to the first state of the electronic device (200). method.
  14. In claim 11, the method is: While determining the second user input corresponding to the first user input, the operation of receiving an advertised advertising packet from the external electronic device (205) using the communication circuit (230); Based on receiving the advertising packet, the operation of transmitting a connection request to the external electronic device (205) to establish the communication link using the communication circuit (230); and Based on transmitting the above connection request, the operation of establishing the above communication link, method.
  15. In claim 14, The type of the above external electronic device (205) is, It is Type 1, and The above advertising packet is, Indicating the second type of the above external electronic device (205), The above method is: Based on receiving the advertising packet, an operation to determine whether the second type of the external electronic device (205) indicated by the advertising packet corresponds to the first type of the external electronic device (205) identified using the at least one camera (250); and Based on determining the second type of the external electronic device (205) corresponding to the first type of the external electronic device (205), the operation of transmitting the connection request to the external electronic device (205) using the communication circuit (230) is included. method.
  16. In claim 14, The above advertising packet is, Indicates a first point in time when the above advertising packet was transmitted, and The above method is: An operation to determine, based on receiving the advertising packet, whether the first time point in which the advertising packet indicated by the advertising packet was transmitted corresponds to the second time point in which the second user input corresponding to the first user input was determined; and Based on determining the first time point corresponding to the second time point, the operation of transmitting the connection request to the external electronic device (205) using the communication circuit (230) method.
  17. In claim 11, the method is: An operation to generate a prompt indicating the type of the external electronic device (205), the first user input, and/or the second user input, based on determining the second user input which is different from the first user input; The operation of obtaining the information (905) by providing the above prompt to a trained model; and The method includes the operation of displaying the information (905) together with the preview image through the display (240). method.
  18. In claim 12, the method is: An operation to generate a prompt indicating the type of the external electronic device (205), the first user input, and/or the third user input, based on determining the third user input which is different from the first user input; The operation of obtaining the other information (1115) by providing the above prompt to the trained model; and The operation of displaying the other information (1115) together with the preview image through the display (240), method.
  19. In claim 11, the method is: Based on determining the second user input different from the first user input, the method includes the operation of superimposing the information (905) onto the preview image through the display (240). method.
  20. In claim 11, the method is: Based on determining the second user input different from the first user input, the operation of displaying the preview image and the information (905) in a split view through the display (240) method.

Description

ELECTRONIC DEVICE, METHOD, AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM FOR ESTABLISHING COMMUNICATION LINK WITH EXTERNAL ELECTRONIC DEVICE The present disclosure relates to an electronic device, a method, and a non-transient computer-readable storage medium for establishing a communication link with an external electronic device. Bluetooth )(or legacy Bluetooth(legacy Bluetooth Bluetooth (or Classic Bluetooth) is a short-range wireless technology standard used for data exchange between electronic devices. Bluetooth can be provided over the ISM (industrial, scientific, and medical) radio band. For example, Bluetooth can be used to exchange text information, voice information, and/or audio information via wireless communication between electronic devices. The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure. Figure 1 illustrates examples of user inputs received with respect to an external electronic device. Figure 2 is a simplified block diagram of an exemplary electronic device and an external electronic device. FIG. 3 is a flowchart illustrating exemplary operations of an electronic device for identifying the state of an electronic device capable of establishing a communication link with an external electronic device. FIG. 4 illustrates an example of detecting events related to establishing a communication link using at least one camera. FIG. 5 illustrates an example of identifying an external electronic device located within the field of view (FOV) of at least one camera. FIG. 6 is a flowchart illustrating exemplary operations of an electronic device for identifying user input to be received with respect to an external electronic device in order to establish a communication link with an external electronic device based on the state of the electronic device capable of establishing a communication link with an external electronic device. FIG. 7 illustrates an example of information guiding the state of an electronic device capable of establishing a communication link with an external electronic device. FIG. 8 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device. FIG. 9 illustrates an example of information for guiding user input to be received regarding an external electronic device in order to establish a communication link with the external electronic device. FIG. 10 is a flowchart illustrating exemplary operations of an electronic device for displaying information to guide changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device. FIG. 11 illustrates an example of information for guiding changes to user input to be received regarding an external electronic device in order to establish a communication link with an external electronic device. FIG. 12 is a signal flow diagram between an exemplary electronic device and an external electronic device for establishing a communication link. FIG. 13 illustrates an example of establishing a communication link with an external electronic device using an external electronic device identified using at least one camera and an advertising packet advertised from the external electronic device. FIG. 14 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 15 illustrates an example of a generative artificial intelligence system according to one embodiment. Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity. Figure 1 illustrates examples of user inputs received with respect to an external electronic device. Referring to FIG. 1, the electronic device (100) may be described as a device available for establishing a communication link with an external electronic device (105). For example, the electronic device (100) may be one of various types of mobile devices such as smartphones having various form factors (e.g., bar-type smartphones, foldable-type smartphones, or rollable-type smartphones), tablets, wearable devices, cellular phones, personal computers (PCs) (e.g., laptops and/or desktops), and/or o