Search

EP-4738071-A1 - ELECTRONIC DEVICE, METHOD, AND COMPUTER-READABLE STORAGE MEDIUM FOR CONTROLLING EXTERNAL ELECTRONIC DEVICE TO OUTPUT VIBRATIONS

EP4738071A1EP 4738071 A1EP4738071 A1EP 4738071A1EP-4738071-A1

Abstract

A wearable device may include a communication circuit, a display, and at least one processor. The wearable device can display a graphic effect, which spreads out into an external space from a first location spaced apart from the wearable device, on the display in response to an event that occurs at the first location and causes the output of vibrations. The wearable device can determine the distance between the first location and a second location of an external electronic device spaced apart from the wearable device. The wearable device, on the basis of determining the distance, can identify the point in time at which at least a portion of the graphic effect intersects with the second location. The present document may relate to a metaverse service for enhancing the interconnectivity between a real object and a virtual object. For example, the metaverse service may be provided over a fifth generation (5G) and/or sixth generation (6G)-based network.

Inventors

  • YIM, Sunghoon
  • KIM, HYUNSOO
  • NAM, MYOUNGWOO
  • SHIM, Jeaguk
  • YOO, NAGYEOM
  • LEE, YOONHO

Assignees

  • Samsung Electronics Co., Ltd.

Dates

Publication Date
20260506
Application Date
20240523

Claims (15)

  1. A wearable device (101), comprising: communication circuitry (135); a display (120); and at least one processor (110) including processing circuitry; memory (115) comprising one or more storage media storing instructions; wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: display a graphic effect (410; 606) spreading from a first point to an external space, on the display, in response to an event that occurs at the first point (420; 501; 602; 702) separated from the wearable device and causes an output on vibration; identify a distance (420-1) between the first point and a second point (420; 502; 603) of an external electronic device separated from the wearable device; identify a time point (421-1) at which at least a portion of the graphic effect intersects the second point based on identifying the distance; and transmit, through the communication circuitry, a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device.
  2. The wearable device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: obtain first haptic pattern information (183-1) indicating the vibration related to the event, based on identifying the event, and display the graphic effect on the display, based on the first haptic pattern information.
  3. The wearable device of any one of claims 1 and 2, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: change the first haptic pattern information to second haptic pattern information (183-2) for controlling the actuator of the external electronic device based on at least one of a type of the external electronic device and the distance; and transmit, to the external electronic device, prior to the time point, the signal requesting to output the vibration based on the magnitude corresponding to the second haptic pattern information at the time point.
  4. The wearable device of any one of claims 1 to 3, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: change the first haptic pattern information to the second haptic pattern information having a second vibration intensity smaller than a first vibration intensity corresponding to the first haptic pattern information, based on the distance.
  5. The wearable device of any one of claims 1 and 4, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: identify the event indicating contact between at least one body part of a user of the wearable device and a virtual object (415; 701) displayed on the display, and obtain the first haptic pattern information based on a type of the virtual object.
  6. The wearable device of any one of claims 1 to 5, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: change the first haptic pattern information to the second haptic pattern information, based on user perception information (181) related to vibration.
  7. The wearable device of any one of claims 1 to 6, wherein the user perception information is obtained based on a user interface (910) for identifying an intensity of vibration generated by the external electronic device at a body part of a user wearing the external electronic device according to the type of the external electronic device.
  8. The wearable device of any one of claims 1 and 7, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: transmit the signal causing the external electronic device to output vibration corresponding to the second haptic pattern information while at least a portion of the graphic effect is included in an area corresponding to the second point.
  9. A method of a wearable device (101), the method comprises: displaying a graphic effect (410; 606) spreading from a first point to an external space, on a display (120), in response to an event that occurs at the first point (420; 501; 602; 702) separated from the wearable device and causes an output on vibration; identifying a distance (420-1) between the first point and a second point (420; 502; 603) of an external electronic device separated from the wearable device; identifying a time point (421-1) at which at least a portion of the graphic effect intersects the second point based on identifying the distance; and transmitting, through communication circuitry (135), a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device.
  10. The method of claim 9, displaying the graphic effect comprises: obtaining first haptic pattern information (183-1) indicating the vibration related to the event, based on identifying the event, and displaying the graphic effect on the display, based on the first haptic pattern information.
  11. The method of any one of claims 9 and 10, transmitting the signal comprises: changing the first haptic pattern information to second haptic pattern information (183-2) for controlling the actuator of the external electronic device based on at least one of a type of the external electronic device and the distance; and transmitting, to the external electronic device, prior to the time point, the signal requesting to output the vibration based on the magnitude corresponding to the second haptic pattern information at the time point.
  12. The method of any one of claims 9 to 11, changing to the second haptic pattern information comprises: changing the first haptic pattern information to the second haptic pattern information having a second vibration intensity smaller than a first vibration intensity corresponding to the first haptic pattern information, based on the distance.
  13. The method of any one of claims 9 to 12, obtaining the first pattern information comprises: identifying the event indicating contact between at least one body part of a user of the wearable device and a virtual object (415; 701) displayed on the display, and obtaining the first haptic pattern information based on a type of the virtual object.
  14. The method of any one of claims 9 to 13, changing to the second haptic pattern information comprises: changing the first haptic pattern information to the second haptic pattern information, based on user perception information (181) related to vibration.
  15. A computer readable storage medium storing instructions, wherein the instructions, when executed by a processor of a wearable device, cause the wearable device to: display a graphic effect (410; 606) spreading from a first point to an external space, on a display (120), in response to an event that occurs at the first point (420; 501; 602; 702) separated from the wearable device and causes an output on vibration; identify a distance (420-1) between the first point and a second point (420; 502; 603) of an external electronic device separated from the wearable device; identify a time point (421-1) at which at least a portion of the graphic effect intersects the second point based on identifying the distance; and transmit, through communication circuitry (135), a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device.

Description

[Technical Field] The present disclosure relates to an electronic device, a method, and a computer readable storage medium for controlling an external electronic device to output vibration. [Background Art] In order to provide an enhanced user experience, an electronic device providing an extended reality (XR) service displaying information generated by a computer in connection with an external object in a real-world are being developed. The electronic device may provide the extended reality service to a user, using a virtual object corresponding to the user. [Disclosure] [Technical Solution] According to an embodiment, in a wearable device, the wearable device may comprise communication circuitry, a display, at least one processor including processing circuitry, and memory comprising one or more storage media storing instructions. The instructions, when executed by the at least one processor individually or collectively, may cause the electronic device to display a graphic effect spreading from a first point to an external space, on the display, in response to an event that occurs at the first point separated from the wearable device and causes an output on vibration. The instructions, when executed by the at least one processor individually or collectively, may cause the electronic device to identify a distance between the first point and a second point of an external electronic device separated from the wearable device. The instructions, when executed by the at least one processor individually or collectively, may cause the electronic device to identify a time point at which at least a portion of the graphic effect intersects the second point based on identifying the distance. The instructions, when executed by the at least one processor individually or collectively, may cause the electronic device to transmit, through the communication circuitry, a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device. According to an embodiment, in a method of a wearable device, the method may comprise displaying a graphic effect spreading from a first point to an external space, on a display, in response to an event that occurs at the first point separated from the wearable device and causes an output on vibration. The method may comprise identifying a distance between the first point and a second point of an external electronic device separated from the wearable device. The method may comprise identifying a time point at which at least a portion of the graphic effect intersects the second point based on identifying the distance. The method may comprise transmitting, through communication circuitry, a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device. According to an embodiment, in a computer readable storage medium storing instructions, the instructions, when executed by a processor of a wearable device, may cause the wearable device to display a graphic effect spreading from a first point to an external space, on a display, in response to an event that occurs at the first point separated from the wearable device and causes an output on vibration. The instructions executed by the processor may cause the wearable device to identify a distance between the first point and a second point of an external electronic device separated from the wearable device. The instructions executed by the processor may cause the wearable device to identify a time point at which at least a portion of the graphic effect intersects the second point based on identifying the distance. The instructions executed by the processor may cause the wearable device to transmit, through communication circuitry, a signal for controlling an actuator of the external electronic device to output vibration having a magnitude determined based on the distance at the time point to the external electronic device. [Description of the Drawings] FIGS. 1A and 1B illustrate an example of a block diagram of a wearable device and an external electronic device according to an embodiment.FIG. 2A illustrates an example of a perspective view of a wearable device according to an embodiment.FIG. 2B illustrates an example of one or more hardware disposed in a wearable device according to an embodiment.FIGS. 3A to 3B illustrate an example of an exterior of a wearable device according to an embodiment.FIG. 4 illustrates an example of an operation in which a wearable device according to an embodiment controls an external electronic device based on a distance between a point of an event and a point of an external electronic device.FIG. 5 illustrates an example of an operation in which a wearable device according to an embodiment controls an external electronic device based on an event.FIG. 6 illustrates