Search

EP-4035017-B1 - AUGMENTING REALITY BY CAPTURING SIGNALS USING WIRELESS RADIOS

EP4035017B1EP 4035017 B1EP4035017 B1EP 4035017B1EP-4035017-B1

Inventors

  • BENOLIEL, Micha, Anthenor
  • KINSMAN, Garrett, Edward

Dates

Publication Date
20260506
Application Date
20200925

Claims (15)

  1. A method, comprising: providing a short-range network; receiving (305) a wireless signal from a device within an environment and via the short-range network; identifying (310) the device based on at least one of data and metadata included in the wireless signal; determining (315) a location of the device relative to at least two other devices within the environment, the at least two other devices being communicatively coupled to the short-range network and being configured as crowd-sourced intermediate devices; and displaying (320) an augmented environment representative of the environment and a symbol representative of the device within the augmented environment, the symbol being displayed in a location within the augmented environment corresponding to the location of the device within the environment.
  2. The method of claim 1, wherein the metadata included in the wireless signal comprises: a type of signal for the wireless signal; and a communication protocol for the wireless signal.
  3. The method of claim 1, wherein the data included in the wireless signal comprises a device identifier.
  4. The method of claim 1, wherein the data included in the wireless signal comprises characteristic descriptions of the device.
  5. The method of claim 1, wherein the data included in the wireless signal comprises information pertaining to purchasing the device or a service related to the device.
  6. The method of claim 1, wherein the method is performed by a mobile device configured to move at least within the environment.
  7. The method of claim 1, wherein displaying the augmented environment representative of the environment comprises constructing a three-dimensional representation of the environment in the augmented environment including the device.
  8. The method of claim 1, wherein the environment includes a shopping area and the device is embedded in a storefront, the data included in the wireless signal comprises at least one of sales descriptions, goods descriptions, and service descriptions available in a store corresponding to the storefront.
  9. The method of claim 1, wherein the environment includes a shopping area and the device is embedded in a shelf storing food goods, the data included in the wireless signal comprises at least one of nutritional values, ingredients, and health ratings of the food goods.
  10. The method of claim 1, wherein the environment includes a road system and the device is embedded in a vehicle using the road system, the data included in the wireless signal comprises at least one of a history, identifying information of a driver and identifying information of the vehicle.
  11. The method of claim 1, wherein the environment includes a medical facility and the device is embedded in a clothing article associated with a patient, the data included in the wireless signal comprises at least one of identifying information of, medical history of, and medications taken by the patient.
  12. The method of claim 1, wherein the environment includes a medical facility and the device is embedded in a medical device, the symbol representative of the device is displayed in the augmented environment to track the medical device and to ensure that the medical device is not misplaced.
  13. The method of claim 1, wherein the environment includes an educational facility and the device is embedded in an object associated with a student, the method further comprising marking the student present based on the wireless signal.
  14. The method of claim 1, wherein the data included in the wireless signal comprises a published MAC address of the device, the method further comprising determining the published MAC address of the device.
  15. The method of claim 1, wherein the environment includes a residential building and the device includes a sensor physically attached to a non-computing device.

Description

BACKGROUND The present disclosure generally relates to augmenting reality. In particular, the present disclosure describes systems and methods to augment reality by capturing signals using wireless radios. Augmented reality (AR) and virtual reality (VR) include the practice of augmenting or replacing the real world with simulated elements or an entire simulated world. In addition, AR and VR may be used to enhance perceived reality of a user with additional graphics, text, sounds, video, etc. For example, AR and/or VR may add game characters to a simulated world, avatars of other users, etc. Accordingly, the present disclosure relates to augmenting reality by identifying devices by capturing signals using wireless radios. The claimed subject matter is not limited to embodiments that solve any disadvantages or that operate only in environments such as those described above. This background is only provided to illustrate examples of where the present disclosure may be utilized. US 2017/0228935 A1 relates to augmented reality based on wireless ranging. US 2015/0029220 A1 relates to detecting and visualizing wireless network devices in communication networks. SUMMARY The present disclosure generally relates to augmenting reality. In particular, the present disclosure describes systems and methods to augment reality by identifying devices by capturing signals using wireless radios. The invention is defined by the subject matter of independent claim 1. In one example, a method may include receiving a wireless signal from a device. The device may be within an environment. The method may also include identifying the device. The device may be identified based on at least one of data and metadata included in the wireless signal. In addition, the method may include determining a location of the device within the environment. The location of the device within the environment may be determined based on the data included the wireless signal. Further, the method may include displaying an augmented environment representative of the environment and a symbol representative of the device within the augmented environment. The symbol may be displayed in a location within the augmented environment corresponding to the location of the device within the environment. In another example, a method may include receiving a first wireless signal from a first device. The first device may be within an environment. The method may also include receiving a second wireless signal from a second device. The second device may also be within the environment. In addition, the method may include identifying the first device. The first device may be identified based on at least one of data and metadata included in the first wireless signal. Further, the method may include identifying the second device. The second device may be identified based on at least one of data and metadata included in the second wireless signal. The method may include determining locations of the first device and second device within the environment. The location of the first device and the second device may be determined based on the first and second wireless signal. The method may also include displaying an augmented environment. The augmented environment may be representative of the environment and may include symbols representative of the first device and the second device. The symbols may be displayed in locations within the augmented environment corresponding to the locations of the first device and the second device within the environment. This Summary introduces a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential characteristics of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 illustrates an example network architecture;Figure 2 illustrates an example environment for augmenting reality by capturing signals using wireless radios;Figure 3 is a flow diagram of an example method to augment reality by capturing signals using wireless radios; andFigure 4 is a diagrammatic representation of a machine in the example form of a computing device within which a set of instructions, for causing the machine to perform any one or more of the methods discussed herein, may be executed. DETAILED DESCRIPTION Reference will be made to the drawings and specific language will be used to describe various aspects of the disclosure. Using the drawings and description in this manner should not be construed as limiting its scope. Additional aspects may be apparent in light of the disclosure, including the claims, or may be learned by practice. As the number of wireless devices using standardized communication protocols (e.g., Bluetooth®) increase and the cost of producing the wireless devices decrease so do the possibilities of augmenting reality using wire