EP-4742019-A2 - WEARABLE COMPUTING DEVICE WITH ELECTROPHYSIOLOGICAL SENSORS

Abstract

A wearable computing device with bio-signal sensors and a feedback module provides an interactive mediated reality ("VR") environment for a user. The bio-signal sensors receive bio-signal data (for example, brainwaves) from the user and include bio-signal sensors embedded in a display isolator, having a deformable surface, and having an electrode extendable to contact the user's skin. The wearable computing device further includes a processor to: present content in the VR environment via the feedback module; receive bio-signal data of the user from the bio-signal sensor; process the bio-signal data to determine user states of the user, including brain states, using a user profile; modify a parameter of the content in the VR environment in response to the user states of the user. The user receives feedback indicating the modification of the content via the feedback module.

Inventors

• AIMONE, Christopher Allen
• MACKENZIE, Samuel Thomas
• JACOB BANVILLE, Hubert
• PROULX, Nicole Helene
• MOFFAT, GRAEME DANIEL

Assignees

• InteraXon Inc.

Dates

Publication Date

20260513

Application Date

20180530

Claims (15)

1. A mediated reality device comprising: a wearable computing device with a bio-signal sensor, at least one feedback module to provide an interactive mediated reality environment for a user, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor, wherein the wearable computing device comprises: a face pad comprising an exterior surface, wherein the pad is configured to compress when affixed to the user's head, such that the pad conforms to at least a part of the user's face, wherein the pad comprises the at least one bio-signal sensor and the at least one bio-signal sensor is disposed thereon; wherein the computing device is in communication with a processor configured to: as part of the interactive mediated reality environment, present content via the at least one feedback module; receive user manual inputs from the input device for creating or modifying an object in the interactive mediated reality environment; receive the bio-signal data of the user from the bio-signal sensor; process the bio-signal data to determine user states of the user, including brain states, the user states processed using a user profile stored in a data storage device accessible by the processor and the user states including brain states; modify a property of the object according to the bio-signal data of the user to update the interactive mediated reality environment.
2. The mediated reality device of claim 1, wherein the at least one feedback module is coupled to the face pad.
3. The mediated reality device of claim 1, wherein the face pad comprises an interior matrix; optionally wherein a flexible printed circuit board is disposed within the interior matrix.
4. The mediated reality device of claim 1, wherein the face pad further comprises at least one of display isolator, an optical sensor, a heart sensor, a pressure or strain sensor, or an eye tracker.
5. The mediated reality device of claim 1, wherein the face pad is detachably attached to the wearable computing device.
6. The mediated reality device of claim 1, the at least one bio-signal sensor comprises at least one of electrodes distributed along the face pad and spaced apart or a conductive coating applied to the exterior surface.
7. The mediated reality device of claim 1, further comprising an electrical signal generator.
8. A bio-signal sensor comprising: a face pad comprising an exterior surface, where the pad is configured to compress when affixed to the user's head, such that the pad conforms to at least a part of the user's face, wherein the pad comprises the bio-signal sensor and the bio-signal sensor disposed thereon, and wherein the face pad comprises an interior matrix.
9. The bio-signal sensor of claim 8, wherein at least one feedback module is coupled to the face pad.
10. The bio-signal sensor of claim 8, wherein a flexible printed circuit board is disposed within the interior matrix.
11. The bio-signal sensor of claim 8, wherein the face pad further comprises at least one of a display isolator, an optical sensor, a heart sensor, a pressure or strain sensor, or an eye tracker.
12. The bio-signal sensor of claim 8, wherein the face pad is configured to detachably attach to a wearable computing device.
13. The bio-signal sensor of claim 8, wherein the bio-signal sensor comprises a conductive coating applied to the exterior surface.
14. The bio-signal sensor of claim 8, wherein the bio-signal sensor comprises electrodes distributed along the face pad and spaced apart.
15. The bio-signal sensor of claim 8, further comprising an electrical signal generator.

Description

This application claims priority from US Provisional Patent Application No. 62/512,555 filed on May 30, 2017, and US Provisional Patent Application No. 62/613,492 filed on January 4, 2018, the contents of which are hereby incorporated by reference. FIELD The present invention relates to wearable devices. This invention relates more particularly to sensors for wearable devices and wearable devices with brain sensors. Even more particularly, this invention relates to wearable devices with brain sensors and methods for use in mediated reality environments. BACKGROUND A user may interact with a computing device for example using a keyboard, mouse, track pad, touch screen, or motion-capture devices. As the ways in which humans interact with computing devices change, computers may become usable for new purposes, or more efficient in performing existing tasks. A user command to a computing device that may require several commands on a keyboard may be instead associated with a single hand gesture captured and processed by a motion-capture input device. As the human body has many parts which may be controlled through voluntary movement, there are opportunities for capturing and interpreting other movements for interacting with a computing device. Bio-signals are signals that are generated by biological beings that can be measured and monitored. Electroencephalographs, galvanometers, and electrocardiographs are examples of devices that are used to measure and monitor bio-signals generated by humans. A human brain generates bio-signals such as electrical patterns, which may be measured/monitored using an electroencephalogram ("EEG"). These electrical patterns, or brainwaves, are measurable by devices such as an EEG. Typically, an EEG will measure brainwaves in an analog form. Then, these brainwaves may be analyzed either in their original analog form or in a digital form after an analog to digital conversion. Measuring and analyzing bio-signals such as brainwave patterns can have a variety of practical applications. For example, brain computer interfaces ("BCI") allow users to control devices and computers using brainwave signals. SUMMARY In accordance with an aspect of the present invention, there is provided a mediated reality device comprising: an input device and a wearable computing device with a bio-signal sensor, a display to provide an interactive mediated reality environment for a user, and a display isolator, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor, wherein the bio-signal sensor is embedded in the display isolator, wherein the bio-signal sensor includes a soft, deformable user-contacting surface. In accordance with an aspect of the present invention, there is provided a mediated reality device comprising: an input device and a wearable computing device with a bio-signal sensor, at least one feedback module to provide an interactive mediated reality environment for a user, and a contact adjuster for adjusting contact between the bio-signal sensor and the user, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor. In accordance with an aspect of the present invention, there is provided a mediated reality device comprising: an input device and a wearable computing device with a bio-signal sensor, at least one feedback module to provide an interactive mediated reality environment for a user, and a conduction medium applicator for applying a conduction medium to a user contacting surface of the bio-signal sensor, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor. In accordance with an aspect of the present invention, there is provided a mediated reality device comprising: an input device and a wearable computing device with a bio-signal sensor, at least one feedback module to provide an interactive mediated reality environment for a user, and a conduction medium applicator for applying a conduction medium to a user contacting surface of the bio-signal sensor, the bio-signal sensor receives bio-signal data from the user, the bio-signal sensor comprising a brainwave sensor; the computing device having or in communication with a processor configured to: as part of the interactive mediated reality environment, present content via the at least one feedback module; receive user manual inputs from the input device for creating an object in the interactive mediated reality environment; receive the bio-signal data of the user from the bio-signal sensor; process the bio-signal data to determine user states of the user, including brain states, the user states are processed using a user profile stored in a data storage device accessible by the processor and the user states include brain states; modifying a property of the object according to the bio-signal data of the user. In accordance with an aspect of the present invention, t