Search

US-12627848-B2 - System and method for enhancing content using brain-state data

US12627848B2US 12627848 B2US12627848 B2US 12627848B2US-12627848-B2

Abstract

A computer system or method may be provided for modulating content based on a person's brainwave data, including modifying presentation of digital content at at least one computing device. The content may also be modulated based on a set of rules maintained by or accessible to the computer system. The content may also be modulated based on user input, including through receipt of a presentation control command that may be processed by the computer system of the present invention to modify presentation of content. Content may also be shared with associated brain state information.

Inventors

  • Christopher Allen Aimone
  • Trevor Ce Coleman
  • Ariel Stephanie Garten
  • Locillo (Lou) Giuseppe Pino
  • Kapil Jay Mishra Vidyarthi
  • Paul Harrison Baranowski
  • Raul Rajiv Rupsingh
  • Tracy Nicole Chong

Assignees

  • INTERAXON INC.

Dates

Publication Date
20260512
Application Date
20240726

Claims (20)

  1. 1 . A system comprising: a wearable computing device, wherein the wearable computing device comprises a heads-up display through which a scene is viewable; a bio-signal sensor in communication with the computing device; the wearable computing device configured to: acquire bio-signal data from a user using the bio-signal sensor; compute a current brain state of the user based at least in part on the bio-signal data; and modify the heads-up display based on the current brain state of the user and a rules engine.
  2. 2 . The system of claim 1 , wherein modifying the heads-up display is based further on a presentation control command.
  3. 3 . The system of claim 1 , wherein modifying the heads-up display comprises presenting a popup or notification based on the current brain state.
  4. 4 . The system of claim 1 , wherein the system further comprises an object tracker and wherein modifying the heads-up display comprises applying an augmented reality digital image effect based on the current brain state and a presentation modification rule to a location of an object in the scene tracked using the object tracker.
  5. 5 . The system of claim 1 , further comprising an imager wherein the imager records or images the scene based on the current brain state.
  6. 6 . The system of claim 1 , further comprising an imager recording the scene, wherein the system annotates the recording based on the current brain state.
  7. 7 . The system of claim 1 , wherein the system tracks the user's location when the current brain state satisfies a pre-defined brain state.
  8. 8 . The system of claim 1 , further configured to: compute a subsequent brain state of the user after modifying the heads-up display; and update the rules engine based at least in part on the subsequent brain state.
  9. 9 . The system of claim 1 , wherein modifying the heads-up display is based further on a target brain state.
  10. 10 . The system of claim 1 , wherein the current brain state comprises at least one of a level of concentration or focus, workload, cognitive load, confusion, and emotional response.
  11. 11 . A method comprising: acquiring bio-signal data from a user using a bio-signal sensor; computing a current brain state of the user based at least in part on the bio-signal data; and modifying a heads-up display through which a scene is viewable of a wearable computing device based on the current brain state of the user and a rules engine.
  12. 12 . The method of claim 11 , wherein modifying the heads-up display is based further on a presentation control command.
  13. 13 . The method of claim 11 , wherein modifying the heads-up display comprises presenting a popup or notification based on the current brain state.
  14. 14 . The method of claim 11 , wherein modifying the heads-up display comprises applying an augmented reality digital image effect based on the current brain state and a presentation modification rule to a location of an object in the scene tracked using an object tracker.
  15. 15 . The method of claim 11 , further comprising recording or based on the current brain state, wherein imager actuation comprises recording or imaging the scene.
  16. 16 . The method of claim 11 , further comprising recording or imaging the scene with an imager based on the current brain state.
  17. 17 . The method of claim 11 , further comprising tracking the user's location when the current brain state satisfies a pre-defined brain state.
  18. 18 . The method of claim 11 , further comprising: computing a subsequent brain state of the user after modifying the heads-up display; and updating the rules engine based at least in part on the subsequent brain state.
  19. 19 . The method of claim 11 , wherein modifying the heads-up display is based further on a target brain state.
  20. 20 . The method of claim 11 , wherein the current brain state comprises at least one of a level of concentration or focus, workload, cognitive load, confusion, and emotional response.

Description

CROSS REFERENCE TO RELATED APPLICATION(S) This application is a continuation of U.S. patent application Ser. No. 18/221,223, filed Jul. 12, 2023, which is a continuation of U.S. patent application Ser. No. 17/570,820, filed Jan. 7, 2022, which is a continuation of U.S. patent application Ser. No. 17/094,027, filed Nov. 10, 2020, which is a continuation of U.S. patent application Ser. No. 16/516,903, filed Jul. 19, 2019, which is a continuation of U.S. patent application Ser. No. 15/991,906, filed May 29, 2018, which is a continuation of U.S. patent application Ser. No. 14/096,822, filed Dec. 4, 2013 and claims all benefit, including priority, of U.S. Provisional Patent Application Ser. No. 61/733,223, filed Dec. 4, 2012, entitled SYSTEM AND METHOD FOR ENHANCING CONTENT USING BRAIN-STATE DATA, the entire contents of each which is incorporated herein by this reference. FIELD OF THE INVENTION The present invention relates to bio-signal collection methods, and systems that utilize bio-signal data. This invention relates more particularly to visualization tools and methods. BACKGROUND OF THE INVENTION Bio-signals are signals that are generated by biological beings that can be measured and monitored. Electroencephalographs, galvanometers, and electrocardiographs are examples of devices that are used to measure and monitor bio-signals generated by humans. A human brain generates bio-signals such as electrical patterns, which may be measured or monitored using an electroencephalogram (EEG). These electrical patterns, or brainwaves, are measurable by devices such as and EEG. Typically, an EEG will measure brainwaves in an analog form. Then, these brainwaves may be analyzed either in their original analog form or in a digital form after an analog to digital conversion. Measuring and analyzing bio-signals such as brainwave patterns can have a variety of practical applications. For example, brain computer interfaces (BCI) have been developed that allow users to control devices and computers using brainwave signals. Various platforms exist for creating or capturing content; and communicating this content either to the creator or the creator's audience. There is a need to improve the evocative nature or engaging nature of communication platforms and methods. SUMMARY OF THE INVENTION A computer system or method may be provided for modulating content based on a person's brainwave data. The content may also be modulated based on a set of rules maintained by or accessible to the computer system. The content may also be modulated based on user input, including through receipt of a presentation control command that may be processed by the computer system of the present invention to modify presentation of content. In accordance with an aspect of the present invention, there is provided a system comprising: at least one computing device; at least one biological-signal (bio-signal) sensor in communication with the at least one computing device; at least one user input device in communication with the at least one computing device; the at least one computing device configured to: present digital content at the at least one computing device for presentation to at least one user; receive bio-signal data of the at least one user from the at least one bio-signal sensor, at least one of the at least one bio-signal sensor comprising a brainwave sensor, and the received bio-signal data comprising at least brainwave data of the at least one user; and modify presentation of the digital content at the at least one computing device based at least partly on the received bio-signal data, at least one presentation modification rule associated with the presented digital content, and at least one presentation control command received from the at least one user input device. The presentation modification rule may be derived from a profile which can exist locally on the at least one computing device or on a remote computer server or servers, which may co-operate to implement a cloud platform. The profile may be user-specific. The user profile may include historical bio-signal data, analyzed and classified bio-signal data, and user demographic information and preferences. Accordingly, the user profile may represent or comprise a bio-signal interaction classification profile. The digital content presentation may be audio, video, or any other type of physical, tactile, or any other type of presentation. Modification of the presentation of the digital content may include changing a sound or appearance of the content, adding other content to the presentation, associating brain state data with the presentation, or sharing the content with one or more other users, optionally through a separate content sharing service, network, or computer system. The presentation modifying may include prioritizing, sorting, or filtering content, or any other types of presentation modification. The presentation modifying may be destructive or non-destructive to the origina