Search

CN-116185187-B - Non-contact eye movement tracking device, control input system and method

CN116185187BCN 116185187 BCN116185187 BCN 116185187BCN-116185187-B

Abstract

The invention provides a non-contact eye movement tracking device, a control input system and a control input method, and belongs to the technical field of vision tracking. The eye-movement sensing device comprises a sensing interface array and wearing equipment, wherein the sensing interface array is attached to the wearing equipment, the sensing interface array comprises a sensing electrode and a transparent supporting layer, the sensing electrode is attached to the transparent supporting layer, the sensing electrode is covered with a dielectric material, and the surface of the dielectric material can keep static charges and generate electric signals when eyes move. The device generates mutual inductance with the fluctuation of the skin around the eyes in the form of a space electric field by a transparent sensing interface array arranged in front of the eyes, and couples and decodes multipath signals generated by the mutual inductance to realize the accurate identification of blinking and eyeball rotation, thus forming a mouse input system for controlling the eye movement.

Inventors

  • CHEN XIANGYU
  • SHI YUXIANG

Assignees

  • 北京纳米能源与系统研究所

Dates

Publication Date
20260508
Application Date
20230117

Claims (9)

  1. 1. A non-contact eye tracking device is characterized by comprising a sensing interface array and wearing equipment, The sensing interface array is arranged on the wearing equipment; the sensing interface array comprises an induction electrode, a transparent supporting layer and a dielectric material layer, wherein the induction electrode is attached to the transparent supporting layer, and the dielectric material layer is positioned on the surface of the induction electrode; The surface of the dielectric material layer is capable of holding an electrostatic charge and generating an electrical signal upon eye movement, Wherein the eye movement comprises the times of blinking movement and the rotation movement of eyeballs in different directions and different angles, the eye movement is corresponding to the eye movement through the coupling action of the electric signals, Wherein the electrical signal comprises a voltage signal, an amount of charge or an amount of current, the change of the voltage signal comprises a change in amplitude, a change in waveform, the change in waveform comprises a peak and a trough, The number of the induction electrodes is four, the induction electrodes are arranged in a mode of three modes up and down, four paths of electric signals can be generated, the four paths of electric signals are in first correspondence with the eye movement action through the coupling action of the four paths of electric signals, Wherein the first correspondence includes any one or more of: determining the blink times according to the trough number of the voltage waveforms of the four paths of electric signals; When the eyeball rotates upwards, the fluctuation waveform is a wave crest and a wave trough of a first intensity and a wave crest and a wave trough of a second intensity, wherein the first intensity is larger than the second intensity; When the eyeball rotates downwards, the fluctuation waveform is the trough of one path of first intensity and the trough of three paths of second intensity; When the eyeball rotates leftwards, the fluctuation waveform is a wave trough of one path of third intensity and a wave crest of three paths of second intensity, wherein the third intensity is larger than the second intensity and smaller than the first intensity; When the eyeball rotates rightwards, the fluctuation waveform is the trough of one path of third intensity and the trough of three paths of second intensity.
  2. 2. The non-contact eye-tracking device of claim 1, wherein, The dielectric material is injected with charges on the surface thereof in a high-voltage polarization mode, the thickness range is 3-100 mu m, and the high-voltage polarization is realized by a high-voltage polarimeter or an antistatic gun; The dielectric material layer is one or more of polytetrafluoroethylene, perfluoroethylene propylene copolymer, polydimethylsiloxane, polyimide, aniline formaldehyde resin, polyoxymethylene, ethylcellulose, polyamide, melamine formaldehyde, polyethylene glycol succinate, cellulose acetate, polyethylene glycol adipate, diallyl phthalate, styrene propylene copolymer, styrene butadiene copolymer, rayon, polymethacrylate, polyvinyl alcohol, polyester, polyisobutylene, polyethylene terephthalate, polyvinyl butyral, natural rubber, polyacrylonitrile, polyvinylidene chloride-co-acrylonitrile, polyethylene propylene carbonate, polystyrene, polymethyl methacrylate, polycarbonate, liquid crystal high molecular polymer, polychloroprene, polyacrylonitrile, polydiphenol carbonate, polychloroether, polyvinylidene chloride, polyethylene, polypropylene, polyvinyl chloride, titanium dioxide, barium titanate, calcium titanate.
  3. 3. The non-contact eye-tracking device of claim 1, wherein, The plurality of induction electrodes are uniformly distributed at the blind area positions around the eyeball; The induction electrode is one or more of a metal conductive film, indium tin oxide, PEDOT, PSS coating, metal nano coating and conductive polymer coating.
  4. 4. The non-contact eye-tracking device of claim 1, wherein, The thickness of the transparent supporting layer ranges from 10 mu m to 2000 mu m, and the transparent supporting layer is a transparent elastomer or a transparent film; The transparent elastomer is one or more selected from polydimethylsiloxane, ecoflex, polyurethane and SEBS; The transparent film is one or more selected from transparent polyethylene, polyvinyl chloride, polypropylene and polymethyl methacrylate.
  5. 5. The non-contact eye-tracking device of claim 1, wherein, The wearing equipment is glasses, and the glasses are goggles, sunshade lenses or near vision lenses.
  6. 6. A non-contact eye movement control input system, comprising: The non-contact eye tracking device of any of claims 1-5 for tracking eye movements and generating electrical signals; An electric signal processing device for performing a first correspondence between the electric signal and the eye movement, and performing a second correspondence between the eye movement and an input command; And the signal receiving and executing device is used for receiving the input instruction and executing corresponding operation according to the input instruction.
  7. 7. The non-contact eye movement control input system of claim 6 wherein, The non-contact eye movement tracking device comprises four induction electrodes, can generate four paths of electric signals, and performs first correspondence with the eye movement through the coupling action of the four paths of electric signals.
  8. 8. The non-contact eye movement control input system of claim 6 wherein, The input instruction is a mouse instruction, and the second correspondence includes: 2 times of blinking actions correspond to one click of the left mouse button, 3 times of blinking actions correspond to one click of the right mouse button, and 4 times of blinking actions correspond to double click of the left mouse button; the rotation movements of the eyeball in the up, down, left and right directions respectively correspond to the movement of the mouse in the up, down, left and right directions.
  9. 9. A non-contact eye movement control input method, comprising: Generating an electrical signal from eye movement of a wearer using the non-contact eye movement tracking device of any one of claims 1-5; Performing a first correspondence between the electrical signal and the eye movement, and performing a second correspondence between the eye movement and an input command; the input of the eye movement control command is realized.

Description

Non-contact eye movement tracking device, control input system and method Technical Field The present invention relates to the field of visual tracking technology, and more particularly, to a method and apparatus for tracking eye movement, and more particularly, to a non-contact eye movement tracking apparatus comprising an array of electrostatic-retaining sensing interfaces. Background Eye tracking technology can provide important information such as human visual behaviors, thinking process and the like by decoding eye movement actions such as eye rotation, staring, blinking and the like, and has been applied to important fields such as medicine, commerce, engineering and the like. For example, the eye movement tracking technology is used for assisting in solving the problems of cognitive function rehabilitation, human-computer interaction of patients suffering from the progressive freezing disease, business preference evaluation of consumers, virtual reality control technology and the like. The continued development of eye movement technology is therefore particularly important in the fields of medical detection and treatment, ergonomic improvement, and commercial analysis. Current eye tracking techniques mainly include those based on magnetic fields, nuclear magnetic resonance, optical trapping, and electrooculogram signals, among others. However, the magnetic field technology requires to wear invasive coils in eyes, the nuclear magnetic resonance eye movement tracking technology requires heavy nuclear magnetic equipment, the optical tracking-based method (such as CN113963416A discloses an eye movement interaction method and system based on laser visual feedback) requires a complex calculation and analysis process although high-precision eye movement tracking can be realized, and the contact electrode (such as CN109077730A discloses a muscle micro-movement detection element) required by the electrooculogram tracking method is easy to cause skin infection. Thus, new eye tracking techniques remain to be explored. Meanwhile, for the non-contact eye tracking technology, the prior art CN103677221a also discloses an eye control communication system, which can detect the eye movements (left and right eye movements, blinks or gazes) of the user through the eye control module, and simultaneously corresponds to the corresponding control command. However, this prior art only proposes a concept, and does not specifically develop how to use the eye control module for instruction manipulation, which is difficult to implement. In addition, how to accurately capture such small movements of the eye is also a problem that the present invention seeks to solve. Disclosure of Invention In order to solve the above problems, the invention designs a non-contact eye tracking device based on a sensing interface array for holding static electricity. The device generates mutual inductance with the fluctuation of the skin around the eyes in the form of a space electric field by a transparent sensing interface array arranged in front of the eyes, and realizes the accurate identification of blinking and eyeball rotation by the coupling decoding of multipath signals generated by the mutual inductance. An embodiment of the present invention provides a non-contact eye tracking device, including: an array of sensing interfaces and a wearable device, The sensing interface array is arranged on the wearing equipment; the sensing interface array comprises an induction electrode, a transparent supporting layer and a dielectric material layer, wherein the induction electrode is attached to the transparent supporting layer, and the dielectric material layer is positioned on the surface of the induction electrode; The surface of the dielectric material layer is capable of holding an electrostatic charge and generating an electrical signal upon eye movement. Preferably, the dielectric material is injected with charges on the surface thereof in a high-voltage polarization mode, and the thickness range is 3-100 μm, and the high-voltage polarization is realized by a high-voltage polarimeter or an antistatic gun; The dielectric material layer is selected from one or more of polytetrafluoroethylene, perfluoroethylene propylene copolymer, polydimethylsiloxane, polyimide, aniline formaldehyde resin, polyoxymethylene, ethylcellulose, polyamide, melamine formaldehyde, polyethylene glycol succinate, cellulose acetate, polyethylene glycol adipate, diallyl phthalate, styrene propylene copolymer, styrene butadiene copolymer, rayon, polymethacrylate, polyvinyl alcohol, polyester, polyisobutylene, polyethylene terephthalate, polyvinyl butyral, natural rubber, polyacrylonitrile, polyvinylidene chloride-co-acrylonitrile, polyethylene propylene carbonate, polystyrene, polymethyl methacrylate, polycarbonate, liquid crystal high molecular polymer, polychloroprene, polyacrylonitrile, polydiphenol carbonate, polychloroether, polyvinylidene chloride, polyethylene, polyp