CN-121995639-A - Lightweight independent intelligent terminal glasses and application ecology and multi-mode interaction system thereof
Abstract
The invention discloses light independent intelligent terminal glasses and an application ecological and multi-mode interaction system thereof, and belongs to the technical field of intelligent wearing and near-to-eye display. The intelligent terminal glasses (100) comprise an integrated glasses frame (101), glasses legs (102 and 103), lenses (104), a near-to-eye display module (105), a special eye movement ASIC module (106), an independent intelligent processing unit (110), a storage module (111), a flexible battery (112), a wireless charging module (113), a WiFi/Bluetooth communication module (114), a UWB space positioning unit (115), a 6DoF inertia measurement unit (116) and a multi-mode interaction unit. The whole machine is of an IPX8 totally-enclosed waterproof structure, the appearance of the whole machine is consistent with that of the traditional glasses, no camera unit, no physical clamping groove and no physical charging interface are arranged, and the weight of the whole machine is less than or equal to 40 g. The lightweight independent operating system and the exclusive application store are carried, and the third party AR application can be independently downloaded, installed and operated, so that the automatic switching conversation between VoWiFi and Bluetooth is supported. The eye tracking adopts a special ASIC chip, has no image sensor, no image output, no region identification and intention inference, only outputs the fixation point coordinate, is autonomously judged and interacted by an application layer, and has the advantages of ultralow power consumption, privacy safety, no interaction, all-weather wearing and the like. The intelligent glasses solve the problems that the existing intelligent glasses depend on external equipment, are abrupt in appearance, high in privacy risk, complex in interaction and the like, and can be widely used for daily intelligent wearing, AR space entertainment and immersive interaction scenes.
Inventors
- Request for anonymity
Assignees
- 贾浩
Dates
- Publication Date
- 20260508
- Application Date
- 20260312
Claims (10)
- 1. A lightweight independent intelligent terminal glasses (100) is characterized by comprising an integrated glasses frame (101) and glasses legs (102 and 103), wherein the glasses frame and the glasses legs form an integrated structure, a whole machine is free of an exposed physical data interface, a clamping groove and a camera-free unit, a contact near-to-eye display module (105) integrated inside a lens (104), a hardware system which is fully enclosed and arranged inside the glasses legs (102 and 103), the hardware system comprises an independent intelligent processing unit (110), a built-in storage module (111), a flexible energy storage unit (112), a wireless charging receiving module (113) and a wireless communication module (114) supporting WiFi and Bluetooth, a multimode interaction sensing unit comprises an eye tracking module (106), the eye tracking module (106) is a special-purpose chip which is connected with an infrared sensor (107), the ASIC is configured to calculate and output normalized viewpoint coordinates and eye movement event types only according to infrared reflection signals, does not comprise any image sensor and does not output any image data, the independent operation system comprises an independent operation system, the operation system supports an application program, is arranged on the inside the glasses, the operation system, is installed through a wireless communication module (114) and is installed on a mobile phone, and can be installed through a wireless communication channel or a mobile communication terminal, and can be installed through a wireless communication channel, and the mobile communication module is not installed on a mobile phone And running a network call function based on the wireless local area network.
- 2. The smart terminal eyewear (100) of claim 1, wherein the independent smart processing unit (110) is configured to receive gaze point coordinates output by the eye tracking ASIC chip (106) and to pass the coordinates directly to a currently running application, wherein interaction logic is autonomously determined by the application from its own user interface layout, and wherein system layer software does not perform eye trajectory based region recognition or intent inference algorithms.
- 3. The smart terminal eyewear (100) of claim 1, wherein the eye-tracking ASIC chip (106) operates at a sampling rate of 30 frames/second with a power consumption of no more than 5 milliwatts and a package size of no more than 3.6 millimeters by 3.6 millimeters.
- 4. The smart terminal eyewear (100) of claim 1, wherein the near-eye display module (105) employs an optical waveguide structure having an optical path footprint that is physically compatible with the near-sighted or astigmatic optical prescription area (123) of the lens.
- 5. The smart terminal glasses (100) according to claim 1, wherein the hardware system further comprises a UWB spatial location unit (115), a 6DoF inertial measurement unit (116), a MEMS microphone array (117), an audio output unit (118), and a contact touch sensing unit (119).
- 6. The smart terminal glasses (100) according to claim 1, wherein the wireless communication module (114) supports WiFi and bluetooth protocols, and the independent smart processing unit (110) has a VoWiFi protocol stack built in and is configured to automatically switch between a WiFi independent call path and a bluetooth audio transparent path according to a network connection state.
- 7. The intelligent terminal glasses (100) according to claim 1, wherein the flexible energy storage units (112) integrated inside the glasses legs (102, 103) are solid-state batteries, the wireless charging receiving module (113) accords with Qi wireless charging standard, and the whole glasses do not have physical charging interface.
- 8. The smart terminal glasses (100) according to claim 1, wherein the local data processing of the glasses is completed by an end-side AI engine, and the zero acquisition and zero storage of the image data is realized from a hardware architecture level due to no camera acquisition unit.
- 9. The smart terminal eyewear (100) of any of claims 1-8, wherein the overall machine weighs less than or equal to 40 grams and is provided with an acoustic channel that maintains air tightness through a waterproof breathable membrane (122).
- 10. An independent intelligent terminal interaction method based on the glasses (100) according to any one of claims 1 to 9 is characterized by comprising the steps of wirelessly downloading an adapted third party application program through an application store, completing installation and foreground operation of the application program by an independent operation system, acquiring a gaze point coordinate and an eye movement event by a special eye movement tracking ASIC chip (106) under the condition of no participation of an image sensor, directly transmitting the gaze point coordinate to the application program operated in the foreground by an independent intelligent processing unit (110), autonomously judging and executing an interaction instruction corresponding to the gaze point coordinate by the application program according to a control layout of a self graphical user interface, and automatically switching to a VoWiFi independent path or a Bluetooth transparent transmission path to transmit audio data by a processing unit when a call is initiated.
Description
Lightweight independent intelligent terminal glasses and application ecology and multi-mode interaction system thereof Technical Field The invention belongs to the technical field of intelligent wearing equipment, independent intelligent terminals, near-to-eye display, artificial intelligence and space interaction, and particularly relates to lightweight intelligent terminal glasses (100) which are consistent with traditional glasses in appearance, can independently download and install an application program, do not need an external host or mobile phone, do not have a camera unit and a physical data interface, and adopt wireless charging. Background The following industry pain points generally exist in the existing intelligent glasses, AR glasses and game wearing equipment: The equipment depends on a mobile phone, a host or an external computing unit, can not independently run, and uses a field Jing Shouxian; The appearance is heavy, the structure is obvious, and the glasses cannot be worn as daily glasses all the day; the clamping groove, the physical charging interface and the honeycomb module are required to be arranged, so that the appearance integrity, the waterproof performance and the wearing comfort level are damaged; the carrying of the camera device is easy to cause privacy disputes and social rejection, and the acceptance of public scenes is low; The method cannot have independent application ecology like a mobile phone, and cannot freely download, install and run the third party APP; the interaction mode is complicated, manual operation is relied on, and the full-field Jing Caokong free of hands and free of feel and nature cannot be realized; The lens is difficult to be compatible with optical prescriptions such as myopia, astigmatism and the like, and the applicable crowd range is narrow; The existing chip scheme has overhigh power consumption or overlarge volume, and is difficult to realize full-function integration in the size of the traditional glasses; the existing eye movement tracking interaction scheme generally relies on a camera to acquire eye images, and has the problems of high power consumption, high privacy risk, incapability of always being online and the like; the existing patent adopts a complex region identification algorithm, determines the intention of a user by calculating parameters such as a round trip coefficient, an interesting weight and the like of an eye movement track, has high algorithm complexity and large interaction delay, needs a main processor to continuously operate, and is difficult to realize low-power consumption always online interaction; the industry generally believes that spatial interactions must rely on visual image input and complex intent inferences, resulting in smart glasses having to be equipped with high performance processors and cameras, further exacerbating power consumption, privacy and appearance issues. At present, the integrated intelligent terminal glasses which are conventional in appearance, light in weight, independent in operation, ecological in independent application, free of clamping grooves, free of camera shooting, free of physical interfaces, wireless in charging, wiFi/Bluetooth independent networking, capable of realizing network communication, free in installing APP and games and supporting multi-mode and noninductive interaction do not exist in the market, so that the intelligent terminal glasses have remarkable novelty, creativity and practicability, and can effectively fill the industry blank. Disclosure of Invention 4.1 Technical problem to be solved The invention overcomes the defects that the existing intelligent equipment depends on an external host, cannot independently operate, is abrupt in appearance, poor in privacy, free of complete application ecology, inconvenient in interaction, limited in applicable crowd, multiple in structure openings, poor in waterproofness, difficult in chip power consumption and volume and the like, and provides the lightweight independent intelligent terminal glasses (100) for realizing full scene intelligent experience of consistent appearance with the traditional glasses, independent downloading operation of APP and games, no clamping groove, no camera shooting, no physical interface, wireless charging, wiFi/Bluetooth networking conversation, multi-mode non-inductive interaction, compatibility of optical prescriptions, and comfortable wearing throughout the day. 4.2 Technical proposal A lightweight self-contained smart terminal eyeglass (100), comprising: the high-strength light composite material is adopted to manufacture the glasses frame (101) and the glasses legs (102, 103) by adopting an integrated forming process, internal electronic elements are all coated inside structural members by adopting an injection molding or nesting process to form an integrated closed structure, and besides the necessary acoustic channel (122) is treated by adopting a waterproof breathable film, the w