Search

CN-121979382-A - Device control method, electronic device, storage medium, and computer program product

CN121979382ACN 121979382 ACN121979382 ACN 121979382ACN-121979382-A

Abstract

The embodiment of the invention discloses a device control method, electronic equipment, storage medium and computer program product, wherein the method comprises the steps of judging whether the actual attention of an auxiliary object meets the preset attention requirement or not based on an electroencephalogram signal acquired by an electroencephalogram signal acquisition device; if the judgment result is yes, a first target action corresponding to the electroencephalogram signal is determined, otherwise, the auxiliary object is prompted to improve the attention, the electroencephalogram signal is generated due to the intention associated with the first target action in the consciousness of the auxiliary object, control information is generated according to the first target action, and the control information is used for controlling the movement of peripheral auxiliary equipment to execute the first target action. According to the scheme, whether the attention of the auxiliary object is focused or not can be judged according to the electroencephalogram signals acquired for the auxiliary object, so that the electroencephalogram signals with high analysis accuracy, which are suitable for determining the first target action, can be acquired when the attention of the auxiliary object is focused.

Inventors

  • ZHANG RUIZHONG

Assignees

  • 北京镁伽机器人科技有限公司

Dates

Publication Date
20260505
Application Date
20251224

Claims (13)

  1. 1. The device control method is characterized by being used for controlling peripheral auxiliary devices expected to be operated by an auxiliary object, the peripheral auxiliary devices are in communication connection with an electroencephalogram signal acquisition device, the electroencephalogram signal acquisition device is used for acquiring the electroencephalogram signal of the auxiliary object, and the method comprises the following steps: Judging whether the actual attention of the auxiliary object meets the preset attention requirement or not based on the electroencephalogram signals acquired by the electroencephalogram signal acquisition equipment; if the judgment result is yes, determining a first target action corresponding to the electroencephalogram signal, otherwise prompting the auxiliary object to improve the attention, wherein the electroencephalogram signal is generated due to the intention associated with the first target action in the consciousness of the auxiliary object; and generating control information according to the first target action, wherein the control information is used for controlling the movement of the peripheral auxiliary equipment to execute the first target action.
  2. 2. The method as recited in claim 1, further comprising: Displaying icons corresponding to a plurality of actions through a display device, wherein the flicker frequencies of the icons corresponding to different actions are different, and each icon correspondingly displays a text description of the corresponding action; The electroencephalogram signals acquired by the electroencephalogram signal acquisition equipment are generated by stimulating visual nerves due to flickering of the observed icons when the auxiliary object observes the icons corresponding to the actions to be executed by the auxiliary object; And when a first target action corresponding to the electroencephalogram signal is determined, determining a flicker frequency corresponding to an icon observed by the auxiliary object according to the electroencephalogram signal, and determining an action corresponding to the icon with the flicker frequency as the first target action.
  3. 3. The method according to claim 2, wherein in displaying icons corresponding to a plurality of actions, the transparency of the icons is adjusted according to the attention of the auxiliary object.
  4. 4. A method according to claim 3, wherein determining whether the actual attention of the auxiliary object meets a preset attention requirement comprises: Determining a current attention value of the auxiliary object according to the electroencephalogram signal; Judging that the actual attention of the auxiliary object meets the preset attention requirement under the condition that the ratio of the current attention value to the preset attention reference value is higher than a preset ratio threshold; Otherwise, judging that the actual attention of the auxiliary object does not accord with the preset attention requirement; and adjusting the transparency of the icon according to the attention of the auxiliary object includes: And under the condition that the actual attention of the auxiliary object is not in accordance with the preset attention requirement, improving the transparency of the icon.
  5. 5. The method of claim 4, wherein the increased transparency is associated with a ratio of the current attention value to a preset attention reference value.
  6. 6. The method as recited in claim 1, further comprising: an electromyographic signal acquired by an electromyographic signal acquisition device in communication with the peripheral auxiliary device when the auxiliary object performs a specific action; Identifying a specific action represented by the electromyographic signal, and determining a second target action corresponding to the identified specific action according to the corresponding relation between a plurality of preset specific actions and a plurality of target actions; and generating control information from the first target action includes: and generating control information according to the first target action and the second target action, wherein the control information is used for controlling the movement of the peripheral auxiliary equipment to execute the combined action of the first target action and the second target action.
  7. 7. The method of claim 6, wherein identifying the particular action represented by the electromyographic signal comprises: identifying an action type and an action parameter of the specific action; And determining a second target action corresponding to the identified specific action according to the corresponding relation between the preset specific actions and the target actions, wherein the second target action comprises the following steps: Determining a target action set corresponding to the identified action type according to the corresponding relation between a plurality of preset action types and a plurality of target action sets; And selecting the action in the target action set as the second target action according to the identified action parameter.
  8. 8. The method of claim 7, wherein for each target action set of the plurality of target action sets, the target action set is capable of being associated with other target action sets than the target action set by the plurality of action types, and wherein the plurality of action types have a one-to-one correspondence with the other target action sets; According to the corresponding relation between a plurality of pre-configured action types and a plurality of target action sets, determining the target action set corresponding to the identified action type comprises the following steps: determining a first target action set in which the first target action is located, and determining a second target action set associated with the first target action set through the identified action type according to a one-to-one correspondence between the multiple action types and the target action set, wherein the second target action set is a target action set for determining the second target action subsequently.
  9. 9. The method according to claim 7, wherein different action types are distinguished by different joints and/or by different ways of movement according to the correspondence between a plurality of specific actions and a plurality of target actions which are pre-configured.
  10. 10. The method of claim 7, wherein the actions within each target action set are preconfigured with a correspondence to action parameters comprising at least one of: The number of actions, the amplitude of actions, and the frequency of actions.
  11. 11. The method of claim 7, wherein the peripheral auxiliary device comprises a plurality of joints, wherein there is a correspondence between the plurality of joints and a plurality of preset action sets, each preset action set of the plurality of preset action sets comprising one or more actions that the corresponding joint is capable of performing; the plurality of target action sets are at least part of the plurality of preset action sets, and the target action set to which the first target action belongs is different from the target action set to which the second target action belongs.
  12. 12. An electronic device comprising a processor and a memory, wherein the memory has stored therein computer program instructions which, when executed by the processor, are adapted to carry out the device control method of any of claims 1-11.
  13. 13. A storage medium having stored thereon program instructions, which when run are adapted to perform the device control method of any of claims 1-11.

Description

Device control method, electronic device, storage medium, and computer program product Technical Field The present invention relates to the field of medical rehabilitation, and in particular to a method, a system, an electronic device, a storage medium and a computer program product for controlling a peripheral auxiliary device. Background In recent years, with the development of robotics and communication technologies, a control method for controlling peripheral auxiliary devices based on Brain-computer interface (BCI) -Computer Interface-is increasingly applied to the field of medical rehabilitation. For some patients losing limb movement function due to limb injury, the control system based on the brain-computer interface can help the patients to control actions of peripheral auxiliary equipment such as wheelchairs, mechanical arms, exoskeletons and the like, and the patients can perform rehabilitation training independently under the assistance of the peripheral auxiliary equipment, so that the time and energy of accompanying personnel can be greatly reduced. In order to enable paralyzed patients to control peripheral auxiliary equipment more easily, the display device is used for carrying out visual stimulation on the patients so that the patients generate brain electrical signals required by control instructions, the instruction input mode of the visual stimulation can reduce the difficulty of outputting the instructions to a certain extent, but the scheme requires the patients to watch the screen for a long time, so that the fatigue of the patients is easily caused, the attention of the patients is reduced, the recognition accuracy of the brain electrical signals is correspondingly reduced when the attention of the patients is lower, and the control capability of the patients on the peripheral auxiliary equipment is further reduced. Currently, no effective solution has been proposed for the above problems. Disclosure of Invention The present invention has been made in view of the above-described problems. The invention provides a device control method, an electronic device, a storage medium and a computer program product. According to the scheme, whether the attention of the auxiliary object is focused or not can be judged according to the electroencephalogram signals acquired for the auxiliary object, so that the electroencephalogram signals with high analysis accuracy, which are suitable for determining the first target action, can be acquired when the attention of the auxiliary object is focused. According to one aspect of the invention, a device control method is provided, the device control method is used for controlling peripheral auxiliary devices expected to be operated by an auxiliary object, the peripheral auxiliary devices are in communication connection with an electroencephalogram signal acquisition device, the electroencephalogram signal acquisition device is used for acquiring electroencephalogram signals of the auxiliary object, the method comprises the steps of judging whether actual attention of the auxiliary object meets preset attention requirements or not based on the electroencephalogram signals acquired by the electroencephalogram signal acquisition device, determining a first target action corresponding to the electroencephalogram signals if the actual attention of the auxiliary object meets the preset attention requirements, otherwise prompting the auxiliary object to improve the attention, wherein the electroencephalogram signals are generated due to intention associated with the first target action in consciousness of the auxiliary object, and generating control information according to the first target action, wherein the control information is used for controlling movement of the peripheral auxiliary device to execute the first target action. The method comprises the steps of displaying icons corresponding to a plurality of actions through a display device, wherein the flicker frequencies of the icons corresponding to different actions are different, displaying text descriptions of the corresponding actions corresponding to each icon, wherein the electroencephalogram signals acquired by an electroencephalogram signal acquisition device are generated by the fact that visual nerves are stimulated due to the flicker of the observed icons when an auxiliary object observes the icons corresponding to the actions to be executed, and determining the flicker frequency corresponding to the observed icons of the auxiliary object according to the electroencephalogram signals when determining a first target action corresponding to the electroencephalogram signals, and determining the action corresponding to the icon with the display frequency as the first target action. Optionally, in displaying icons corresponding to the plurality of actions, the transparency of the icons is adjusted according to the attention of the auxiliary object. Optionally, judging whether the actual attention