Search

CN-121986313-A - Information processing system and information processing method

CN121986313ACN 121986313 ACN121986313 ACN 121986313ACN-121986313-A

Abstract

An information processing system includes a biometric information detection unit that detects biometric information from one or more portions of a user, an estimation unit that estimates text information or voice information from the biometric information detected by the biometric information detection unit, a determination unit that determines whether the biometric information corresponds to a specific movement for controlling the system, and a control unit that controls the system based on a result of the determination by the determination unit.

Inventors

  • Xiang Chudaping
  • NAGURA CHIHIRO

Assignees

  • 佳能株式会社

Dates

Publication Date
20260505
Application Date
20240815
Priority Date
20231006

Claims (19)

  1. 1. An information processing system, comprising: a biometric information detection unit that detects biometric information from one or more portions of a user; an estimation unit that estimates text information or voice information from the biometric information detected by the biometric information detection unit; a determination unit that determines whether the biometric information corresponds to a specific movement for controlling the system, and And a control unit that controls the system based on a result of the determination by the determination unit.
  2. 2. The information handling system of claim 1, Wherein when it is determined that the biometric information corresponds to a first specific movement, the control unit controls the system so as to start estimation of the text information or the voice information based on the biometric information by the estimation unit.
  3. 3. The information processing system according to claim 1 or 2, Wherein when it is determined that the biometric information corresponds to a second specific movement, the control unit controls the system so as to end the estimation of the text information or the voice information based on the biometric information by the estimation unit.
  4. 4. The information processing system according to any one of claim 1 to 3, Wherein the control unit controls the system to switch the operation mode in dependence of which of a plurality of specific movements the biometric information corresponds to.
  5. 5. The information processing system according to any one of claim 1 to 4, Wherein the control unit controls the system to activate an application in dependence of which of the plurality of specific movements the biometric information corresponds to.
  6. 6. The information processing system according to any one of claim 1 to 5, Wherein the specific movement is at least any one of facial movement, cheek movement, tongue movement, and eyeball or eyelid movement of the user.
  7. 7. The information processing system according to any one of claim 1 to 6, Wherein the biometric information detection unit detects biometric information for estimating the voice information or the text information and biometric information for determining whether the biometric information corresponds to the specific movement by using the same sensor.
  8. 8. The information processing system according to any one of claim 1 to 7, Wherein the biometric information detection unit includes at least one of an acceleration sensor and an angular velocity sensor and includes a myoelectric sensor.
  9. 9. The information processing system according to any one of claim 1 to 7, Wherein the biometric information detection unit includes at least one of an acceleration sensor and an angular velocity sensor and includes a tactile sensor.
  10. 10. The information processing system according to any one of claim 1 to 9, Wherein the biometric information detection unit detects the biometric information from at least two or more parts of the user among a mandibular region, cheek, throat, sub-aural region, neck region, and temple of the user.
  11. 11. The information processing system according to any one of claim 1 to 10, Wherein the control unit starts displaying the text information by using the display unit when it is determined that the biometric information corresponds to a third specific movement, and ends displaying the text information using the display unit when it is determined that the biometric information corresponds to a fourth specific movement.
  12. 12. The information processing system according to any one of claims 1 to 11, Wherein the control unit starts outputting the voice information by using the voice information output unit when it is determined that the biometric information corresponds to the fifth specific movement, and ends outputting the voice information by using the voice information output unit when it is determined that the biometric information corresponds to the sixth specific movement.
  13. 13. The information processing system according to any one of claim 1 to 12, Wherein the estimation unit estimates the text information or the speech information from the biometric information by using a first trained model, and Wherein the determining unit determines whether the biometric information corresponds to the specific movement by using a second trained model.
  14. 14. The information handling system of claim 13, Wherein each of the first trained model and the second trained model is the same trained model.
  15. 15. The information processing system according to any one of claim 1 to 14, Wherein the biometric information detection unit is included in a device attachable to the user, and Wherein the estimation unit, the determination unit, and the control unit are included in an information processing apparatus configured to be communicable with the device.
  16. 16. The information handling system of claim 15, Wherein the apparatus includes an output unit that outputs the text information or the speech information estimated by the estimation unit.
  17. 17. The information processing system according to any one of claim 1 to 16, Wherein the control unit controls the system based on a type of movement, the type of movement being based on the biometric information.
  18. 18. An information processing method, comprising: A biometric information detection step of detecting biometric information from one or more portions of a user; An estimating step of estimating text information or voice information from the biometric information detected in the biometric information detecting step; A determining step of determining whether the biometric information corresponds to a specific movement for controlling the system, and And a control step of controlling the system based on a result of the determination in the determination step.
  19. 19. A program for causing a computer to execute each of the steps of the information processing method according to claim 18.

Description

Information processing system and information processing method Technical Field The present invention relates to an information processing system that converts biometric (biometric) information into text information or voice information. Background In recent years, recognition of spoken content by using voice information of a user has been performed. Meanwhile, acquiring biometric information in place of voice information, recognizing a facial expression, text information, and the like of a user from the biometric information, and outputting the facial expression, text information, and the like of the user has been performed. NPL 1 discloses a technology for recognizing utterance content from biometric information related to skin motion during a silence motion by using an acceleration sensor and an angular velocity sensor. CITATION LIST Patent literature PTL 1 Japanese patent laid-open No. 2010-21902 Non-patent literature NPL 1 Japanese society of information processing Interaction 2020"Derma: silence talk interactions Using percutaneous motion perception" Disclosure of Invention Technical problem However, in the case of NPL 1, it is necessary to press a button, for example, in order to control a device or to perform control by using equipment (such as a PC or a smart phone) connected to the device, but control cannot be performed in a case where both hands are not free with respect to such equipment. In the device control by using a combination of NPL 1 and PTL 1, each device is necessary and cannot be used when the hand movement is not free. An object of the present invention is to allow easy control of devices in an information processing system that converts biometric information into text information or voice information. Solution to the problem According to a first aspect of the present disclosure, an information processing system includes a biometric information detection unit that detects biometric information from one or more portions of a user, an estimation unit that estimates text information or voice information from the biometric information detected by the biometric information detection unit, a determination unit that determines whether the biometric information corresponds to a specific movement for controlling the system, and a control unit that controls the system based on a result of the determination by the determination unit. According to a second aspect of the present disclosure, an information processing method includes a biometric information detection step of detecting biometric information from one or more portions of a user, an estimation step of estimating text information or voice information from the biometric information detected in the biometric information detection step, a determination step of determining whether the biometric information corresponds to a specific movement for a control system, and a control step of controlling the system based on a result of the determination in the determination step. Advantageous effects of the invention According to the present invention, in an information processing system that converts biometric information into text information or voice information, a device can be easily controlled without using another device. Drawings Fig. 1 is a diagram illustrating a configuration of an information processing system according to an embodiment. Fig. 2 is a flowchart illustrating an operation of the information processing system according to an embodiment. Fig. 3 is a diagram illustrating a configuration of an information processing system according to a first example. Fig. 4 is a schematic diagram of a detection device according to a first example. Fig. 5 is a diagram illustrating a configuration of an information processing system according to a second example. Fig. 6 is a schematic diagram of a detection device according to a second example. Fig. 7 is a diagram illustrating a configuration of an information processing system according to a third example. Fig. 8 is a schematic diagram of a detection device according to a third example. Fig. 9 is a diagram illustrating a configuration of a contact type sensor unit according to a third example. Fig. 10 is a diagram illustrating a configuration of a contact type sensor unit according to a third example. Fig. 11 is a diagram illustrating an external force calculation process in the third example. Fig. 12 is a diagram illustrating an external force calculation process in the third example. Detailed Description Hereinafter, embodiments of the present invention will be described in detail. FIG. 1 illustrates an overview of an information handling system of the present invention. The information processing system converts the speech content into text information or speech information based on biometric information such as muscle activity during vocalization. In the present disclosure, sound production includes actions of sound production in which audible sound is zero or substantially zero. Further, f