CN-115348497-B - Man-machine interaction control method and device for true wireless earphone and storage medium

CN115348497BCN 115348497 BCN115348497 BCN 115348497BCN-115348497-B

Abstract

The disclosure relates to a man-machine interaction control method, a device and a storage medium of a true wireless earphone. The man-machine interaction control method of the real wireless TWS earphone comprises the steps of responding to connection of the TWS earphone and equipment, detecting gestures of a user by the optical sensor, identifying interaction functions corresponding to the detected gestures, and generating control instructions according to the interaction functions, wherein the control instructions are used for controlling the TWS earphone and/or the equipment to execute the interaction functions corresponding to the gestures. According to the man-machine interaction control method of the real wireless earphone, a user can control the TWS earphone and/or equipment connected with the TWS earphone to execute an interaction function through gestures, and convenience and accuracy of man-machine interaction realization are improved.

Inventors

YANG YIZHEN

Assignees

北京小米移动软件有限公司

Dates

Publication Date: 20260508
Application Date: 20210513

Claims (14)

1. The man-machine interaction control method of the real wireless TWS earphone is characterized by being applied to the TWS earphone, wherein an optical sensor is arranged in the TWS earphone, and the man-machine interaction control method of the TWS earphone comprises the following steps: determining that the TWS earphone is connected with equipment, detecting a gesture of a user by the optical sensor, and identifying an interaction function corresponding to the detected gesture; Generating a control instruction according to the interaction function, wherein the control instruction is used for controlling the TWS earphone and/or the equipment to execute the interaction function corresponding to the gesture; wherein the generating a control instruction according to the interactive function includes: Responding to the TWS earphone to be connected with a single device, wherein the TWS earphone comprises a first TWS earphone and a second TWS earphone, the first TWS earphone which detects a user gesture is controlled to generate a first control instruction corresponding to the interactive function, and the second TWS earphone which detects the user gesture is controlled to generate a second control instruction corresponding to the interactive function, wherein the user gesture detected by the first TWS earphone and the second TWS earphone is consistent, and the first control instruction is identical with the second control instruction; responding to the TWS earphone to connect a plurality of devices, wherein the TWS earphone comprises a first TWS earphone and a second TWS earphone, determining a first device controlled by the first TWS earphone and a second device controlled by the second TWS earphone, determining a current TWS earphone generating the control instruction according to the interaction function corresponding to the gesture, and generating the control instruction by the current TWS earphone so as to control the corresponding device to execute the corresponding function; the method comprises the steps of determining a current TWS earphone generating the control instruction according to the interaction function corresponding to the gesture, and generating the control instruction by the current TWS earphone to control corresponding equipment to execute the corresponding function, wherein the method comprises the following steps: And under the condition that the interaction function corresponding to the gesture detected by the second TWS earphone is executed by the first device, generating a control instruction by the second TWS earphone or generating a corresponding control instruction by the first TWS earphone so as to control the first device to execute the corresponding function.
2. The method for controlling human-computer interaction of a TWS headset according to claim 1, wherein determining a current TWS headset generating the control command according to the interaction function corresponding to the gesture, and generating the control command by the current TWS headset to control the corresponding device to execute the corresponding function, comprises: and controlling the first TWS earphone to generate a third control instruction for controlling the first device and/or the TWS earphone to execute the interactive function, and/or controlling the second TWS earphone to generate a fourth control instruction for controlling the second device and/or the TWS earphone to execute the interactive function.
3. The human-computer interaction control method of the TWS headset of claim 1, wherein the first device and the second device determine to establish a connection with the TWS headset by: determining the time for the TWS earphone to establish connection with each device in the plurality of devices; The equipment which is connected with the TWS earphone firstly is determined to be first equipment controlled by the first TWS earphone; and determining the device which establishes connection with the TWS earphone after the first device as a second device controlled by the second TWS earphone.
4. The method for controlling human-computer interaction of a TWS headset according to any one of claims 1 to 3, wherein before the identifying the interaction function corresponding to the detected gesture, the method for controlling human-computer interaction of a TWS headset further comprises: And determining that the TWS headset is in a wearing state.
5. The human-computer interaction control method of the TWS headset of claim 1, wherein identifying the interaction function corresponding to the detected gesture comprises: determining an interaction function corresponding to the detected gesture based on a predefined relation between the gesture and the interaction function; wherein the interactive functions include one or a combination of the following functions: a control function of increasing/decreasing the volume of the TWS earphone and/or the device playing the media file; a control function of playing the previous media file or the next media file by the device; a control function of the device for playing the forward or backward media file; And a control function of photographing the equipment.
6. The human-computer interaction control method of the TWS earphone of claim 1, wherein the human-computer interaction control method of the TWS earphone further comprises: And responding to the interaction function type, determining that the equipment connected by the TWS earphone executes the interaction function, and sending the control instruction to the equipment connected by the TWS earphone.
7. The utility model provides a real wireless TWS earphone's human-computer interaction controlling means which characterized in that is applied to TWS earphone, be provided with optical sensor in the TWS earphone, TWS earphone's human-computer interaction controlling means includes: the processing unit is used for determining that the TWS earphone is connected with equipment, the optical sensor detects gestures of a user, and the interaction function corresponding to the detected gestures is identified; The generating unit is used for generating a control instruction according to the interaction function, wherein the control instruction is used for controlling the TWS earphone and/or the equipment to execute the interaction function corresponding to the gesture; the generating unit generates a control instruction according to the interaction function in the following manner: Responding to the TWS earphone to be connected with a single device, wherein the TWS earphone comprises a first TWS earphone and a second TWS earphone, the first TWS earphone which detects a user gesture is controlled to generate a first control instruction corresponding to the interactive function, and the second TWS earphone which detects the user gesture is controlled to generate a second control instruction corresponding to the interactive function, wherein the user gesture detected by the first TWS earphone and the second TWS earphone is consistent, and the first control instruction is identical with the second control instruction; responding to the TWS earphone to connect a plurality of devices, wherein the TWS earphone comprises a first TWS earphone and a second TWS earphone, determining a first device controlled by the first TWS earphone and a second device controlled by the second TWS earphone, determining a current TWS earphone generating the control instruction according to the interaction function corresponding to the gesture, and generating the control instruction by the current TWS earphone so as to control the corresponding device to execute the corresponding function; The processing unit determines the TWS earphone generating the control instruction according to the interaction function corresponding to the gesture, and generates the control instruction by the determined TWS earphone to control the corresponding device to execute the corresponding function: And under the condition that the interaction function corresponding to the gesture detected by the second TWS earphone is executed by the first device, generating a control instruction by the second TWS earphone or generating a corresponding control instruction by the first TWS earphone so as to control the first device to execute the corresponding function.
8. The man-machine interaction control device of the TWS earphone according to claim 7, wherein the processing unit determines a current TWS earphone generating the control instruction according to the interaction function corresponding to the gesture, and generates the control instruction by the current TWS earphone to control the corresponding device to execute the corresponding function: and controlling the first TWS earphone to generate a third control instruction for controlling the first device and/or the TWS earphone to execute the interactive function, and/or controlling the second TWS earphone to generate a fourth control instruction for controlling the second device and/or the TWS earphone to execute the interactive function.
9. The human-computer interaction control apparatus of the TWS headset of claim 7, wherein the generation unit determines that the first device establishes a connection with the TWS headset and the second device establishes a connection with the TWS headset in the following manner: determining the time for the TWS earphone to establish connection with each device in the plurality of devices; The equipment which is connected with the TWS earphone firstly is determined to be first equipment controlled by the first TWS earphone; and determining the device which establishes connection with the TWS earphone after the first device as a second device controlled by the second TWS earphone.
10. The human-machine interaction control device of a TWS headset according to any one of claims 7 to 9, wherein the processing unit is further configured to: And before identifying the interaction function corresponding to the detected gesture, determining that the TWS earphone is in a wearing state.
11. The human-computer interaction control device of the TWS headset of claim 7, wherein the processing unit identifies the interaction function corresponding to the gesture detected by: determining an interaction function corresponding to the detected gesture based on a predefined relation between the gesture and the interaction function; wherein the interactive functions include one or a combination of the following functions: a control function of increasing/decreasing the volume of the TWS earphone and/or the device playing the media file; a control function of playing the previous media file or the next media file by the device; a control function of the device for playing the forward or backward media file; And a control function of photographing the equipment.
12. The man-machine interaction control device of a TWS headset according to claim 7, further comprising a transmitting unit, The processing unit is further used for determining that the equipment connected by the TWS earphone executes the interactive function according to the interactive function type; and the sending unit is used for sending the control instruction to equipment connected with the TWS earphone.
13. A human-computer interaction control device of a real wireless TWS earphone, comprising: A processor; A memory for storing processor-executable instructions; Wherein the processor is configured to perform the human-machine interaction control method of the TWS headset of any one of claims 1 to 6.
14. A storage medium having instructions stored therein, which when executed by a processor of a TWS headset, enable the TWS headset to perform the human-machine interaction control method of the TWS headset of any one of claims 1 to 6.

Description

Man-machine interaction control method and device for true wireless earphone and storage medium Technical Field The disclosure relates to the technical field of headphones, and in particular relates to a man-machine interaction control method, device and storage medium of a true wireless headphone. Background With the development of wireless headset technology, the application of true wireless (True wireless stereo, TWS) headsets is becoming more and more popular. The TWS earphone can be in wireless connection with electronic equipment such as a mobile phone, and the like, so that the TWS earphone can be matched with the electronic equipment to perform functional control of man-machine interaction, such as music playing/pausing, noise reduction on/off, and the like, so that the man-machine interaction experience of the TWS earphone is enriched, and the convenience of use is improved. In the related art, a touch operation such as pressure sensing or touch control is generally adopted to perform a function control of man-machine interaction on the TWS earphone. However, the touch operation control mode is easy to cause the problems of pressure sensing, false touch, touch failure and the like. Disclosure of Invention In order to overcome the problems in the related art, the present disclosure provides a man-machine interaction control method, device and storage medium for a true wireless earphone. According to a first aspect of embodiments of the present disclosure, a human-computer interaction control method of a TWS headset is provided, which is applied to the TWS headset, where an optical sensor is disposed in the TWS headset, and the method includes: The TWS earphone is connected with equipment, the optical sensor detects gestures of a user and recognizes interaction functions corresponding to the detected gestures, and a control instruction is generated according to the interaction functions and used for controlling the TWS earphone and/or the equipment to execute the interaction functions corresponding to the gestures. In one embodiment, the method for generating the control command according to the interactive function comprises the steps of responding to the TWS earphone to be connected with a single device, wherein the TWS earphone comprises a first TWS earphone and a second TWS earphone, the first TWS earphone which detects the user gesture is controlled to generate a first control command corresponding to the interactive function, and/or the second TWS earphone which detects the user gesture is controlled to generate a second control command corresponding to the interactive function, and the first control command is identical to or different from the second control command. In one embodiment, the method comprises the steps of responding to the TWS earphone to connect a plurality of devices, determining a first device controlled by the first TWS earphone and a second device controlled by the second TWS earphone, controlling the first TWS earphone to generate a third control instruction for controlling the first device and/or the TWS earphone to execute the interactive function, and/or controlling the second TWS earphone to generate a fourth control instruction for controlling the second device and/or the TWS earphone to execute the interactive function. In one embodiment, determining the first device controlled by the first TWS headset and the second device controlled by the second TWS headset comprises determining the time when the TWS headset is connected with each device in the plurality of devices, determining the device which is connected with the TWS headset first as the first device controlled by the first TWS headset, and determining the device which is connected with the TWS headset after the first device as the second device controlled by the second TWS headset. In an implementation manner, before the interaction function corresponding to the detected gesture is identified, the man-machine interaction control method of the TWS headset further comprises the step of determining that the TWS headset is in a wearing state. In an implementation mode, the interaction function corresponding to the detected gesture is identified, and the interaction function corresponding to the detected gesture is determined based on a predefined relation between the gesture and the interaction function, wherein the interaction function comprises one or a combination of a TWS earphone and/or a control function of increasing/decreasing the volume of playing a media file by the device, a control function of playing the previous media file or the next media file by the device, a control function of advancing or backing the playing media file by the device and a control function of photographing by the device. In one embodiment, the man-machine interaction control method of the TWS earphone further comprises the step of responding to the fact that the device connected with the TWS earphone executes the interaction fun