Search

CN-116110430-B - Method, device, electronic equipment and medium for identifying user operation through music rhythm

CN116110430BCN 116110430 BCN116110430 BCN 116110430BCN-116110430-B

Abstract

The application relates to a method, a device, electronic equipment and a medium for identifying user operation through music rhythm, belonging to the technical field of information identification, wherein the method comprises the steps of generating an demonstration melody according to at least one section of first non-rhythm melody, at least one section of rhythm melody and at least one section of second non-rhythm melody which are sequentially arranged; according to the at least one section of first non-rhythm type melody, the blank melody and the at least one section of second non-rhythm type melody which are sequentially arranged, an operation melody is generated in a combined mode, the duration of the blank melody is equal to that of the rhythm type melody, the demonstration melody and the operation melody are sequentially played, operation information imitating the rhythm type melody when a user plays the blank melody is obtained, whether the operation information is matched with the rhythm type melody or not is judged, if yes, the parameter value of a target object is changed, and otherwise, the operation information is determined to be wrong. The application has the effect of enabling the blind user to accurately and rapidly operate the target object.

Inventors

  • YANG JUN

Assignees

  • 北京心智互动科技有限公司

Dates

Publication Date
20260512
Application Date
20230113

Claims (10)

  1. 1. A method of identifying a user operation by a music tempo, comprising: generating an demonstration melody by combining at least one section of first non-rhythm melody, at least one section of rhythm melody and at least one section of second non-rhythm melody which are sequentially arranged; combining and generating an operation melody according to the at least one section of first non-rhythm melody, the blank melody and the at least one section of second non-rhythm melody which are sequentially arranged, wherein the duration of the blank melody is equal to that of the rhythm melody; Sequentially playing the demonstration melody and the operation melody to acquire operation information imitating rhythm melody when playing blank melody; judging whether the operation information is matched with the rhythm type melody, if so, changing a parameter value of a target object, and executing a corresponding action by the target object, wherein the target object is an object operated by a user; otherwise, determining the operation information is wrong.
  2. 2. The method according to claim 1, wherein the determining whether the operation information matches the rhythm-type melody includes: Dividing the rhythm type melody into a plurality of first sub-melodies, wherein each first sub-melody comprises a note; dividing the operation information into a plurality of second sub-melodies according to the duration of the first sub-melody; Determining a first starting time and a first ending time of each note in the rhythm-type melody, and a second starting time and a second ending time of each note in the operation information; Comparing the second starting time of each second sub-melody with the first starting time of the corresponding first sub-melody, and/or comparing the second ending time of each second sub-melody with the first ending time of the corresponding first sub-melody, and determining the matching degree of the second sub-melody and the corresponding first sub-melody; And determining whether the operation information is matched with the rhythm type melody according to the matching degree of each second sub-melody in the operation information and the corresponding first sub-melody.
  3. 3. The method of claim 2, wherein the comparing the second start time in each of the second sub-melodies with the first start time in the corresponding first sub-melody and/or the second end time in each of the second sub-melodies with the first end time in the corresponding first sub-melody, determining the degree of matching comprises: judging whether a second starting moment of a corresponding note exists in the second sub-melody; If yes, then Determining a first difference between a second starting time in the second sub-melody and a first starting time in a corresponding first sub-melody; Determining a second difference between a second ending time of the corresponding note in the second sub-melody and a first ending time in the corresponding first sub-melody; adding the absolute values of the first difference value and the second difference value to obtain an intermediate value, and obtaining the matching degree according to the ratio of the calculated intermediate value to the duration of the first sub-melody; If not, the matching degree is determined to be zero.
  4. 4. The method of claim 1, wherein after determining the operation information error, the method further comprises: Judging whether the number of times of the same operation information errors reaches a preset number of times or not in continuous time; if not, playing the demonstration melody and the operation melody again; If yes, determining the difficulty of a next demonstration melody according to the difficulty of the current demonstration melody, wherein the difficulty of the next demonstration melody is smaller than the difficulty of the current demonstration melody; determining a new rhythm type melody according to the difficulty of the next demonstration melody; generating new demonstration melody and new operation melody according to the new rhythm melody.
  5. 5. The method of claim 1, wherein after determining the operation information error, the method further comprises: acquiring unmatched sound segments in the operation information; Generating a playback melody according to the operation melody and the operation information; And increasing the volume of the unmatched sound segments when the playback melody is played.
  6. 6. The method of claim 1, wherein the notes of the rhythmic melody are percussive and the notes of the non-rhythmic melody are non-percussive.
  7. 7. The method of claim 1, further comprising determining types of the rhythm-type melody according to a user's demand, the types including a no-strong type and a strong-weak type.
  8. 8. A device for identifying a user operation by a music tempo, comprising: The demonstration melody generation module is used for generating demonstration melodies according to at least one section of first non-rhythm melody, at least one section of rhythm melody and at least one section of second non-rhythm melody which are sequentially arranged; The operation melody generation module is used for generating an operation melody in a combined way according to the at least one section of first non-rhythm melody, the blank melody and the at least one section of second non-rhythm melody which are sequentially arranged, and the duration of the blank melody is equal to the duration of the rhythm melody; the operation information acquisition module is used for sequentially playing the demonstration melody and the operation melody and acquiring operation information imitating rhythm melody when a user plays blank melody; The judging module is used for judging whether the operation information is matched with the rhythm type melody or not; the execution module is used for changing the parameter value of a target object when the judgment module judges that the judgment module is yes, and the target object executes corresponding actions, wherein the target object is an object operated by a user; And the error determination module is used for determining the operation information error when the judgment module judges that the operation information is not correct.
  9. 9. An electronic device, characterized in that, At least one processor; a memory; At least one application program, wherein the at least one application program is stored in the memory and configured to be executed by the at least one processor, the at least one application program being configured to perform the method of identifying user operations by music tempo according to any one of claims 1 to 7.
  10. 10. A computer-readable storage medium, characterized in that a computer program capable of being loaded by a processor and executing the method of recognizing a user operation by a music tempo as set forth in any one of claims 1 to 7 is stored.

Description

Method, device, electronic equipment and medium for identifying user operation through music rhythm Technical Field The present application relates to the field of information identification, and in particular, to a method, an apparatus, an electronic device, and a medium for identifying a user operation by music tempo. Background With the development of the internet, more and more people are surfing the internet by using computers. And the blind person cannot see the image, so that the Internet surfing is difficult. For example, when a certain target object in the interface needs to be actuated, such as opening, closing, playing, stopping, scrolling, etc., the blind cannot position the mouse to the target object for operation by eye operation, and cannot accurately control the target object. Disclosure of Invention In order to enable a blind user to accurately and rapidly operate a target object, the application provides a user operation method, device, electronic equipment and medium for identifying a user through music rhythm. In a first aspect, the present application provides a method for identifying a user operation by music tempo, which adopts the following technical scheme: generating an demonstration melody by combining at least one section of first non-rhythm melody, at least one section of rhythm melody and at least one section of second non-rhythm melody which are sequentially arranged; combining and generating an operation melody according to the at least one section of first non-rhythm melody, the blank melody and the at least one section of second non-rhythm melody which are sequentially arranged, wherein the duration of the blank melody is equal to that of the rhythm melody; Sequentially playing the demonstration melody and the operation melody to acquire operation information imitating rhythm melody when playing blank melody; Judging whether the operation information is matched with the rhythm type melody, if so, changing the parameter value of the target object; otherwise, determining the operation information is wrong. By adopting the technical scheme, the electronic equipment generates the demonstration melody according to the first non-rhythm melody, the rhythm melody and the second non-rhythm melody in a combined way, further determines the blank melody with the same duration as the rhythm melody, generates the operation melody according to the first non-rhythm melody, the blank melody and the second non-rhythm melody, sequentially plays the demonstration melody and the operation melody, acquires the operation information of the user when playing the blank melody, further compares the operation melody with the rhythm melody, judges whether the operation melody is matched with the rhythm melody, if the music melody is matched with the user, the operation of the user is correct, the parameter value of the target object is changed, if the operation information of the user is not matched with the music melody, the operation information of the blind user about the music melody can be identified, the blind user can operate the target object, the operation target object can be rapidly and accurately realized, and the blind user can smoothly surf the internet. Further, the determining whether the operation information matches the rhythm-type melody includes: Dividing the rhythm type melody into a plurality of first sub-melodies, wherein each first sub-melody comprises a note; dividing the operation information into a plurality of second sub-melodies according to the duration of the first sub-melody; Determining a first starting time and a first ending time of each note in the rhythm-type melody, and a second starting time and a second ending time of each note in the operation information; Comparing the second starting time of each second sub-melody with the first starting time of the corresponding first sub-melody, and/or comparing the second ending time of each second sub-melody with the first ending time of the corresponding first sub-melody, and determining the matching degree of the second sub-melody and the corresponding first sub-melody; And determining whether the operation information is matched with the rhythm type melody according to the matching degree of each second sub-melody in the operation information and the corresponding first sub-melody. By adopting the technical scheme, the electronic equipment divides the rhythm type melody into a plurality of first sub-melodies, divides the operation information into a plurality of second sub-melodies, and further determines the starting time and the ending time of each note, so that the electronic equipment can compare the second starting time of the corresponding note of the second sub-melody with the first starting time of the corresponding first sub-melody, and compare the second ending time of the second sub-melody with the second ending time of the corresponding first sub-melody, determine the matching degree of the second sub-melod