CN-121985279-A - Hearing aid and sound transmission device system with intelligent frequency modulation and training method thereof

CN121985279ACN 121985279 ACN121985279 ACN 121985279ACN-121985279-A

Abstract

The invention discloses a hearing aid microphone system with intelligent frequency modulation, which comprises electronic equipment or a microphone, wherein the electronic equipment is provided with a training APP, the electronic equipment is provided with a data receiving end, a data transmitting end and a cloud storage interaction module, the microphone comprises a microphone for collecting sound, a microphone for playing audio and a sound intensity sensor for monitoring external sound intensity in real time, a preset voice sample library, a voice processing module, a frequency analysis module, an intelligent fine tuning module, a noise reduction filtering module and a hearing protection module are arranged in the training APP, the preset voice sample library comprises at least seven standard voice materials in specific frequency intervals, the microphone is in wireless connection with the electronic equipment through a Bluetooth system, sound data collected by the microphone are transmitted to the training APP through the data receiving end, and the voice processing module, the frequency analysis module and the intelligent fine tuning module are sequentially used for cooperatively processing the data and generating optimized audio.

Inventors

SONG YONG
WU XUEZHU
ZHU HUIQUAN
LIU YU

Assignees

东莞泰升音响科技有限公司

Dates

Publication Date: 20260505
Application Date: 20260206

Claims (10)

1. A hearing aid microphone system with intelligent frequency modulation is characterized by comprising, The electronic equipment is provided with a training APP, and is provided with a data receiving end, a data transmitting end and a cloud storage interaction module; The acoustic device comprises a microphone for collecting sound, a sound transmission device for playing audio and a sound intensity sensor for monitoring the external sound intensity in real time; the training APP is internally provided with a preset voice sample library, a voice processing module, a frequency analysis module, an intelligent fine adjustment module, a noise reduction and filtration module and a hearing protection module, The preset voice sample library comprises at least seven standard voice materials in specific frequency intervals; The sound transmission device is in wireless connection with the electronic equipment through a Bluetooth system, sound data acquired by the microphone are transmitted to a training APP through a data receiving end, the voice processing module, the frequency analysis module and the intelligent fine adjustment module are sequentially used for cooperatively processing the data and generating optimized audio, the optimized audio is transmitted to the sound transmission device through a data transmitting end, cloud storage and interaction module is used for realizing cloud storage and calling of adjustment parameters, standard audio and nonstandard audio, and the hearing protection module is used for dynamically adjusting an audio gain threshold according to sound intensity sensor data; The voice processing module integrates a voice conversion text module and is used for converting standard voice materials and collected voice data into texts and synchronously comparing semantic, voice, intonation and speed difference; The frequency analysis module integrates a Fourier transform unit and a sound intensity response function algorithm unit and is used for carrying out frequency spectrum conversion and sound intensity calculation on voice data with larger semantic difference; the intelligent fine tuning module is internally provided with a multitask statistical analysis unit which is used for determining a hearing defect frequency spectrum by combining with environmental factors such as dialects, voice distortion and the like, and supporting independent or synchronous loudness gain fixed-point adjustment of left and right ears.
2. The adjustable intelligent hearing aid microphone system of claim 1, wherein the standard speech material of the library of pre-set speech samples comprises standard speech material of specific frequency intervals of 250Hz-300Hz, 500-600Hz, 1000-1100Hz, 1500Hz, 2000Hz, 4000Hz, 8000 Hz.
3. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The multi-task statistical analysis unit realizes multi-task collaborative switching and high-efficiency analysis by embedding a specific expression of hearing aid frequency identification, sound intensity matching and semantic proofreading tasks into a pre-training model.
4. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The intelligent fine adjustment module supports the triggering parameter adjustment of a user through three feedback modes of silencing, ambiguous consonant and loud repetition, the gain adjustment is gradually increased according to a preset scale, and the single adjustment amplitude is not more than 5%.
5. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The hearing protection module presets a high decibel safety threshold, when the sound intensity sensor detects that the external sound intensity exceeds 85dB, the audio gain is reduced to be below the threshold in real time, and the gain adjustment time delay is not more than 10ms.
6. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The noise reduction filtering module supports an environment self-adaptive mode and a manual selection mode, the environment self-adaptive mode can automatically identify three scenes of sleep, communication and outdoors and switch filtering parameters, Manual selection of modes supports user-defined noise filtering strengths.
7. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The sound transmission device is a loudspeaker or an artificial cochlea adapting interface or a bone conduction earphone, The output audio generated by the training APP can be switched into a sound or vibration mode, and the frequency of the vibration mode is consistent with the frequency of the corresponding sound.
8. The adjustable intelligent hearing aid microphone system of claim 1, wherein, The cloud storage interaction module supports multi-equipment synchronization, and when a user changes an electronic device or a sound transmission device, historical adjustment parameters and hearing defect frequency spectrum data can be called through account login without repeated training.
9. A training method of a hearing aid microphone system with intelligent frequency modulation is characterized in that, Training method based on an adjustable intelligent hearing aid microphone arrangement of any of claims 1-8, comprising the steps of: S1, constructing a preset voice sample library, wherein the sample library comprises seven specific frequency intervals of standard voice materials of 250Hz-300Hz, 500-600Hz, 1000-1100Hz, 1500Hz, 2000Hz, 4000Hz and 8000Hz, and simultaneously configuring a natural dialogue voice acquisition task; s2, connecting the sound transmission device with the electronic equipment through Bluetooth, starting a training APP and completing cloud storage account binding, and automatically loading a preset voice sample library by the training APP; S3, the user recommends materials in a preset voice sample library through a microphone of the microphone device, can select to participate in a natural dialogue task, and synchronously collects recommends voice data and natural dialogue voice data; S4, training APP to perform optimization processing of background sound removal, segmentation and classification on the collected voice data, converting the optimized voice data and corresponding standard voice materials into texts through ASR Model, synchronously displaying the texts on an electronic equipment interface for a user to check semantics, and comparing and analyzing voice, intonation and speed difference; s5, extracting voice fragments with larger semantic and voice feature differences, converting the voice fragments into frequency spectrums through Fourier FFT, calculating sound intensities corresponding to different frequencies by combining with an RMS algorithm, and primarily identifying potential hearing defect frequencies; s6, utilizing a T-Model multitasking statistical analysis unit, combining speech distortion factors caused by dialects and cultural degrees of the user, carrying out multidimensional statistics on the preliminarily identified defect frequency, and determining a core hearing defect frequency spectrum of the user and corresponding sound intensity requirements; s7, the intelligent fine adjustment module carries out fixed-point adjustment on the loudness gain of the corresponding frequency according to the core defect frequency spectrum, supports the user to manually select synchronous adjustment or independent adjustment of the left ear and the right ear, generates initial optimized audio and plays the initial optimized audio through the sound transmission device; s8, the user feeds back the audio definition in a silent, ambiguous consonant and loud repetition mode, the intelligent fine adjustment module iteratively adjusts the gain parameters according to the feedback according to preset scales until standard optimized audio approved by the user is generated, and meanwhile, the adjustment parameters, the standard optimized audio and nonstandard audio in the adjustment process are uploaded and stored through the cloud storage interaction module; And S9, continuously collecting voice interaction data of the user in daily use, repeating the steps S4-S8, dynamically updating the frequency spectrum of the hearing defect of the user and adjusting parameters, and realizing dynamic matching of the system and the hearing condition of the user.
10. A training method for a hearing aid microphone system with smart frequency modulation as claimed in claim 1, In the step S3, the collection time of the natural dialogue voice data is not less than 10 minutes, and the training APP automatically records dialogue scenes in the collection process and stores scene information and voice data in an associated mode; in the step S5, the frequency analysis precision of the Fourier FFT is not lower than 1Hz, and the sound intensity calculation error of the RMS algorithm is not more than 3%; in the step S6, the statistical sample size of the T-Model multitask statistical analysis unit is not less than 1000 groups, and the statistical sample size comprises voice interaction data of different dialects and age layers, so that the defect frequency identification accuracy is not less than 95%; In the step S8, the preset scale of the gain parameter is 0.5 dB/level, the maximum gain adjustment amplitude is not more than 30dB, and secondary hearing damage of a user is avoided; In step S9, the dynamic update period may be set by the user, the default period is 30 days, and when the variation amplitude of the frequency of the hearing defect of the user is detected to be more than 10%, the instant update process is automatically triggered; The hearing state evaluation step further comprises the step of training the APP to generate a quaternary hearing state report according to the historical defect frequency spectrum, the gain adjustment parameters and the user feedback data, and prompting the user about hearing change trend and notice.

Description

Hearing aid and sound transmission device system with intelligent frequency modulation and training method thereof Technical Field The invention relates to the field of acoustic hearing aid systems, in particular to a hearing aid microphone system with intelligent frequency modulation and a training method thereof. Background The hearing impaired people who have a large number of deaf and behind the ear in the current society can be very inconvenient in social connection, amusement, study and the like, and the hearing aid on the market is mostly single in function, and most of the hearing aids need to be specially worn with a power amplifier device, and the structure is heavy and inconvenient. However, some bluetooth-structured headphones exist, but the structure is complex and cannot be accepted and used by most users, i.e. the users can feel too troublesome, and for voice handicapped people, some places where voice or sentences are ambiguous for identifying certain specific words may exist, so that the problem that the voice segments can be acquired by repeatedly listening for several times sometimes exists. Disclosure of Invention The invention mainly aims to provide a hearing aid microphone system with intelligent frequency modulation and a training method thereof, and aims to provide a microphone control system with logic learning capability, so that the system is trained repeatedly, the matching relation with a user is achieved, the using degree is improved, the using is more convenient and more convenient, and the using experience is improved. In order to achieve the above object, the present invention provides a hearing aid microphone system with intelligent frequency modulation, comprising, An electronic device (such as a watch, an earphone body, an earphone box, a mobile phone, a portable electronic screen and the like) provided with a training APP, wherein the electronic device is provided with a data receiving end, a data transmitting end and a cloud storage interaction module; The acoustic device comprises a microphone for collecting sound, a sound transmission device for playing audio and a sound intensity sensor for monitoring the external sound intensity in real time; the training APP is internally provided with a preset voice sample library, a voice processing module, a frequency analysis module, an intelligent fine adjustment module, a noise reduction and filtration module and a hearing protection module, The preset voice sample library comprises at least seven standard voice materials in specific frequency intervals; The sound transmission device is in wireless connection with the electronic equipment through a Bluetooth system, sound data acquired by the microphone are transmitted to a training APP through a data receiving end, the voice processing module, the frequency analysis module and the intelligent fine adjustment module are sequentially used for cooperatively processing the data and generating optimized audio, the optimized audio is transmitted to the sound transmission device through a data transmitting end, cloud storage and interaction module is used for realizing cloud storage and calling of adjustment parameters, standard audio and nonstandard audio, and the hearing protection module is used for dynamically adjusting an audio gain threshold according to sound intensity sensor data; the voice processing module integrates a voice conversion text module (ASR Model) for converting standard voice materials and collected voice data into texts and synchronously comparing semantic, voice, intonation and speed difference; The frequency analysis module integrates a Fourier transform (FFT) unit and a sound intensity response function algorithm unit (RMS) and is used for carrying out frequency spectrum conversion and sound intensity calculation on voice data with larger semantic difference; The intelligent fine tuning module is internally provided with a multi-task statistical analysis unit (T-Model) which is used for determining a hearing defect frequency spectrum (such as an acoustic-color spectrum, effectively analyzing the existing background noise point and high noise point) by combining with environmental factors such as dialect, voice distortion and the like, and supporting independent or synchronous loudness gain fixed-point adjustment of the left ear and the right ear. A training method of a hearing aid microphone system with intelligent frequency modulation is based on the training method of the adjustable intelligent hearing aid microphone system, and comprises the following steps: S1, constructing a preset voice sample library, wherein the sample library comprises seven specific frequency intervals of standard voice materials of 250Hz-300Hz, 500-600Hz, 1000-1100Hz, 1500Hz, 2000Hz, 4000Hz and 8000Hz, and simultaneously configuring a natural dialogue voice acquisition task; s2, connecting the sound transmission device with the electronic equipment through Bluetooth, starting a