CN-121989849-A - Vehicle-mounted intelligent interaction device, intelligent interaction method and equipment

CN121989849ACN 121989849 ACN121989849 ACN 121989849ACN-121989849-A

Abstract

The application discloses a vehicle-mounted intelligent interaction device, an intelligent interaction method and equipment, and belongs to the technical field of vehicles. In the device, the control module accurately identifies the direction of the object by a sound source localization method in the process of interaction between the voice interaction module and the object, and then drives the lifting rotating mechanism to rotate to the direction facing the object, so that the face-to-face interaction between the voice interaction module and the object can be realized, the limitation of the traditional fixed interaction visual angle is broken, the interference of voice signals is reduced, and the interaction efficiency is improved. And moreover, the lifting rotating mechanism can drive the intelligent interaction assembly to be stored in the shell, so that the occupied space in the vehicle can be avoided, the overall simplicity and attractiveness in the vehicle are maintained, and the visual experience of a user is improved.

Inventors

He Deting
QI BIN
ZHANG MIN

Assignees

安徽开阳科技有限公司
奇瑞汽车股份有限公司

Dates

Publication Date: 20260508
Application Date: 20260330

Claims (10)

1. The vehicle-mounted intelligent interaction device is characterized by comprising a shell, a lifting rotating mechanism and an intelligent interaction assembly; the shell is embedded in the middle console or instrument desk of the vehicle, the top of the shell is provided with an opening for the lifting rotary mechanism to lift out, the intelligent interaction assembly is integrated on the lifting rotating mechanism; The lifting and rotating mechanism is used for driving the intelligent interaction assembly to lift out of the shell from the opening or be contained in the shell; The intelligent interaction assembly comprises a controller and a voice interaction module, wherein the lifting rotation mechanism and the voice interaction module are electrically connected with the controller; the voice interaction module is used for collecting voice signals of an object and sending the voice signals to the controller; The controller is used for determining the direction of the object through a sound source positioning method based on the voice signal, and controlling the lifting rotating mechanism to rotate based on the direction so as to enable the voice interaction module to rotate to the direction facing the object; The voice interaction module is further used for continuously collecting voice signals of the object and performing voice interaction with the object based on the voice signals.
2. The apparatus of claim 1, wherein the object is a plurality; the voice interaction module is used for collecting voice signals of a plurality of objects, respectively carrying out semantic recognition on the voice signals of the plurality of objects to obtain a plurality of voice content information, and sending the voice signals and the voice content information corresponding to the plurality of objects to the controller; The controller is used for determining the voice content information with the highest priority based on the importance degrees corresponding to the voice content information, determining the object corresponding to the voice content information with the highest priority as a target interaction object, determining the direction of the target interaction object through a sound source positioning method based on the voice signal of the target interaction object, and controlling the lifting and rotating mechanism to rotate based on the direction of the target interaction object so as to enable the voice interaction module to rotate to the direction towards the target interaction object.
3. The apparatus of claim 2, wherein the controller is further configured to determine, based on the voice signal of each object, a direction in which each object is located by a sound source localization method when priorities of the plurality of voice content information are the same, determine, based on a preset direction priority, a direction in which the priority is highest among the directions in which the plurality of objects are located, and control the lifting and rotating mechanism to rotate based on the direction in which the priority is highest so as to rotate the voice interaction module to a direction toward the direction in which the priority is highest.
4. The device according to claim 1, wherein an angle sensor is arranged on the lifting and rotating mechanism, and the angle sensor is electrically connected with the controller; the controller is used for determining a first angle between the initial orientation of the voice interaction module and the direction based on the direction; the angle sensor is used for detecting a second angle rotated by the lifting rotating mechanism and sending the second angle to the controller; the controller is further used for adjusting the rotation angle of the lifting rotation mechanism based on the angle difference between the first angle and the second angle until the angle difference is not larger than a preset angle difference.
5. The apparatus of claim 1, wherein the controller is further configured to determine an interaction state in which the voice interaction module is in an interaction process with the object, determine an interaction expression corresponding to the voice interaction module based on the interaction state, send expression data of the interaction expression and pre-stored avatar image data to a central control vehicle, the avatar image and the interaction expression being used for simulating a personified interaction image and a personified interaction expression of the voice interaction module, respectively; The central control car machine is used for displaying the virtual image and the interactive expression through a central control display screen based on the image data and the expression data.
6. The apparatus of claim 1, wherein the intelligent interaction assembly further comprises a camera, the camera being electrically connected to the controller; The controller is also used for controlling the camera to record the video of the road condition in front of the vehicle in the running process of the vehicle, and sending data corresponding to the video to the central control vehicle when receiving a video viewing request; The central control car machine is used for playing the video through a central control display screen based on the data corresponding to the video; Optionally, the controller is further configured to determine, when the vehicle is in a parking or whistle mode and an abnormal signal is received, a target position based on the abnormal signal, where the target position is a position triggering the abnormal signal; The camera is used for shooting pictures corresponding to the target position by rotating a shooting angle in the following mode and sending the pictures to the controller; and the controller is used for sending the picture to the target terminal and carrying out early warning.
7. A smart interaction method, characterized in that it is applied to the apparatus of any one of claims 1 to 6, the method comprising: the voice interaction module collects voice signals of an object and sends the voice signals to the controller; The controller determines the direction of the object through a sound source positioning method based on the voice signal, and controls the lifting and rotating mechanism to rotate based on the direction so as to enable the voice interaction module to rotate to the direction facing the object; The voice interaction module continues to collect the voice signal of the object and performs voice interaction with the object based on the voice signal.
8. A controller comprising a processor and a memory, wherein the memory has at least one program code stored therein, the at least one program code being loaded and executed by the processor to implement the intelligent interaction method of claim 7.
9. A computer readable storage medium having stored therein at least one program code loaded and executed by a processor to implement the intelligent interaction method of claim 7.
10. A computer program product, characterized in that the computer program product has stored therein at least one program code, which is loaded and executed by a processor to implement the intelligent interaction method according to claim 7.

Description

Vehicle-mounted intelligent interaction device, intelligent interaction method and equipment Technical Field The application relates to the technical field of vehicles, in particular to a vehicle-mounted intelligent interaction device, an intelligent interaction method and equipment. Background With the continued development of intelligent cabins, on-board assistants have become an integral part of the vehicle's use. In the related art, when a vehicle-mounted intelligent interaction device interacts with a user, the problem of fixed interaction visual angle exists, and voice signals are easy to interfere, so that interaction efficiency is low. Disclosure of Invention The embodiment of the application provides a vehicle-mounted intelligent interaction device, an intelligent interaction method and equipment, which can improve interaction efficiency. The technical scheme is as follows: In one aspect, a vehicle-mounted intelligent interaction device is provided, which comprises a shell, a lifting rotation mechanism and an intelligent interaction assembly; the shell is embedded in the middle console or instrument desk of the vehicle, the top of the shell is provided with an opening for the lifting rotary mechanism to lift out, the intelligent interaction assembly is integrated on the lifting rotating mechanism; The lifting and rotating mechanism is used for driving the intelligent interaction assembly to lift out of the shell from the opening or be contained in the shell; The intelligent interaction assembly comprises a controller and a voice interaction module, wherein the lifting rotation mechanism and the voice interaction module are electrically connected with the controller; the voice interaction module is used for collecting voice signals of an object and sending the voice signals to the controller; The controller is used for determining the direction of the object through a sound source positioning method based on the voice signal, and controlling the lifting rotating mechanism to rotate based on the direction so as to enable the voice interaction module to rotate to the direction facing the object; The voice interaction module is further used for continuously collecting voice signals of the object and performing voice interaction with the object based on the voice signals. In one possible implementation, the object is a plurality of objects; the voice interaction module is used for collecting voice signals of a plurality of objects, respectively carrying out semantic recognition on the voice signals of the plurality of objects to obtain a plurality of voice content information, and sending the voice signals and the voice content information corresponding to the plurality of objects to the controller; The controller is used for determining the voice content information with the highest priority based on the importance degrees corresponding to the voice content information, determining the object corresponding to the voice content information with the highest priority as a target interaction object, determining the direction of the target interaction object through a sound source positioning method based on the voice signal of the target interaction object, and controlling the lifting and rotating mechanism to rotate based on the direction of the target interaction object so as to enable the voice interaction module to rotate to the direction towards the target interaction object. In another possible implementation manner, the controller is further configured to determine, based on the voice signal of each object, a direction in which each object is located by a sound source localization method when priorities of the plurality of voice content information are the same, determine, based on a preset direction priority, a direction in which the priority is highest among the directions in which the plurality of objects are located, and control the lifting and rotating mechanism to rotate based on the direction in which the priority is highest, so that the voice interaction module rotates to face the direction in which the priority is highest. In another possible implementation manner, an angle sensor is arranged on the lifting rotation mechanism, and the angle sensor is electrically connected with the controller; the controller is used for determining a first angle between the initial orientation of the voice interaction module and the direction based on the direction; the angle sensor is used for detecting a second angle rotated by the lifting rotating mechanism and sending the second angle to the controller; the controller is further used for adjusting the rotation angle of the lifting rotation mechanism based on the angle difference between the first angle and the second angle until the angle difference is not larger than a preset angle difference. In another possible implementation manner, the controller is further used for determining an interaction state of the voice interaction module in the interaction