CN-116653828-B - Vehicle control method and system based on user state and vehicle

CN116653828BCN 116653828 BCN116653828 BCN 116653828BCN-116653828-B

Abstract

The invention belongs to the field of vehicle control, and provides a vehicle control method and system based on a user state and a vehicle. The vehicle control method comprises the steps of obtaining video information of all users in a vehicle, extracting identity information and control instruction information of all users based on the video information, comparing the identity information of all users with the identity information in a user information base, controlling a vehicle part to be in an initialization state matched with the user identity information when the corresponding user identity information exists in the user information base, controlling the vehicle corresponding part to execute corresponding actions directly according to the control instruction information of the users when the corresponding user identity information does not exist in the user information base, and taking the state of the vehicle corresponding part after the actions are completed as an initial state of the vehicle part matched with the corresponding user identity information and storing the initial state of the vehicle part and the user identity information into the user information base.

Inventors

HE YUJIE
WANG FEI
XIA CUI
WANG CHUANSU
YANG XIAOMEI

Assignees

奇瑞汽车股份有限公司

Dates

Publication Date: 20260505
Application Date: 20230421

Claims (9)

1. A vehicle control method based on a user state, comprising: monitoring the user state through a camera, analyzing and processing the acquired image, extracting the external output data through morphological algorithm characteristics, carrying out layering processing on the image according to pixel distribution, brightness and color information, and converting the image into digital signals for external transmission; Comparing the identity information of all users with the identity information in a user information base, and controlling vehicle parts according to the identity information comparison result and control instruction information, wherein the vehicle parts comprise, but are not limited to, vehicle windows, seats and vehicle-mounted communication equipment; When the corresponding user identity information exists in the user information base, controlling the vehicle part to be in an initialized state matched with the user identity information, and then controlling the vehicle corresponding part to execute corresponding actions according to control instruction information of a user; When the corresponding user identity information does not exist in the user information base, the corresponding part of the vehicle is directly controlled to execute corresponding actions according to the control instruction information of the user, the state of the corresponding part of the vehicle after the actions are completed is used as the initial state of the corresponding part of the vehicle matched with the corresponding user identity information, and the initial state and the user identity information are stored in the user information base; When the vehicle is started, the DMS/OMS/RMS camera collects the user image and converts the brightness and the color into digital signals, namely, comparing the face image with the database face; when the digital signal information converted by the visual controller is personnel information, the vehicle-mounted communication module takes out the information in the internet of vehicles background as comparison analysis, and if the analysis shows that the current passenger information is stored in the internet of vehicles background, the vehicle-mounted communication module executes the internet of vehicles background data parameters by the vehicle body controller system; when the digital signal information converted by the visual controller is action information, the information stored in the domain controller module automatically extracts each dependency item input in advance for comparison, and if each dependency item is met, the action is executed through the vehicle body control system according to the parameters input in advance; when the digital signal information converted by the visual controller is personnel information, and the information in the background of the Internet of vehicles is successfully compared with the digital signal by the vehicle-mounted communication module, if the action information converted by the visual controller is successfully compared with the information in the background of the Internet of vehicles at the same time, the operation of the background of the Internet of vehicles is carried out through the vehicle-mounted communication module according to the data stored in the domain controller.
2. The vehicle control method based on the user's state according to claim 1, wherein the initial state of the operation of the corresponding part of the vehicle and the user's identification information and control instruction information together constitute dependency information and are stored in advance.
3. The vehicle control method based on the user's state according to claim 1, wherein the control instruction information is motion information including body motion information and eye-gaze motion information.
4. The vehicle control method based on the user's state according to claim 1, wherein the control instruction information is voice information.
5. The vehicle control method based on the user's state according to claim 1, wherein the control instruction information is cooperatively controlled motion information and voice information, the motion information including body motion information and gaze motion information.
6. A vehicle control system based on a user status, comprising: The system comprises an information extraction module, a camera, a data comparison and external output data processing module, a data processing module and a data processing module, wherein the information extraction module is used for acquiring video information of all users in a vehicle, extracting identity information and control instruction information of all users based on the video information, monitoring the user state through the camera, analyzing and processing the acquired image, extracting the characteristics through a morphological algorithm, carrying out layering processing on the image according to pixel distribution, brightness and color information, and converting the image into a digital signal for external transmission; The vehicle control module is used for comparing the identity information of all users with the identity information in the user information base and controlling vehicle parts according to the identity information comparison result and control instruction information, wherein the vehicle parts comprise, but are not limited to, vehicle windows, seats and vehicle-mounted communication equipment; When the corresponding user identity information exists in the user information base, controlling the vehicle part to be in an initialized state matched with the user identity information, and then controlling the vehicle corresponding part to execute corresponding actions according to control instruction information of a user; When the corresponding user identity information does not exist in the user information base, the corresponding part of the vehicle is directly controlled to execute corresponding actions according to the control instruction information of the user, the state of the corresponding part of the vehicle after the actions are completed is used as the initial state of the corresponding part of the vehicle matched with the corresponding user identity information, and the initial state and the user identity information are stored in the user information base; When the vehicle is started, the DMS/OMS/RMS camera collects the user image and converts the brightness and the color into digital signals, namely, comparing the face image with the database face; when the digital signal information converted by the visual controller is personnel information, the vehicle-mounted communication module takes out the information in the internet of vehicles background as comparison analysis, and if the analysis shows that the current passenger information is stored in the internet of vehicles background, the vehicle-mounted communication module executes the internet of vehicles background data parameters by the vehicle body controller system; when the digital signal information converted by the visual controller is action information, the information stored in the domain controller module automatically extracts each dependency item input in advance for comparison, and if each dependency item is met, the action is executed through the vehicle body control system according to the parameters input in advance; when the digital signal information converted by the visual controller is personnel information, and the information in the background of the Internet of vehicles is successfully compared with the digital signal by the vehicle-mounted communication module, if the action information converted by the visual controller is successfully compared with the information in the background of the Internet of vehicles at the same time, the operation of the background of the Internet of vehicles is carried out through the vehicle-mounted communication module according to the data stored in the domain controller.
7. The vehicle control system based on a user status of claim 6, The initial state of the action of the corresponding part of the vehicle and the identity information and control instruction information of the user together form dependent information and are stored in advance.
8. A vehicle control system based on a user status, comprising: the system comprises a video acquisition module, a visual controller module, a camera, a data comparison and external output data acquisition module, a display module and a display module, wherein the video acquisition module is used for acquiring video information of all users in a vehicle and transmitting the video information to the visual controller module; the visual controller module is used for extracting identity information and control instruction information of all users based on the video information and transmitting the identity information and the control instruction information to the domain controller module through the vehicle-mounted communication module; The domain controller module is used for comparing the identity information of all users with the identity information in the user information base, generating a control instruction according to the comparison result and issuing the control instruction to the vehicle body controller system, and controlling the vehicle component to execute corresponding actions by the vehicle body controller system, wherein the vehicle component comprises but is not limited to a vehicle window, a seat and vehicle-mounted communication equipment; When the corresponding user identity information exists in the user information base, controlling the vehicle part to be in an initialized state matched with the user identity information, and then controlling the vehicle corresponding part to execute corresponding actions according to control instruction information of a user; When the corresponding user identity information does not exist in the user information base, the corresponding part of the vehicle is directly controlled to execute corresponding actions according to the control instruction information of the user, the state of the corresponding part of the vehicle after the actions are completed is used as the initial state of the corresponding part of the vehicle matched with the corresponding user identity information, and the initial state and the user identity information are stored in the user information base; When the vehicle is started, the DMS/OMS/RMS camera collects the user image and converts the brightness and the color into digital signals, namely, comparing the face image with the database face; when the digital signal information converted by the visual controller is personnel information, the vehicle-mounted communication module takes out the information in the internet of vehicles background as comparison analysis, and if the analysis shows that the current passenger information is stored in the internet of vehicles background, the vehicle-mounted communication module executes the internet of vehicles background data parameters by the vehicle body controller system; when the digital signal information converted by the visual controller is action information, the information stored in the domain controller module automatically extracts each dependency item input in advance for comparison, and if each dependency item is met, the action is executed through the vehicle body control system according to the parameters input in advance; when the digital signal information converted by the visual controller is personnel information, and the information in the background of the Internet of vehicles is successfully compared with the digital signal by the vehicle-mounted communication module, if the action information converted by the visual controller is successfully compared with the information in the background of the Internet of vehicles at the same time, the operation of the background of the Internet of vehicles is carried out through the vehicle-mounted communication module according to the data stored in the domain controller.
9. A vehicle comprising a user state based vehicle control system as claimed in any one of claims 6-7.

Description

Vehicle control method and system based on user state and vehicle Technical Field The invention belongs to the field of vehicle control, and particularly relates to a vehicle control method and system based on a user state and a vehicle. Background The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art. In vehicle control, manual control modes are adopted at present for volume adjustment, air conditioning adjustment, seat adjustment and the like, so that control is not easy to realize in the driving process, and on the other hand, the safety of the vehicle can be threatened. The inventor finds that in the existing vehicle control service, some control instructions are generated through the fixation information and semantic information of a user or through a single monitoring signal, but the technical scheme has the problems that the identity information of the user is not considered, the signal is single, error response is easy to generate, and an error operation command is generated. Disclosure of Invention In order to solve the technical problems in the prior art, the invention provides a vehicle control method and system based on a user state and a vehicle, which can control vehicle components more conveniently according to user identity information and reduce misoperation. In order to achieve the above purpose, the present invention adopts the following technical scheme: A first aspect of the present invention provides a vehicle control method based on a user state. In one or more embodiments, a vehicle control method based on a user state includes: acquiring video information of all users in a vehicle, and extracting identity information and control instruction information of all users based on the video information; Comparing the identity information of all users with the identity information in a user information base, and controlling the vehicle parts according to the identity information comparison result and the control instruction information, wherein the user information base is pre-stored with the user identity information and the vehicle part initialization state matched with the user identity information; when corresponding user identity information exists in a user information base, controlling a vehicle component to be in an initialized state matched with the user identity information; When the corresponding user identity information does not exist in the user information base, the corresponding part of the vehicle is directly controlled to execute corresponding actions according to the control instruction information of the user, the state of the corresponding part of the vehicle after the actions are completed is used as the initial state of the corresponding part of the vehicle matched with the corresponding user identity information, and the initial state and the user identity information are stored in the user information base. A second aspect of the invention provides a vehicle control system based on a user status. In one or more embodiments, a vehicle control system based on a user status includes: the information extraction module is used for acquiring video information of all users in the vehicle and extracting identity information and control instruction information of all users based on the video information; The vehicle control module is used for comparing the identity information of all users with the identity information in the user information base and controlling the vehicle parts according to the identity information comparison result and the control instruction information, wherein the user information base is pre-stored with the user identity information and the initialization state of the vehicle parts matched with the user identity information; when corresponding user identity information exists in a user information base, controlling a vehicle component to be in an initialized state matched with the user identity information; When the corresponding user identity information does not exist in the user information base, the corresponding part of the vehicle is directly controlled to execute corresponding actions according to the control instruction information of the user, the state of the corresponding part of the vehicle after the actions are completed is used as the initial state of the corresponding part of the vehicle matched with the corresponding user identity information, and the initial state and the user identity information are stored in the user information base. In other embodiments, a user state based vehicle control system includes: the video acquisition module is used for acquiring video information of all users in the vehicle and transmitting the video information to the vision controller module; the visual controller module is used for extracting identity information and control instruction information of all users based on the video information and transmittin