Search

CN-122008849-A - Vehicle-computer interaction method and system, storage medium and vehicle

CN122008849ACN 122008849 ACN122008849 ACN 122008849ACN-122008849-A

Abstract

The application relates to a vehicle-machine interaction method, a system, a storage medium and a vehicle, and belongs to the technical field of vehicle-machines; the vehicle-computer interaction method comprises the steps of establishing a mapping relation between virtual keys defined on the inner decorative surface of a vehicle and vehicle-mounted functions, obtaining image data containing the virtual keys, obtaining behavior characteristics of fingers of a user based on the image data, judging whether triggering states of the virtual keys are effective triggering or not based on the behavior characteristics, and activating the vehicle-mounted functions mapped with the virtual keys when the triggering states are effective triggering. The intelligent control method and the intelligent control system fundamentally solve the problems that the number of the traditional physical keys is limited and can not be expanded along with the intelligent requirements, and effectively avoid the potential safety hazards caused by the large difficulty of touch blind operation of the vehicle and the machine screen. The application reserves the traditional operation habit of clicking the physical surface by the user, provides real physical contact feedback, does not need the user to learn a new interaction mode, and is particularly suitable for the groups with high dependence on physical operation, such as the elderly users, professional drivers and the like.

Inventors

  • ZHU JINGXUAN

Assignees

  • 长城汽车股份有限公司

Dates

Publication Date
20260512
Application Date
20260128

Claims (10)

  1. 1. The vehicle-machine interaction method is characterized by comprising the following steps of: Establishing a mapping relation between virtual keys defined on the surface of the vehicle interior and vehicle-mounted functions; acquiring image data containing the virtual key; acquiring behavior characteristics of a user finger based on the image data; Judging whether the triggering state of the virtual key is effective triggering or not based on the behavior characteristics; and when the triggering state is effective triggering, activating the vehicle-mounted function mapped with the virtual key.
  2. 2. The vehicle-to-machine interaction method according to claim 1, wherein the method for establishing a mapping relationship between virtual keys defined on the interior surface of the vehicle and the functions on the vehicle comprises: acquiring position parameters of a user at a selected position of the interior surface; defining a virtual key on the interior surface based on the position parameter; Acquiring the vehicle-mounted function selected by a user; and establishing a mapping relation between the virtual key and the vehicle-mounted function.
  3. 3. The vehicle-to-machine interaction method according to claim 2, wherein the method for defining virtual keys on the interior surface comprises: determining a center reference point based on the location parameter; Acquiring a predefined contour shape and corresponding size parameters; Determining a boundary by taking the center reference point as a center according to the outline shape and the size parameter; and defining an area surrounded by the boundary as the virtual key.
  4. 4. The vehicle-computer interaction method according to claim 2, wherein the method for acquiring the vehicle-mounted function selected by the user comprises: Displaying a configurable vehicle-mounted function list; acquiring a target function selected by a user from the vehicle-mounted function list; and determining the target function as the vehicle-mounted function mapped with the virtual key.
  5. 5. The vehicle-computer interaction method according to claim 1, wherein the method for acquiring the behavior characteristics of the fingers of the user comprises the following steps: Acquiring contour data of the hand of the user based on the image data; Determining coordinates of the fingertip based on the profile data; establishing a time sequence corresponding relation between the fingertip coordinates and time to obtain a movement track of the fingertip; And obtaining the behavior characteristics of the finger based on the motion trail.
  6. 6. The vehicle-computer interaction method according to claim 5, wherein the method for judging whether the triggering state of the virtual key is effective triggering comprises: when the coordinates of the fingertip are detected to fall into the virtual key range, recording a first moment; When the coordinates of the fingertip are detected to be moved out of the virtual key range, recording a second moment; calculating a first time difference between the second time and the first time; judging whether the first time difference value is larger than or equal to a first time length and smaller than or equal to a second time length; and when the first time difference value is greater than or equal to a first time length and less than or equal to a second time length, determining the triggering state as effective triggering.
  7. 7. The vehicle-computer interaction method according to claim 6, wherein the method for judging whether the triggering state of the virtual key is a valid triggering further comprises: when detecting that the coordinates of the fingertip fall into the virtual key range again after the second moment, recording a third moment; Calculating a second time difference between the third time and the second time; judging whether the second time difference value is smaller than or equal to a third duration; and when the second time difference value is smaller than or equal to a third time length, prohibiting generation of a new trigger state.
  8. 8. The vehicle-computer interaction system is characterized by being used for realizing the vehicle-computer interaction method of any one of claims 1-7, and comprising the following steps: The virtual mapping module is used for defining virtual keys on the surface of the vehicle interior decoration and establishing a mapping relation between the virtual keys and the vehicle-mounted functions; the image acquisition module is used for acquiring image data containing the virtual keys in real time; the action recognition module is used for analyzing and extracting the behavior characteristics of the fingers of the user based on the image data; The trigger judging module is used for judging whether the trigger state of the virtual key is effective trigger or not according to the behavior characteristics; And the function execution module is used for activating the vehicle-mounted function mapped with the virtual key when the triggering state is effective triggering.
  9. 9. A readable storage medium storing program code for execution by one or more processors to cause an apparatus comprising the one or more processors to perform the vehicle-to-machine interaction method of any of claims 1-7.
  10. 10. A vehicle comprising the vehicle-to-machine interaction system of claim 8.

Description

Vehicle-computer interaction method and system, storage medium and vehicle Technical Field The application relates to the technical field of automobile machines, in particular to an automobile machine interaction method, an automobile machine interaction system, a storage medium and an automobile. Background With the acceleration of the intelligent process of automobiles, modern vehicles have integrated various functional systems such as navigation, entertainment, air conditioning, driving assistance and the like. Therefore, the user's demand for vehicle-mounted interaction tends to be complex from simple, and the required function buttons are increasing. The current vehicle-mounted interaction technology is mainly realized through modes such as physical keys, a touch screen, voice control, gesture recognition and the like. In particular, physical keys provide a direct way of operation by means of physical buttons, however, it is difficult to satisfy the requirement of function expansion due to the hardware quantity and layout having fixability, and frequent use is liable to cause wear. The touch screen adopts a large-size display screen to support touch input, and although the integration level is high, a driver needs to look at the screen to operate in the driving process, the accuracy of blind operation is low, and the risk of distraction driving is easily caused. The voice control executes the password instruction by using an acoustic recognition technology, so that although the voice control is convenient, the recognition rate of the voice control can be reduced under noisy road conditions, and the hidden danger of privacy disclosure exists. The gesture recognition technology captures the user action through the camera to realize non-contact operation, however, the gesture recognition is higher in false touch rate and higher in learning difficulty due to lack of physical touch feedback. Disclosure of Invention The application provides a vehicle-machine interaction method, a system, a storage medium and a vehicle, which aim to acquire pictures of the interior surface of the vehicle through a camera, further map a virtual key with a physical position of the interior surface in the system, and then judge whether a user finger tip coincides with the virtual key through the camera so as to achieve vehicle-machine interaction, solve the problems of difficult function expansion, high blind operation difficulty, high false touch rate and the like in the existing vehicle-machine interaction technology, and realize balance between the expansion requirement of the vehicle-machine interaction function and the operation habit of the physical key of the user. In order to achieve the above purpose, the application adopts the following technical scheme: the application provides a vehicle-machine interaction method, which comprises the following steps: Establishing a mapping relation between virtual keys defined on the surface of the vehicle interior and vehicle-mounted functions; acquiring image data containing the virtual key; acquiring behavior characteristics of a user finger based on the image data; Judging whether the triggering state of the virtual key is effective triggering or not based on the behavior characteristics; and when the triggering state is effective triggering, activating the vehicle-mounted function mapped with the virtual key. In the embodiment, the virtual keys capable of being positioned in a self-defined mode are established on the surface of the vehicle interior, and the virtual keys are mapped with the vehicle-mounted functions, so that the problems that the number of traditional physical keys is limited and cannot be expanded along with the intelligent requirements are fundamentally solved, and meanwhile, the potential safety hazards caused by the fact that the touch blind operation of the screen of the vehicle is difficult are effectively avoided. The application reserves the traditional operation habit of clicking the physical surface by the user, provides real physical contact feedback, does not need the user to learn a new interaction mode, and is particularly suitable for the groups with high dependence on physical operation, such as the elderly users, professional drivers and the like. In addition, the virtual keys are bound with the specific positions of the inner decoration surface, so that the operation experience close to the physical keys is achieved, a user can perform blind operation by means of muscle memory, the operation reliability is remarkably improved, the operation accuracy can reach more than 95%, the distraction risk caused by interactive operation in the driving process is effectively reduced, and the driving safety performance is greatly improved. The application obviously overcomes the inherent defects of high error touch rate and lack of operation feedback of non-contact gesture control, and simultaneously avoids the limitations of high-cost hardware transformatio