Search

CN-122029071-A - Device and method for operating a user interface of a vehicle

CN122029071ACN 122029071 ACN122029071 ACN 122029071ACN-122029071-A

Abstract

An apparatus (100) for operating a user interface of a vehicle (102) comprises an output unit (106) of the vehicle (102) configured to output at least one element of the user interface of the vehicle (102) to a user (104). Furthermore, the device comprises a detection unit (108) configured to detect at least one information and to generate input data corresponding to the detected information, the information corresponding to user input of the user (104) and/or environmental information related to the environment of the vehicle (102). Furthermore, the device comprises a control unit (110) which is configured to control the output unit (106) of the vehicle (102) and to process the input data using at least one machine learning method. The control unit (110) is further configured to generate at least one element of a user interface of the vehicle (102) that can be output by the output unit (106) based on the input data and using the machine learning method, and to manipulate the output unit (106) to output the generated element.

Inventors

  • S. basil
  • P. Weidao Er
  • DISTLER ARMIN
  • L. Fleisch
  • S. Heikibor
  • A. PETERS
  • G. Lyle
  • C. Rivle
  • H Steene
  • J. L. von Forstner

Assignees

  • 宝马股份公司

Dates

Publication Date
20260512
Application Date
20241009
Priority Date
20231120

Claims (15)

  1. 1. A device (100) for operating a user interface of a vehicle (102), the device comprising: -an output unit (106) of the vehicle (102) configured to output at least one element of a user interface of the vehicle (102) to a user (104); a detection unit (108) configured to detect at least one information corresponding to a user input of the user (104) and/or environmental information related to the environment of the vehicle (102) and to generate input data corresponding to the detected information, and A control unit (110) configured to control the output unit (106) of the vehicle (102) and to process the input data using at least one machine learning method, Wherein the control unit (110) is further configured to generate at least one element of a user interface of the vehicle (102) that can be output by the output unit (106) based on the input data and using the machine learning method, and to manipulate the output unit (106) to output the generated element.
  2. 2. The device (100) according to claim 1, wherein the output unit (106) is configured to output visual information to the user (104), and the generated element is a visual element.
  3. 3. The device (100) according to claim 2, wherein the control unit (110) is configured to generate a first image with a first resolution using the machine learning method and to generate a second image with a second resolution as the visual element using another machine learning method based on the first image, wherein the second resolution is higher than the first resolution.
  4. 4. A device (100) according to claim 2 or 3, wherein the control unit (110) is configured to generate at least one visual element based on the input data and using the machine learning method, the visual element being part of a graphical user interface of the vehicle (102).
  5. 5. The device (100) according to claim 4, wherein the control unit (110) is configured to generate at least one further element of the user interface based on the generated visual element.
  6. 6. The device (100) according to any one of claims 2 to 5, wherein the control unit (110) is configured to generate a plurality of visual elements, which are part of a unified skin of the graphical user interface, based on the input data and using the machine learning method.
  7. 7. The device (100) according to any one of claims 2 to 6, wherein the detection unit (108) is configured to provide the input data in the form of natural language text, and the control unit (110) is configured to process the input data to generate the visual element using a text-to-image model as the machine learning method.
  8. 8. The device (100) according to any one of the preceding claims, wherein the output unit (106) is configured to output audible information to the user (104), and the element of the user interface is an audible element.
  9. 9. The device (100) according to any one of the preceding claims, wherein the detection unit (108) is configured to detect navigation information related to the vehicle (102) and/or weather information related to the environment of the vehicle (102) as the information.
  10. 10. The device (100) according to any one of the preceding claims, wherein the detection unit (108) comprises an image detection unit (114) of the vehicle (102), the image detection unit being configured to detect at least one image with an imaging of an area outside the vehicle (102) as the information and to generate image data corresponding to the image, and the input data comprises the image data.
  11. 11. The device (100) according to any one of the preceding claims, wherein the detection unit (108) comprises a mobile terminal (118) configured to detect the information, in particular to detect a user input of the user (104).
  12. 12. The device (100) according to any one of the preceding claims, wherein the machine learning method is a generative model, in particular a generation of an antagonism network.
  13. 13. The device (100) according to any one of the preceding claims, wherein the control unit (110) is configured to manipulate the output unit (106) to output at least one predefined question to the user (104), and the detection unit (108) is configured to detect an answer in the form of a user input by the user (104) as the information, and to generate input data corresponding to the answer.
  14. 14. The device (100) according to any one of the preceding claims, wherein the detection unit (108) is configured to detect feedback of the user (104) related to the generated element and to generate feedback data corresponding to the feedback, and the control unit (110) is configured to modify the machine learning method based at least on the feedback data.
  15. 15. A method for operating a user interface of a vehicle (102), wherein, Detecting at least one piece of information corresponding to a user input of a user (104) and/or environmental information related to the environment of the vehicle (102); generating input data corresponding to the detected information; Generating at least one element of a user interface of the vehicle (102) based on the input data and using a machine learning method, and The generated element is output by an output unit (106) of the vehicle (102).

Description

Device and method for operating a user interface of a vehicle Technical Field The present invention relates to a device for operating a user interface of a vehicle. The invention also relates to a method for operating a user interface of a vehicle. Background The user interface of modern vehicles comprises a plurality of output units, in particular visual output units for outputting visual information. Examples of visual output units are a combination meter, a Central Information Display (CID), a projector or a heads-up display. However, the lighting elements arranged in the vehicle interior or outside the vehicle may also form a visual output unit. The vehicle also has an audible output unit, such as a speaker of the vehicle's media playback system. The elements output by the output unit, such as elements of a graphical user interface or speech output, generally follow a uniform design. The design is preset by the factory, and the user can choose between a few designs at most. Many users, however, have a need to personalize the design of the user interface. But the storage space and bandwidth are limited so that a large number of user interface elements cannot be provided simply in a variety of designs. A method is known from DE102021206537A1, in which a graphical user interface for different devices and platforms is generated by means of a neural network. In the method, a second user interface for a second platform is generated based on functionality and visual features of a first user interface of the first platform. The second user interface may in particular be generated taking into account the limitations of the second platform. US10452902B1 discloses a method in which an image component of a patent drawing is generated by means of a generation countermeasure network. Reference is made by way of example to the patent drawings of a graphical user interface. Disclosure of Invention The object of the present invention is to provide a device and a method for operating a user interface of a vehicle, which can have a plurality of designs and use less memory space and/or bandwidth. This object is achieved by a device having the features of claim 1 and by a method having the features of the independent method claim. Advantageous developments are given in the dependent claims. The proposed device for operating a user interface of a vehicle comprises an output unit of the vehicle, which output unit is configured to output at least one element of the user interface of the vehicle to a user. The apparatus further includes a detection unit configured to detect at least one piece of information corresponding to user input of a user and/or environmental information related to a vehicle environment and generate input data corresponding to the detected piece of information. The apparatus further includes a control unit configured to control an output unit of the vehicle and process the input data using at least one machine learning method. The control unit is further configured to generate at least one element of the user interface of the vehicle that can be output by the output unit based on the input data and using the machine learning method, and to manipulate the output unit to output the generated element. The output unit may comprise, for example, a display surface facing the driver and/or another occupant of the vehicle or a loudspeaker of the vehicle. The detection unit comprises in particular an input unit for detecting user inputs and/or an environment sensing mechanism of the vehicle for detecting environment information. Further examples for the output unit and the detection unit are given in the following description relating to the embodiments. At least a part of the control unit may be constituted by a processing unit remote from the vehicle. For example, the machine learning method may be performed on a remote processing unit, while the manipulation of the output unit is performed locally on the vehicle. The device first detects information on the basis of which elements of the user interface should be generated. The information may be user input, such as a selection from a predefined text module or a prompt word freely entered by the user. The information may also be environmental information such as time of day, season or geographical region in which the vehicle is currently located. Further, the detected information may also be a combination of user input and environmental information. Input data is generated from the detected information, the input data being used as an input to a machine learning method. The input data may be modified, for example, or the input may be limited to a predefined framework, for example, to form a branding aesthetic framework for generating the element. Elements of the user interface are then generated using a machine learning method. The machine learning method may be a generic model or a model that is fine-tuned based on a small training dataset. The generic model has