CN-120882604-B - Cabin control method, electronic system and vehicle

Abstract

The cabin control method, the electronic system and the vehicle relate to the technical field of electronic control, and can enable a user to experience media resources more realistically in dimensions such as vision, hearing and the like in the cabin, so that various experience requirements of the user are met. According to the method, the vehicle can acquire gesture information corresponding to different gestures of the user, and render images and audios in the media resources according to the currently acquired gesture information, when the gestures of the user change, the rendering of the images and the rendering of the audios change, and then the display effect and the audios of the images change. The head-mounted device connected with the vehicle can present dynamic image 3D visual effect along with the change of the user gesture for the user, the plurality of loudspeakers in the seat cabin can present dynamic immersive hearing effect along with the change of the user gesture for the user, the user can experience media resources in aspects such as vision and hearing in the seat cabin, the user has better feeling, and various experience demands of the user are met.

Inventors

• ZHU LIANGMING
• XIANG TENG

Assignees

• 深圳引望智能技术有限公司

Dates

Publication Date

20260508

Application Date

20240229

Claims (19)

1. 1. A cabin control method, characterized in that it is applied to a vehicle comprising at least two speakers respectively arranged at different positions in a cabin, said vehicle being connected to a head mounted device, said method comprising: acquiring media resources and first pose information of a user in the seat cabin, wherein the media resources comprise images and audios corresponding to the images; transmitting an image comprising a first display effect to the head-mounted device according to the first pose information, wherein the first display effect is a three-dimensional effect obtained according to the first pose information; controlling each loudspeaker to play the audio corresponding to the loudspeaker according to the first pose information, and obtaining the audio corresponding to each loudspeaker according to the audio in the media resource, the attribute information of the loudspeaker and the first pose information; Acquiring second pose information of a user in the seat cabin; Transmitting an image comprising a second display effect to the head-mounted device according to the second pose information, wherein the second display effect is a three-dimensional effect obtained according to the second pose information; Controlling each loudspeaker to play the audio corresponding to the loudspeaker according to the second pose information, and obtaining the audio corresponding to each loudspeaker according to the audio in the media resource, the attribute information of the loudspeaker and the second pose information; The method further comprises the steps of: acquiring image information of an image in the media resource, wherein the image information comprises one or more of season information, weather information, temperature information, place information, scene information or event information; And controlling functional components in the cabin to provide functions matched with the image information, wherein the functional components comprise one or more of a seat, an on-vehicle air conditioner, an on-vehicle air humidifier, an on-vehicle fragrance or a vibration unit on the seat.
2. 2. The method of claim 1, wherein the acquiring first pose information of the user within the pod comprises: Acquiring first information sent by the head-mounted equipment, wherein the first information is acquired by the head-mounted equipment through at least one sensor, and the first information comprises head posture information of a user; Acquiring second information through at least one sensor in the cabin, wherein the second information comprises one or more of image information, infrared information of a user, seat position information of a seat where the user is located, seat back angle information, seat angle information or seat bearing pressure information; and determining the first pose information according to the first information and the second information.
3. 3. The method of claim 1 or 2, wherein the second display effect is an effect after the first display effect is changed, and wherein the change in display effect comprises a change in one or more of an image perspective, an image content, or an image size.
4. 4. The method of claim 1, wherein the audio corresponding to each speaker varies according to changes in user pose information, and wherein the changes in audio include changes in one or more of audio frequency, audio amplitude, audio delay, audio phase, or audio spectral characteristics.
5. 5. The method of claim 1, wherein the functional component comprises a vibratory unit on a seat, the vibratory unit comprising one or more, and each of the vibratory units being disposed at a different location on the seat; the controlling the functional components in the cabin to provide the matching function with the image information comprises: Determining vibration information corresponding to the vibration unit according to the image information, wherein the vibration information comprises vibration frequency and/or vibration intensity; and controlling the vibration unit to vibrate according to the vibration information.
6. 6. The method of claim 1, wherein the functional components comprise one or more of an on-board air conditioner, an on-board air humidifier, or an on-board fragrance; the controlling the functional components in the cabin to provide the matching function with the image information comprises: Determining setting information of the functional component according to the image information, wherein the setting information comprises one or more of a temperature set value corresponding to the vehicle-mounted air conditioner, a humidity set value corresponding to the vehicle-mounted air humidifier or smell information corresponding to the vehicle-mounted fragrance; And adjusting one or more of the temperature of the vehicle-mounted air conditioner, the humidity of the vehicle-mounted air humidifier or the smell of the vehicle-mounted fragrance according to the setting information.
7. 7. The method of claim 1, wherein the sending an image including a first display effect to the headset according to the first pose information comprises: determining a first display parameter of the image according to the first pose information, wherein the first display parameter is used for representing a first display effect of the image; rendering the image according to the first display parameter; and sending the image subjected to the rendering processing to the head-mounted equipment.
8. 8. The method of claim 1, wherein controlling each speaker to play audio corresponding to the speaker according to the first pose information comprises: Acquiring attribute information of the speakers for each speaker, wherein the attribute information comprises one or more of a position, a sounding direction or a frequency response of the speakers in the cabin; Determining a first playing parameter of the audio corresponding to the loudspeaker according to the audio in the media resource, the first pose information and the attribute information of the loudspeaker; rendering the audio corresponding to the loudspeaker according to the first playing parameter; and sending the audio subjected to the rendering processing to the loudspeaker so as to enable the loudspeaker to play the audio subjected to the rendering processing.
9. 9. The electronic system is characterized by comprising at least two speakers which are respectively arranged at different positions in the seat cabin, and the electronic system is connected with the head-mounted equipment, and also comprises an information acquisition module and a resource processing module; The information acquisition module is used for acquiring media resources and first pose information of a user in the seat cabin, wherein the media resources comprise images and audios corresponding to the images; The resource processing module is used for sending an image comprising a first display effect to the head-mounted equipment according to the first pose information, wherein the first display effect is a three-dimensional effect obtained according to the first pose information, controlling each loudspeaker to play audio corresponding to the loudspeaker according to the first pose information, and obtaining the audio corresponding to each loudspeaker according to the audio in the media resource, the attribute information of the loudspeaker and the first pose information; the information acquisition module is also used for acquiring second pose information of a user in the seat cabin; the resource processing module is further configured to send an image including a second display effect to the head-mounted device according to the second pose information, where the second display effect is a three-dimensional effect obtained according to the second pose information, control each speaker to play audio corresponding to the speaker according to the second pose information, and obtain audio corresponding to each speaker according to the audio in the media resource, attribute information of the speaker, and the second pose information; The resource processing module is further used for acquiring image information of images in the media resources, the image information comprises one or more of season information, weather information, temperature information, place information, scene information or event information, functional components in the cabin are controlled to provide functions matched with the image information, and the functional components comprise one or more of a seat, a vehicle-mounted air conditioner, a vehicle-mounted air humidifier, a vehicle-mounted fragrance or a vibration unit on the seat.
10. 10. The system of claim 9, wherein the information acquisition module is specifically configured to acquire first information sent by the headset, the first information is acquired by the headset through at least one sensor, the first information includes head posture information of a user, the second information is acquired by at least one sensor in the cabin, the second information includes one or more of image information, infrared information, seat position information of a seat where the user is located, seat back angle information, seat angle information, or seat bearing pressure information of the user, and the first posture information is determined according to the first information and the second information.
11. 11. The system of claim 9 or 10, wherein the second display effect is an effect that is a result of a change in the first display effect, and wherein the change in display effect comprises a change in one or more of an image perspective, an image content, or an image size.
12. 12. The system of claim 9, wherein the audio corresponding to each speaker varies according to changes in user pose information, and wherein the changes in audio include changes in one or more of audio frequency, audio amplitude, audio delay, audio phase, or audio spectral characteristics.
13. 13. The system according to claim 9, wherein the functional component comprises a vibration unit on a seat, the vibration unit comprises one or more vibration units, each vibration unit is arranged at a different position on the seat, the resource processing module is specifically used for determining vibration information corresponding to the vibration unit according to the image information, the vibration information comprises vibration frequency and/or vibration intensity, and the vibration unit is controlled to vibrate according to the vibration information.
14. 14. The system according to claim 9, wherein the functional component comprises one or more of a vehicle-mounted air conditioner, a vehicle-mounted air humidifier, or a vehicle-mounted fragrance, the resource processing module is specifically configured to determine setting information of the functional component according to the image information, the setting information comprises one or more of a temperature set value corresponding to the vehicle-mounted air conditioner, a humidity set value corresponding to the vehicle-mounted air humidifier, and fragrance information corresponding to the vehicle-mounted fragrance, the fragrance information comprises a target fragrance type and/or fragrance concentration, and one or more of a temperature of the vehicle-mounted air conditioner, a humidity of the vehicle-mounted air humidifier, or a fragrance of the vehicle-mounted fragrance is adjusted according to the setting information.
15. 15. The system according to claim 9, wherein the resource processing module is specifically configured to determine a first display parameter of the image according to the first pose information, the first display parameter is used to characterize a first display effect of the image, render the image according to the first display parameter, and send the rendered image to the head-mounted device.
16. 16. The system of claim 9, wherein the resource processing module is specifically configured to obtain, for each speaker, attribute information of the speaker, where the attribute information includes one or more of a position, a sound emitting direction, or a frequency response of the speaker in the cabin, determine a first playing parameter of audio corresponding to the speaker according to audio in the media resource, the first pose information, and the attribute information of the speaker, perform rendering processing on the audio corresponding to the speaker according to the first playing parameter, and send the audio subjected to the rendering processing to the speaker, so that the speaker plays the audio subjected to the rendering processing.
17. 17. A vehicle comprising a memory, one or more processors, the memory coupled to the processors, wherein the memory has stored therein computer program code comprising computer instructions that, when executed by the processors, cause the vehicle to perform the cabin control method of any one of claims 1-8.
18. 18. A computer readable storage medium comprising computer instructions which, when run on a vehicle, cause the vehicle to perform the cabin control method as claimed in any one of claims 1 to 8.
19. 19. A computer program product, characterized in that the computer program product, when run on a vehicle, causes the vehicle to carry out the cabin control method as claimed in any one of claims 1-8.

Description

Cabin control method, electronic system and vehicle Technical Field The present application relates to the field of electronic control technologies, and in particular, to a cabin control method, an electronic system, and a vehicle. Background In recent years, with the rapid development of intelligent automobiles, users have also made higher demands on functions provided by the intelligent automobiles. For example, users may wish to not only have smart vehicles with excellent performance in driving, but also better experience in entertainment. At present, a part of video and audio systems, display systems or automatic driving systems of intelligent automobiles can be connected with head-mounted equipment such as Virtual Reality (VR) equipment, augmented reality (augmented reality, AR) equipment and the like, so that visual experience of high-definition large-screen viewing is provided for users in cabins of the automobiles, or multidimensional driving virtual scene pictures are provided for the users in automatic driving scenes, and the users are personally on the scene. However, the above provided viewing experience or virtual scene experience is single or simple in function, and cannot meet multiple experience requirements of users. Disclosure of Invention The embodiment of the application provides a cabin control method, an electronic system and a vehicle, which can enable a user to experience media resources more realistically in dimensions such as vision, hearing and the like in a cabin, and meet various experience requirements of the user. In order to achieve the above purpose, the embodiment of the present application adopts the following technical scheme: In a first aspect, a cabin control method is provided, applied to a vehicle, the vehicle comprising at least two speakers respectively arranged at different positions in a cabin, the vehicle being connected to a head mounted device. In the method, a vehicle acquires a media resource and first pose information of a user in a cabin, wherein the media resource comprises an image and audio corresponding to the image. Then, the vehicle sends an image including a first display effect to the head-mounted device according to the first pose information, wherein the first display effect is a three-dimensional effect obtained according to the first pose information. And controlling each loudspeaker to play audio corresponding to the loudspeaker by the vehicle according to the first pose information, wherein the audio corresponding to each loudspeaker is obtained according to the audio in the media resource, the attribute information of the loudspeaker and the first pose information. The vehicle continues to acquire second pose information of the user in the cabin, and sends an image comprising a second display effect to the head-mounted device according to the second pose information, wherein the second display effect is a three-dimensional effect obtained according to the second pose information. And controlling each loudspeaker to play the audio corresponding to the loudspeaker according to the second pose information, and obtaining the audio corresponding to each loudspeaker according to the audio in the media resource, the attribute information of the loudspeaker and the second pose information. According to the method, the first pose information and the second pose information can represent information respectively corresponding to the user when the user is in different poses in the seat cabin, the vehicle can send images corresponding to or matched with the current poses of the user to the head-mounted equipment, and control the loudspeaker to play audio corresponding to or matched with the current poses of the user, so that the head-mounted equipment can present dynamic three-dimensional visual effects changing along with the poses of the user for the user, a plurality of loudspeakers in the seat cabin can present dynamic immersive hearing effects changing along with the poses of the user for the user, the user can experience media resources in the seat cabin in visual and auditory aspects, the user has better experience, and multiple experience requirements of the user are met. In an implementation manner of the first aspect, when the vehicle acquires the media resource, the media resource may be acquired from a storage space of the vehicle, or the media resource may be acquired from a server. And the media assets include two-dimensional media assets, three-dimensional media assets, panoramic media assets, VR media assets, or AR media assets. So that the vehicle can provide different media assets for the user to experience. In an implementation manner of the first aspect, when the vehicle acquires first pose information of the user in the cabin, first information sent by the head-mounted device may be acquired, where the first information is acquired by the head-mounted device through at least one sensor, and the first information includes head pose in