US-12619301-B2 - Method and apparatus for adjusting display device

Abstract

A method and an apparatus is for adjusting a display device and includes: obtaining a first facial image of a first user; determining first spatial coordinates of a facial feature point of the first user based on the first facial image; and adjusting, based on the first spatial coordinates, an orientation of a first side of an image displayed by the display device, where the first side of the image includes information to be communicated to the first user.

Inventors

• Lu Yuan
• Jingfang ZHA

Assignees

• Shenzhen Yinwang Intelligent Technologies Co., Ltd.

Dates

Publication Date

20260505

Application Date

20241108

Priority Date

20220510

Claims (20)

1. 1 . A method, the method comprising: displaying a first image; obtaining a first facial image of a first user; adjusting, based on first spatial coordinates of a first facial feature point of the first user, an orientation of a first side of the first image, wherein the first spatial coordinates are based on the first facial image, and wherein the first side comprises first information to be communicated to the first user; obtaining a second facial image of the first user; and adjusting, when a distance between the first spatial coordinates and second spatial coordinates of the first facial feature point is greater than or equal to a preset threshold, the orientation of the first side based on the second spatial coordinates, wherein the second spatial coordinates are based on the second facial image.
2. 2 . The method according to claim 1 , wherein after adjusting, based on the first spatial coordinates, the orientation, the method further comprises: obtaining a third facial image of a second user; determining third spatial coordinates of a second facial feature point of the second user based on the third facial image; and adjusting, based on the third spatial coordinates, the orientation of the first side.
3. 3 . The method according to claim 1 , wherein prior to obtaining the first facial image, the method further comprises: obtaining audio information comprising a first voice instruction of the first user that indicates to start or adjust a display device; determining a sound source location of the audio information; determining a location of the first user based on the sound source location; and further obtaining the first facial image based on the location.
4. 4 . The method according to claim 3 , wherein the audio information further comprises a second voice instruction of a second user, and wherein the method further comprises: controlling the display device to display the first image and a second image; and adjusting the display device so that the first side faces the first user and a second side of the second image faces the second user, wherein the second side comprises second information to be communicated to the second user.
5. 5 . The method according to claim 1 , wherein the method further comprises adjusting, based on the first spatial coordinates, a location of the first image.
6. 6 . The method according to claim 1 , wherein prior to adjusting the orientation of the first side, the method further comprises: obtaining initial posture information indicating a posture angle and a location of a display device; determining a rotation angle and a rotation direction of the display device based on the first spatial coordinates and the initial posture information; and further adjusting, based on the rotation angle and the rotation direction, the orientation of the first side.
7. 7 . The method according to claim 1 , wherein the first spatial coordinates indicate a three-dimensional (3D) location of the first facial feature point in a vehicle comprising a display device.
8. 8 . The method according to claim 1 , wherein a display device comprises a holographic projection device, and wherein the first image comprises a three-dimensional (3D) image.
9. 9 . An apparatus comprising: a memory configured to store instructions; and one or more processors coupled to the memory and configured to execute the instructions to cause the apparatus to: display a first image; obtain audio information comprising a voice instruction of a first user that indicates to start or adjust a display device; obtain a first facial image of a first the first user based on a first location of the first user, wherein the first location is based on a sound source location of the audio information; and adjust, based on first spatial coordinates of a first facial feature point of the first user, an orientation of a first side of the first image, wherein the first spatial coordinates are based on the first facial image, and wherein the first side comprises first information to be communicated to the first user.
10. 10 . The apparatus according to claim 9 , wherein after adjusting, based on the first spatial coordinates, the orientation, the one or more processors are further configured to execute the instructions to cause the apparatus to: obtain a second facial image of a second user; determine second spatial coordinates of a second facial feature point of the second user based on the second facial image; and adjust, based on the second spatial coordinates, the orientation of the first side.
11. 11 . The apparatus according to claim 9 , wherein after adjusting, based on the first spatial coordinates, the orientation, the one or more processors are further configured to execute the instructions to cause the apparatus to: obtain a second facial image of the first user; determine second spatial coordinates of the first facial feature point based on the second facial image; and adjust, when a distance between the first spatial coordinates and the second spatial coordinates is greater than or equal to a preset threshold, the orientation of the first side based on the second spatial coordinates.
12. 12 . The apparatus according to claim 9 , wherein the audio information further comprises a second voice instruction of a second user, and the one or more processors are further configured to execute the instructions to cause the apparatus to: control the display device to display the first image and a second image; and adjust the display device so that the first side faces the first user and a second side of the second image faces the second user, wherein the second side comprises second information to be communicated to the second user.
13. 13 . The apparatus according to claim 9 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to adjust, based on the first spatial coordinates, a second location of the first image.
14. 14 . The apparatus according to claim 9 , wherein the first spatial coordinates indicate a three-dimensional (3D) location of the first facial feature point in a vehicle comprising the display device.
15. 15 . The apparatus according to claim 9 , wherein the one or more processors are further configured to execute the instructions to cause the apparatus to: obtain, prior to adjusting the orientation of the first side, initial posture information indicating a posture angle and a second location of the display device; determine a rotation angle and a rotation direction of the display device based on the first spatial coordinates and the initial posture information; and adjust, based on the rotation angle and the rotation direction, the orientation of the first side.
16. 16 . The apparatus according to claim 15 , wherein the display device comprises a holographic projection device, and wherein the first image comprises a three-dimensional (3D) image.
17. 17 . A computer program product comprising computer-executable instructions stored on a non-transitory computer-readable storage medium, wherein the computer-executable instructions when executed by one or more processors of an apparatus cause the apparatus to: display a first image; obtain a first facial image of a first user; adjust, based on first spatial coordinates of a first facial feature point of the first user, an orientation of a first side of the first image, wherein the first spatial coordinates are based on the first facial image, and wherein the first side comprises first information to be communicated to the first user; obtain a second facial image of a second user; and adjust, based on second spatial coordinates of a second facial feature point of the second user, the orientation of the first side, wherein the second spatial coordinates are based on the second facial image.
18. 18 . The computer program product according to claim 17 , wherein the computer-executable instructions when executed by the one or more processors further cause the apparatus to: obtain, prior to obtaining the first facial image, audio information comprising a voice instruction of the first user that indicates to start or adjust a display device; determine a sound source location of the audio information; determine a location of the first user based on the sound source location; and further obtain the first facial image based on the location.
19. 19 . The computer program product according to claim 17 , wherein the computer-executable instructions when executed by the one or more processors further cause the apparatus to: obtain a third facial image of the first user; determine third spatial coordinates of the first facial feature point based on the third facial image; and adjust, when a distance between the first spatial coordinates and the third spatial coordinates is greater than or equal to a preset threshold, the orientation of the first side based on the third spatial coordinates.
20. 20 . The computer program product according to claim 17 , wherein the first spatial coordinates indicate a three-dimensional (3D) location of the first facial feature point in a vehicle comprising a display device, wherein the display device comprises a holographic projection device, and wherein the first image comprises a 3D image.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This is a continuation of International Patent Application No. PCT/CN2022/137563 filed on Dec. 8, 2022, which claims priority to Chinese Patent Application No. 202210505723.1 filed on May 10, 2022. The disclosures of the aforementioned applications are hereby incorporated by reference in their entireties. TECHNICAL FIELD The present disclosure relates to the field of human-computer interaction, and more specifically, to a method and an apparatus for adjusting a display device. BACKGROUND With development of smart vehicles, more imaging display devices are integrated into a cockpit, for example, display devices such as a vehicle-mounted large screen, a head-up display (HUD) device, and a vehicle-mounted holographic image. However, display ranges of existing display devices are limited. When a user is in different locations, for the user, these display devices are not necessarily at a good display angle or location, and even a case in which imaging is incomplete and display is invisible may occur. Therefore, a method and an apparatus that can accurately adjust a display device based on a location of a user need to be developed urgently. SUMMARY The present disclosure provides a method and an apparatus for adjusting a display device, to accurately adjust, based on a location of a user, an orientation of an image displayed by the display device, and help improve user experience at a human-computer interaction level. According to a first aspect, a method for adjusting a display device is provided, and the method may be performed by a vehicle; or may be performed by a vehicle-mounted terminal of a vehicle, such as a vehicle-mounted head unit; or may be performed by a chip or a circuit used in a vehicle. This is not limited in the present disclosure. For ease of description, an example in which a vehicle performs the method is used below for description. The method may include: obtaining a first facial image of a first user; determining first spatial coordinates of a facial feature point of the first user based on the first facial image; and adjusting, based on the first spatial coordinates, an orientation of a first side of an image displayed by the display device, where the first side of the image includes information to be communicated to the first user. In the foregoing technical solution, the orientation of the image displayed by the display device is accurately adjusted based on a location of a user, so that use experience of the user can be improved at an interaction level. In some possible implementations, the first spatial coordinates are three-dimensional (3D) coordinates of the facial feature point of the user in a vehicle coordinate system. For example, the facial feature point may be located in any one or more of a center of eyebrows, an eye, an eyebrow, or a nose of the first user. Alternatively, the facial feature point may be a point at another location on a face of the first user. This is not specifically limited in embodiments of the present disclosure. In some possible implementations, the image may be a 3D image, for example, holographic projection. It should be understood that different angles of holographic projection include different information. Alternatively, the image may be a two-dimensional (2D) image that interacts with the first user and has a 3D feature, for example, a digital human. It should be understood that different interaction effects can be implemented when a face of the digital human faces different directions. For example, when the face of the digital human faces the first user, the first user can feel an effect of face-to-face communication with the digital human. For example, the image is a 3D image of a virtual assistant, and the first side of the image may be a side that includes a front side of a face of the virtual assistant. In another example, the image is a 3D image of the vehicle. To display a style of a front enclosure of the vehicle to the first user, the first side of the image may be a side that includes the front enclosure of the vehicle. For example, adjusting the orientation of the first side of the image may include adjusting a posture of the image. For example, when the image is a 3D image of a virtual assistant, a head posture of the image may be adjusted, so that a face of the image faces the first user. With reference to the first aspect, in some implementations of the first aspect, the method further includes: after the orientation of the first side of the image displayed by the display device is adjusted based on the first spatial coordinates, obtaining a second facial image of a second user; determining second spatial coordinates of a facial feature point of the second user based on the second facial image; and adjusting, based on the second spatial coordinates, the orientation of the first side of the image displayed by the display device. In some possible implementations, determining of the second spatial c