CN-122002126-A - Display device, method, driving chip and storage medium

CN122002126ACN 122002126 ACN122002126 ACN 122002126ACN-122002126-A

Abstract

The application provides a display device, a display method, a driving chip and a storage medium, and belongs to the technical field of display. In the device, a driving chip receives a picture set of a real scene shot by a first camera group, and generates display mode data corresponding to the picture set according to first gaze point information sent by a processor, so that a display panel can display the real scene according to the picture set and the display mode data. In the display device, the first camera group directly sends the picture set of the real scene to the driving chip, and the processor directly sends the first gaze point information to the driving chip, so that the picture set is not transmitted by the processor, the time consumed for transmitting the picture set is greatly shortened, the processor does not need to synthesize, render and other treatments on the picture set, the driving chip does not need to analyze the picture set to acquire the first gaze point information, the calculated amount consumed in the display process of pictures in the picture set is reduced, the time delay for displaying the pictures is shortened, and the perspective function with low time delay is realized.

Inventors

HAN PENG
GAO FENG
LUO QINGYAN
QIN RUIFENG
SHI JUANJUAN
WANG FEIFEI
CHEN LILI
ZHANG HAO
YAO CHAOQUAN

Assignees

京东方科技集团股份有限公司

Dates

Publication Date: 20260508
Application Date: 20241108

Claims (20)

1. The display device is characterized by comprising a first camera group, a processor, a driving chip and a display panel, wherein the first camera group and the processor are respectively connected with the driving chip, and the driving chip is connected with the display panel; The first camera group comprises at least one first camera, the at least one first camera is used for sending a shot picture set to the driving chip, the picture set comprises at least one picture, and the picture is obtained by shooting a real scene by the first camera; the processor is used for sending first gaze point information to the driving chip, wherein the first gaze point information indicates coordinates of a first gaze point, and the first gaze point is a point gazed by a user on the display panel in the process of displaying the picture set; The driving chip is used for generating display mode data corresponding to the picture set according to the received first gaze point information, sending the received picture set and the display mode data corresponding to the picture set to the display panel, wherein the display mode data indicates display modes of a plurality of display modules on the display panel in the process of displaying the picture set, and the display definition of the display modes of the display modules positioned in a target range around the first gaze point is larger than the display definition of the display modes of the display modules positioned outside the target range around the first gaze point; the display panel is used for displaying the real scene based on the received picture set and the display mode data corresponding to the picture set.
2. The apparatus of claim 1, wherein the driver chip is configured to: Determining first region information according to coordinates of a first gaze point indicated by the first gaze point information, wherein the first region information indicates a region, which is positioned around the first gaze point and is within the target range, on the display panel; And generating display mode data corresponding to the picture set according to the first region information.
3. The apparatus of claim 1, wherein the driver chip is further configured to perform optimization processing on the received pictures in the picture set to obtain the optimized picture set, and send the optimized picture set to the display panel.
4. The apparatus of claim 1, wherein, in a case where the first camera group includes a plurality of first cameras, the plurality of first cameras includes at least one narrow angle camera and at least one wide angle camera, a photographing range of the wide angle camera includes a photographing range of the narrow angle camera, the picture set includes a first picture and a second picture, the first picture is a picture taken by the narrow angle camera, and the second picture is a picture taken by the wide angle camera; The driving chip is used for: Determining second region information according to the coordinates of a first gaze point indicated by the first gaze point information and the size of the first picture, wherein the second region information indicates a region on the display panel within the size range of the first picture around the first gaze point; And sending the received first picture, the received second picture and display mode data corresponding to the first picture and the received second picture to the display panel.
5. The apparatus of claim 4, wherein a resolution of the first picture is greater than a resolution of the second picture; The driving chip is further used for respectively optimizing the first picture and the second picture to obtain the first picture and the second picture after optimization, and sending the first picture and the second picture after optimization to the display panel.
6. The apparatus of claim 1, wherein the processor is further configured to send a third picture to the driver chip, the third picture being a picture of a virtual scene; The driving chip is further configured to parse the third picture to obtain second gaze point information, generate display mode data corresponding to the third picture based on the second gaze point information, where the second gaze point information indicates coordinates of a second gaze point, and the second gaze point is a point gazed by a user on the display panel in a process of displaying the third picture.
7. The apparatus of claim 6, wherein the display apparatus further comprises a monitoring module for sending a switching control signal to the processor if a switching scenario is monitored; The processor is further used for responding to the switching control signal and sending first control information to the driving chip; The driving chip is further used for converting from a first state to a second state when the first control information is detected to indicate that a real scene is displayed, wherein the first state is a state of receiving pictures sent by the processor, and the second state is a state of receiving picture sets sent by the first camera group; And in the case that the first control information indicates to display a virtual scene, switching from the second state to the first state.
8. The apparatus of claim 7, wherein the processor is further configured to send second control information to the first camera group, the second control information being configured to trigger the first camera group to capture a real scene if the first control information indicates that a real scene is displayed.
9. The apparatus of claim 7, wherein during processing of each frame of pictures sent by the processor, the processor is further configured to send a first synchronization signal to the driver chip, where the first synchronization signal is configured to control the driver chip to process the pictures sent by the processor.
10. The apparatus of claim 1, wherein during processing of each picture set sent by the first camera group, the first camera group is further configured to send a second synchronization signal to the driving chip, where the second synchronization signal is used to control the driving chip to process the picture set sent by the first camera group.
11. The device of claim 1, wherein a first camera of the first camera set is fixed to the display device by a hinge structure; The display device further comprises a second camera group, wherein the second camera group comprises at least one second camera, and the second camera is used for sending pupil pictures of a user to the processor; The processor is further configured to obtain, according to the pupil picture of the user, a rotation direction and a rotation angle of a first camera in the first camera group relative to the display device, and control, according to the rotation direction and the rotation angle, the first camera to rotate through the rotating shaft structure.
12. The device of claim 11, wherein the spindle structure is secured to the display device by a slide rail structure; the processor is further configured to obtain a translation distance of a first camera in the first camera group relative to the display device according to the pupil picture of the user, and control the rotation shaft structure provided with the first camera to translate according to the translation distance through the slide rail structure.
13. The display method is characterized in that the method is applied to a display device, the device comprises a first camera group, a processor, a driving chip and a display panel, the first camera group and the processor are respectively connected with the driving chip, the driving chip is connected with the display panel, the first camera group comprises at least one first camera, and the method comprises the following steps: the at least one first camera sends a shot picture set to the driving chip, wherein the picture set comprises at least one picture, and the picture is obtained by shooting a real scene by the first camera; The processor sends first gaze point information to the driving chip, wherein the first gaze point information indicates coordinates of a first gaze point, and the first gaze point is a point gazed by a user on the display panel in the process of displaying the picture set; The driving chip generates display mode data corresponding to the picture set according to the received first gaze point information, and sends the received picture set and the display mode data corresponding to the picture set to the display panel, wherein the display mode data indicates display modes of a plurality of display modules on the display panel in the process of displaying the picture set, and the display definition of the display modes of the display modules positioned in a target range around the first gaze point is greater than the display definition of the display modes of the display modules positioned outside the target range around the first gaze point; the display panel displays a real scene based on the received picture set and display mode data corresponding to the picture set.
14. The driving chip is characterized by comprising a display mode data acquisition module; The display mode data acquisition module is used for generating display mode data corresponding to the received picture set according to the received first gaze point information, the first gaze point information indicates coordinates of a first gaze point, the first gaze point is a point gazed by a user on the display panel in the process of displaying the picture set, the display mode data indicates display modes of a plurality of display modules on the display panel in the process of displaying the picture set, and display definition of display modes of the display modules in a target range around the first gaze point is larger than display definition of display modes of the display modules outside the target range around the first gaze point.
15. The driving chip according to claim 14, wherein the display mode data acquisition module includes a region information acquisition unit and a timing control unit; The region information acquisition unit is used for determining first region information according to the coordinates of a first gaze point indicated by the first gaze point information, wherein the first region information indicates a region, which is positioned in the target range around the first gaze point, on the display panel; the time sequence control unit is used for generating display mode data corresponding to the picture set according to the first region information.
16. The driver chip of claim 14, further comprising an image signal processor; The image signal processor is used for optimizing the received pictures in the picture set to obtain the optimized picture set.
17. The driver chip of claim 14, wherein each image signal processor corresponds to one of the first cameras in the first camera set if there are a plurality of image signal processors.
18. The driver chip of claim 14, further comprising a switching module; The switching module is used for responding to the first control information and switching the picture source of the picture received by the driving chip, wherein the picture source comprises a first camera group and a processor.
19. A computer readable storage medium, characterized in that the computer readable storage medium is adapted to store at least one computer program for performing the method of claim 13.
20. A computer program product comprising a computer program which, when executed by a processor, implements the method of claim 13.

Description

Display device, method, driving chip and storage medium Technical Field The present application relates to the field of display technologies, and in particular, to a display device, a display method, a driving chip, and a storage medium. Background VR (Virtual Reality) technology is a technology that creates a Virtual world by means of a computer generated Virtual environment, thereby bringing the user with his immersive experience. VR devices are devices that apply VR technology to present a virtual environment to a user. In the process that the user uses VR equipment, people can't see the external world for user's sense of security is lower, therefore, VR equipment generally can be equipped with perspective function, makes the user see external reality environment through the camera on the VR equipment. At present, one implementation mode of the perspective function on the VR device is that a camera is installed on the VR device, the camera sends a shot picture to a processor in the VR device, the processor synthesizes and renders the received picture, and the processed picture is sent to a display module on the VR device for display. In the above implementation manner, the duration consumed by the processor in the VR device to synthesize and render the picture is long, and in addition, in this process, since the rest of the area is seen with the afterlight when the human eye is gazing at a certain place, and the area seen with the afterlight does not need to be displayed with high definition, the high definition display can be performed in the gazing area of the user, and the low definition display can be performed in the non-gazing area. Accordingly, the processor renders the gaze point information into the picture, so that after the display module receives the picture, the picture is analyzed to obtain the gaze point information, and then the picture is displayed according to the gaze point information, so that the time delay of the display module on the VR equipment for displaying the picture is longer. Disclosure of Invention The embodiment of the application provides a display device, a display method, a driving chip and a storage medium, which are used for shortening the time delay of displaying pictures. The technical scheme is as follows: In a first aspect, a display device is provided, the device includes a first camera group, a processor, a driving chip and a display panel, the first camera group and the processor are respectively connected with the driving chip, and the driving chip is connected with the display panel; the first camera group comprises at least one first camera, the at least one first camera is used for sending a shot picture set to the driving chip, the picture set comprises at least one picture, and the picture is obtained by shooting a real scene by the first camera; The processor is used for sending first gazing point information to the driving chip, the first gazing point information indicates coordinates of a first gazing point, and the first gazing point is a point gazed by a user on the display panel in the process of displaying the picture set; The driving chip is used for generating display mode data corresponding to the picture set according to the received first gaze point information, sending the received picture set and the display mode data corresponding to the picture set to the display panel, wherein the display mode data indicates the display modes of a plurality of display modules on the display panel in the process of displaying the picture set, and the display definition of the display modes of the display modules in the target range around the first gaze point is larger than the display definition of the display modes of the display modules outside the target range around the first gaze point; the display panel is used for displaying the real scene based on the received picture set and the display mode data corresponding to the picture set. In the display device provided by the application, the driving chip receives the picture set of the real scene shot by the first camera group, and generates the display mode data corresponding to the picture set of the real scene according to the first gaze point information sent by the processor, so that the display panel can display the real scene according to the picture set and the display mode data. In the display device, the first camera group directly sends the picture set of the real scene to the driving chip, and the processor directly sends the first gaze point information to the driving chip, so that the picture set is not transmitted by the processor, the time consumed for transmitting the picture set is greatly shortened, the processor does not need to synthesize and render the picture set and the like, the first gaze point information is not required to be rendered into the picture set, the driving chip does not need to analyze the picture set to acquire the first gaze point information, the calculated amo