US-12626332-B2 - Projection data processing method and apparatus

US12626332B2US 12626332 B2US12626332 B2US 12626332B2US-12626332-B2

Abstract

Embodiments of this application disclose a projection data processing method, to reduce a delay in a wireless projection process. In the embodiments of this application, the method includes: A projection transmit end obtains network status information, and determines a target resolution of an image to be projected based on the network status information; and then determines a to-be-synthesized layer based on whether the image is in a full-screen scenario. Therefore, an amount of data to be sent during projection can be reduced, and a projection delay can be reduced. In addition, a projection receive end can perform super-resolution on the image, to avoid image quality damage caused by reducing the amount of data sent by the transmit end. This solution reduces the projection delay and ensures projection image quality to improve user experience.

Inventors

Xindong SHI
Jun Li
Shu Wang
Jiangzheng Wu

Assignees

HUAWEI TECHNOLOGIES CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20230123
Priority Date: 20200730

Claims (20)

1 . A projection data processing method, comprising: obtaining, by a terminal, network status information indicating quality of a communication link between the terminal and a projection device; determining, by the terminal, a target resolution of an image to be projected based on the network status information; and selectively synthesizing, by the terminal, image data based on a current usage scenario and the target resolution, and sending, by the terminal, the image data to the projection device, wherein the image data is used by the projection device to display the image.
2 . The method according to claim 1 , wherein the target resolution is positively correlated with the quality of the communication link.
3 . The method according to claim 1 , wherein the network status information comprises a received signal strength indicator (RSSI).
4 . The method according to claim 3 , wherein the determining the target resolution of the image based on the network status information comprises: if a value of the RSSI is greater than or equal to a first threshold, determining, by the terminal, that the target resolution is a first resolution; if a value of the RSSI is less than a first threshold and is greater than or equal to a second threshold, determining, by the terminal, that the target resolution is half of a first resolution, wherein the second threshold is less than the first threshold; or if a value of the RSSI is less than the second threshold, determining, by the terminal, that the target resolution is one-third of a first resolution.
5 . The method according to claim 1 , further comprising: determining, by the terminal, the current usage scenario.
6 . The method according to claim 5 , wherein the determining the current usage scenario comprises: determining, by the terminal, whether the image is in a full-screen scenario, wherein the selectively synthesizing the image data based on the usage scenario and the target resolution comprises: if the terminal determines that the image is in the full-screen scenario, synthesizing, by the terminal, only an application layer of all layers of the image based on the target resolution; or if the terminal determines that the image is in a non-full-screen scenario, synthesizing, by the terminal, a system layer of the image and an application layer based on the target resolution.
7 . The method according to claim 6 , wherein the determining whether the image is in the full-screen scenario comprises: if a source resolution of the application layer is greater than or equal to a third threshold, determining, by the terminal, that the image is in the full-screen scenario; or if a source resolution of the application layer is less than the third threshold, determining, by the terminal, that the image is in the non-full-screen scenario.
8 . The method according to claim 6 , wherein the determining whether the image is in the full-screen scenario comprises: if a pixel aspect ratio of the application layer is the same as a pixel aspect ratio of a screen, determining, by the terminal, that the image is in the full-screen scenario; or if a pixel aspect ratio of the application layer is different from a pixel aspect ratio of a screen, determining, by the terminal, that the image is in the non-full-screen scenario.
9 . The method according to claim 6 , wherein the determining whether the image is in the full-screen scenario comprises: if a source resolution of the application layer is greater than or equal to a third threshold, and a pixel aspect ratio of the application layer is the same as a pixel aspect ratio of a screen, determining, by the terminal, that the image is in the full-screen scenario; or if a source resolution of the application layer is less than the third threshold, or a pixel aspect ratio of the application layer is different from a pixel aspect ratio of a screen, determining, by the terminal, that the image is in the non-full-screen scenario.
10 . An apparatus for processing projection data, comprising: a memory, and a processor coupled to the memory to store instructions, which when executed by the processor, cause the processor to perform operations, the operations comprising: obtaining network status information indication quality of a communication link between the apparatus and a projection device; determining a target resolution of an image to be projected based on the network status information; and selectively synthesizing image data based on a current usage scenario and the target resolution, and sending the image data to the projection device, wherein the image data is used by the projection device to display the image.
11 . The apparatus according to claim 10 , wherein the target resolution is positively correlated with the quality of the communication link.
12 . The apparatus according to claim 10 , wherein the network status information comprises a received signal strength indicator (RSSI).
13 . The apparatus according to claim 12 , wherein the determining the target resolution of the image based on the network status information comprises: if a value of the RSSI is greater than or equal to a first threshold, determine that the target resolution is a first resolution; if a value of the RSSI is less than a first threshold and is greater than or equal to a second threshold, determine that the target resolution is half of a first resolution, wherein the second threshold is less than the first threshold; or if a value of the RSSI is less than the second threshold, determine that the target resolution is one-third of a first resolution.
14 . The apparatus according to claim 10 , wherein the operations further comprise: determining the current usage scenario.
15 . The apparatus according to claim 14 , wherein the determining the current usage scenario comprises: determining whether the image is in a full-screen scenario, wherein the selectively synthesizing the image data based on the usage scenario and the target resolution comprises: in response to determining that the image is in the full-screen scenario, synthesizing only an application layer of all layers of the image based on the target resolution; or in response to determining that the image is in a non-full-screen scenario, synthesizing a system layer of the image and an application layer based on the target resolution.
16 . The apparatus according to claim 15 , wherein the determining whether the image is in the full-screen scenario comprises: if a source resolution of the application layer is greater than or equal to a third threshold, determining that the image is in the full-screen scenario; or if a source resolution of the application layer is less than the third threshold, determining that the image is in the non-full-screen scenario.
17 . The apparatus according to claim 15 , wherein the determining whether the image is in the full-screen scenario comprises: if a pixel aspect ratio of the application layer is the same as a pixel aspect ratio of a screen, determine that the image is in the full-screen scenario; or if a pixel aspect ratio of the application layer is different from a pixel aspect ratio of a screen, determine that the image is in the non-full-screen scenario.
18 . The apparatus according to claim 15 , wherein the determining, whether the image is in the full-screen scenario comprises: if a source resolution of the application layer is greater than or equal to a third threshold, and a pixel aspect ratio of the application layer is the same as a pixel aspect ratio of a screen, determining that the image is in the full-screen scenario; or if a source resolution of the application layer is less than the third threshold, or a pixel aspect ratio of the application layer is different from a pixel aspect ratio of a screen, determining that the image is in the non-full-screen scenario.
19 . A non-transitory computer-readable storage medium, comprising computer-readable instructions, wherein when executed on a computer, cause the computer to perform operations of processing projection data, the operations comprising: obtaining network status information indicating quality of a communication link between a terminal and a projection device; determining a target resolution of an image to be projected based on the network status information; and selectively synthesizing image data based on a current usage scenario and the target resolution, and sending the image data to the projection device, wherein the image data is used by the projection device to display the image.
20 . The non-transitory computer-readable storage medium of claim 19 , wherein the target resolution is positively correlated with the quality of the communication link.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application is a continuation of International Application No. PCT/CN2021/094510, filed on May 19, 2021, which claims priority to Chinese Patent Application No. 202010753147.3, filed on Jul. 30, 2020. The disclosures of the aforementioned applications are hereby incorporated by reference in their entireties. TECHNICAL FIELD This application relates to the field of projection technologies, and in particular, to a projection data processing method and apparatus. BACKGROUND In recent years, with rapid development of intelligent terminals, a mobile phone, a tablet computer, a computer, a projector, and a smart television are continuously iteratively upgraded. A wireless projection technology makes interaction between a plurality of screens, and corresponding application scenarios also become more diversified and popular. Against this background, seamless transfer of mobile-centric streaming media resources between devices is becoming a rigid demand. Wireless projection is a mode of interaction between a plurality of screens in the past one or two years. Common scenarios include screen mirroring, game projection, and multi-screen interaction. Mainstream wireless projection protocols include digital living network alliance (DLNA), Apple's airplay (Airplay), and Wi-Fi alliance-specified wireless display standard (Miracast). Currently, a delay of the three mainstream wireless projection modes is about 100 ms to 2000 ms, which is long and cannot meet a requirement of direct wireless projection in a game application. As a result, user experience is poor. SUMMARY Embodiments of this application provide a projection data processing method, to reduce a projection delay and improve user experience. A first aspect of an embodiment of the application provides a projection data processing method, including: A terminal obtains network status information, where the network status information indicates quality of a communication link between the terminal and a projection device; the terminal determines a target resolution of a to-be-projected image based on the network status information; and the terminal synthesizes image data based on the target resolution, and sends the image data to the projection device, where the image data is used by the projection device to display the to-be-projected image. The to-be-projected image may be understood as a static image, for example, a picture, or may be understood as a series of dynamic images, for example, a video. According to the projection data processing method provided in an embodiment of the application, the terminal determines the target resolution of the to-be-projected image by obtaining the network status information that indicates the quality of the communication link between the terminal and the projection device, and adjusts the target resolution based on real-time network status information. Compared with the conventional technology in which an image is sent at a fixed resolution, this method can be more flexibly adapted to a current scenario. In this method, the target resolution is determined by considering the network status information, and an amount of image data can be reduced by adjusting the resolution when wireless network communication quality is poor, thereby reducing a video image delay during projection, and improving user experience. In an embodiment of the first aspect, the target resolution is positively correlated with the quality of the communication link. According to the projection data processing method provided in an embodiment of the application, for example, when the quality of the communication link is poor, an image is sent at a low resolution to reduce a delay, and when the quality of the communication link is good, an image is sent at a high resolution to improve projection image quality. In an embodiment of the first aspect, the network status information includes a received signal strength indicator RSSI. According to the projection data processing method provided in an embodiment of the application, the quality of the communication link may be measured by using an RSSI signal, including a wireless communication link established based on a Wi-Fi protocol, a wireless communication link established based on a cellular mobile network protocol, or the like. In an embodiment, a correspondence between a value of the RSSI and the target resolution is preset. Therefore, a target in a current network status may be determined based on the RSSI signal. In an embodiment of the first aspect, that the terminal determines a target resolution of a to-be-projected image based on the network status information includes: if a value of the RSSI is greater than or equal to a first threshold, the terminal determines that the target resolution is a first resolution; if a value of the RSSI is less than a first threshold and is greater than or equal to a second threshold, the terminal determines that the target resolution