US-12621246-B2 - Rendering and displaying data

Abstract

Systems and techniques are described herein for wireless communication. For instance, a method for wireless communication is provided. The method may include determining a first predicted pose of the device, the first predicted pose corresponding to a first time instance; transmitting, to a server, a request to process first data based on the first predicted pose; determining a change in a communication characteristic between the device and the server; and transmitting, to the server, in response to the change in the communication characteristic, a request to cease processing the first data.

Inventors

• Liangping Ma
• Nikolai Konrad Leung
• Thomas Stockhammer
• Imed Bouazizi

Assignees

• QUALCOMM INCORPORATED

Dates

Publication Date

20260505

Application Date

20240102

Claims (20)

1. 1 . An apparatus for wireless communication at a device, the apparatus comprising: at least one memory; and at least one processor coupled to the at least one memory and configured to: determine a first predicted pose of the device, the first predicted pose corresponding to a first time instance; cause at least one transmitter to transmit, to a server, a request to render a first frame of image data based on the first predicted pose; determine a change in a communication characteristic between the device and the server; and cause the at least one transmitter to transmit, to the server, in response to the change in the communication characteristic, a request for the server to cease rendering the first frame of image data.
2. 2 . The apparatus of claim 1 , wherein the at least one processor is further configured to: determine a second predicted pose of the device, the second predicted pose corresponding to a second time instance; and cause the at least one transmitter to transmit, to the server, a request to render a second frame of image data based on the second predicted pose.
3. 3 . The apparatus of claim 1 , wherein, to determine the first predicted pose of the device, the at least one processor is configured to predict the first predicted pose of the device based on at least one of: motion data from an inertial measurement unit (IMU) of the device; or a simultaneous localization and mapping (SLAM) technique based on images captured by the device.
4. 4 . The apparatus of claim 1 , wherein, to determine the first predicted pose, the at least one processor is configured to predict the first predicted pose of the device at the first time instance, and wherein the first time instance is after a current time.
5. 5 . The apparatus of claim 4 , wherein the first time instance is after a current time by a duration and wherein the duration is determined based on at least one of: a communication time between the device and the server; a rendering time associated with rendering the first frame of image data; an encoding time associated with encoding the first frame of image data; a communication time between the server and the device; or a decoding time associated with decoding the first frame of image data.
6. 6 . The apparatus of claim 1 , wherein the request to process the first frame of image data comprises an indication of the first predicted pose.
7. 7 . The apparatus of claim 1 , wherein the request to process the first frame of image data comprises at least one of: an indication of the first predicted pose; an identifier of the first predicted pose; or a timestamp indicative of the first time instance.
8. 8 . The apparatus of claim 7 , wherein the request to cease rendering the first frame of image data comprises at least one of: the indication of the first predicted pose; the identifier of the first predicted pose; or the timestamp indicative of the first time instance.
9. 9 . The apparatus of claim 1 , wherein the change in the communication characteristic comprises a change in a round-trip-time (RTT) for communication between the device and the server.
10. 10 . The apparatus of claim 9 , wherein the at least one processor is further configured to determine to transmit the request to cease rendering the first frame of image data based on a duration of the change in the RTT.
11. 11 . The apparatus of claim 9 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data in response to: the change in the RTT comprising an increase of the RTT, wherein the increase exceeds a first threshold; or the change in the RTT comprising a decrease of the RTT, wherein the decrease exceeds a second threshold.
12. 12 . The apparatus of claim 1 , wherein the change in the communication characteristic comprises a change in a bandwidth for communication between the device and the server.
13. 13 . The apparatus of claim 12 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data based on a degree of the change in the bandwidth.
14. 14 . The apparatus of claim 12 , wherein the at least one processor is further configured to determine to cause the at least one transmitter to transmit the request to cease rendering the first frame of image data in response to: the change in the bandwidth comprising an increase of the bandwidth, wherein the increase exceeds a first threshold; or the change in the bandwidth comprising a decrease of the bandwidth, wherein the decrease exceeds a second threshold.
15. 15 . The apparatus of claim 12 , wherein the at least one processor is further configured to cause the at least one transmitter to transmit a request to revise how to process data at the server based on the change in the bandwidth.
16. 16 . An apparatus for processing data at a server, the apparatus comprising: at least one memory; and at least one processor coupled to the at least one memory and configured to: receive, from a device, a request to render a first frame of image data based on a first predicted pose of the device, the first predicted pose corresponding to a first time instance; in response to the request to render the first frame of image data, initiate rendering of the first frame of image data; receive, from the device, a request to cease rendering the first frame of image data; and in response to the request to cease rendering the first frame of image data, cease rendering of the first frame of image data.
17. 17 . The apparatus of claim 16 , wherein the at least one processor is further configured to: receive, from the device, a request to render a second frame of image data based on a second predicted pose of the device, the second predicted pose corresponding to a second time instance; in response to the request to render the second frame of image data, render the second frame of image data; and cause at least one transmitter to transmit the second frame of image data to the device.
18. 18 . The apparatus of claim 17 , wherein, to render the second frame of image data, the at least one processor is configured to render the second frame of image data based on the second predicted pose and encode the second frame of image data.
19. 19 . The apparatus of claim 16 , wherein the request to render the first frame of image data comprises an indication of the first predicted pose.
20. 20 . The apparatus of claim 16 , wherein the request to process the first frame of image data comprises at least one of: an indication of the first predicted pose; an identifier of the first predicted pose; or a timestamp indicative of the first time instance.

Description

TECHNICAL FIELD The present disclosure generally relates to rendering and displaying data. For example, aspects of the present disclosure include systems and techniques for ceasing or canceling the rendering and/or display of data. BACKGROUND Some extended reality (XR) (including virtual reality (VR), augmented reality (AR), mixed reality (MR), etc.) generate data to be displayed at one device and display the data at a separate device. For example, an XR system may include a display component and a computing component. The computing component may render data and communicate the data to the display component and the display component may display the data. SUMMARY The following presents a simplified summary relating to one or more aspects disclosed herein. Thus, the following summary should not be considered an extensive overview relating to all contemplated aspects, nor should the following summary be considered to identify key or critical elements relating to all contemplated aspects or to delineate the scope associated with any particular aspect. Accordingly, the following summary presents certain concepts relating to one or more aspects relating to the mechanisms disclosed herein in a simplified form to precede the detailed description presented below. Systems and techniques are described for wireless communication. According to at least one example, a method is provided for wireless communication. The method includes: determining a first predicted pose of the device, the first predicted pose corresponding to a first time instance; transmitting, to a server, a request to process first data based on the first predicted pose; determining a change in a communication characteristic between the device and the server; and transmitting, to the server, in response to the change in the communication characteristic, a request to cease processing the first data. In another example, an apparatus for wireless communication is provided that includes at least one memory and at least one processor (e.g., configured in circuitry) coupled to the at least one memory. The at least one processor configured to: determine a first predicted pose of the device, the first predicted pose corresponding to a first time instance; cause at least one transmitter to transmit, to a server, a request to process first data based on the first predicted pose; determine a change in a communication characteristic between the device and the server; and cause the at least one transmitter to transmit, to the server, in response to the change in the communication characteristic, a request to cease processing the first data. In another example, a non-transitory computer-readable medium is provided that has stored thereon instructions that, when executed by one or more processors, cause the one or more processors to: determine a first predicted pose of the device, the first predicted pose corresponding to a first time instance; cause at least one transmitter to transmit, to a server, a request to process first data based on the first predicted pose; determine a change in a communication characteristic between the device and the server; and cause the at least one transmitter to transmit, to the server, in response to the change in the communication characteristic, a request to cease processing the first data. In another example, an apparatus for wireless communication is provided. The apparatus includes: means for determining a first predicted pose of the device, the first predicted pose corresponding to a first time instance; means for transmitting, to a server, a request to process first data based on the first predicted pose; means for determining a change in a communication characteristic between the device and the server; and means for transmitting, to the server, in response to the change in the communication characteristic, a request to cease processing the first data. In another example, a method is provided for processing data at a server. The method includes: receiving, from a device, a request to process first data based on a first predicted pose of the device, the first predicted pose corresponding to a first time instance; in response to the request to process the first data, initiating processing of the first data; receiving, from the device, a request to cease processing the first data; and in response to the request to cease processing the first data, ceasing to process the first data. In another example, an apparatus for processing data at a server is provided that includes at least one memory and at least one processor (e.g., configured in circuitry) coupled to the at least one memory. The at least one processor configured to: receive, from a device, a request to process first data based on a first predicted pose of the device, the first predicted pose corresponding to a first time instance; in response to the request to process the first data, initiate processing of the first data; receive, from the device, a request to cease proces