EP-4742634-A1 - CROSS-PLATFORM CLOUD OPERATING SYSTEM AND METHOD THEREOF

EP4742634A1EP 4742634 A1EP4742634 A1EP 4742634A1EP-4742634-A1

Abstract

A cloud operating system is configured in a remote computing device that is connected to a local terminal via a network. The local terminal serves as both a user operation terminal and a user application graphics interface receiving terminal. The cloud operating system includes: a base kernel for invoking physical and/or virtualized hardware resources of the remote computing device in response to a request; a runtime library for providing a runtime environment for at least one operating system platform based on the base kernel; an interface service module for providing at least one application programming interface corresponding to the runtime library; and an application service module for providing application interfaces and service integration to the local terminal.

Inventors

YANG, LIQUN

Assignees

Yang, Liqun

Dates

Publication Date: 20260513
Application Date: 20230705

Claims (20)

A cloud operating system, configured in a remote computing device that is connected to a local terminal via a network, the local terminal serving as both a user operation terminal and a user application graphics interface receiving terminal, the cloud operating system comprising: a base kernel for invoking physical and/or virtualized hardware resources of the remote computing device in response to a request; a runtime library for providing a runtime environment for at least one operating system platform based on the base kernel; an interface service module for providing at least one application programming interface corresponding to the runtime library; and an application service module for providing application interfaces and service integration to the local terminal.
The cloud operating system according to claim 1, wherein the application service module comprises: a device monitoring unit for acquiring hardware parameters and real-time operating status data from the local terminal; a graphics interface generation unit for generating a runtime graphics interface of a user application based on the hardware parameters of the local terminal; a cloud operation interface unit for maintaining operating interaction with the local terminal; and a driver interface unit for redirecting a required hardware driver request of an application in the remote computing device to a hardware driver request of the local terminal.
The cloud operating system according to claim 1 or 2, wherein the local terminal comprises a display screen, network communication hardware, and a local operating system, and the remote computing device comprises at least one selected from the group consisting of a cloud server, a virtual machine, a container, and a personal computer, and wherein at least a part of the cloud operating system is deployed on a remote server, a virtual machine, or a container.
The cloud operating system according to any one of claims 1 to 3, wherein the local terminal comprises a cloud operation desktop running within a browser framework in the local operating system of the local terminal, the cloud operation desktop comprising: a graphics interface control or add-ons providing a user graphics interface and a functional extension associated with the user graphics interface based on the browser framework; a local access unit connected to the graphics interface control or add-on, wherein the local access unit is configured to capture real-time user action data and to access local application information and hardware information in the local terminal; at least one service unit connected to the graphics interface control or add-on, for providing interactions of graphics interface images, videos, and audio between the local terminal and the remote system; and at least one client unit connected to both the service unit and the local access unit, for communicating and transmitting data with proxy service programs in the remote computing device.
The cloud operating system according to any one of claims 2 to 4, wherein at least one user application and at least one background service program are executed in a remote environment based on the application service module, wherein the device monitoring unit is configured to acquire hardware data of a screen and an input device provided in the local terminal after an authenticated connection between the local terminal and the remote computing device, and to receive data from a local application in the local terminal, wherein the graphics interface generation unit generates a graphics interface environment for presenting the user application, based on a graphics interface style and a default operational habit corresponding to a user account, and based on a configuration parameter in the hardware data acquired by the device monitoring unit, wherein the background service program captures a runtime graphics interface of the user application for generating a graphics interface image and transmitting the graphics interface image to the cloud operation desktop in the local terminal, wherein the cloud operation interface unit is invoked by the background service program to receive user action data in real-time from the local terminal, and convert the data into operation data for the remote computing device, and wherein the driver interface unit redirects source data intended for hardware execution from the remote computing device to the hardware of the local terminal, in response to a hardware resource request from the user application.
The cloud operating system according to any one of claims 2 to 5, wherein at least a portion of the graphics interface generation unit is provided by a graphics interface rendering engine of a browser framework of the remote computing device to generate the runtime graphics interface of the user application from a web page file received by the user application from the web server.
The cloud operating system according to any one of claims 2 to 6, wherein in response to a hardware resource request initiated by the user application via an application programming interface, the driver interface unit captures the source data from the memory area of the remote computing device and transmits the source data to the local terminal, wherein the hardware of the remote computing device acquires the source data upon being triggered by a remote driver program, and wherein in response to a command from the driver interface unit, a background service unit of the local terminal initiates hardware resource interfacing via an application programming interface to receive the source data, and triggers the local hardware to apply the source data by a local driver program.
The cloud operating system according to any one of claims 1 to 7, wherein the remote computing device comprises a cloud server and at least one virtual machine generated within the cloud server, wherein the runtime library, the interface service module, and the application service module of the cloud operating system are at least deployed in the virtual machine, and wherein system scheduling is provided among a plurality of virtual machines via a central proxy service center to allocate corresponding cloud operating system data and at least one virtual machine for the user account associated with the local terminal, based on the user database in the cloud server.
The cloud operating system according to any one of claims 1 to 8, wherein the base kernel is a Linux kernel, and the runtime library comprises at least one selected from the group consisting of a Linux runtime component, an Android runtime component, a Windows runtime component, and an iOS runtime component.
The cloud operating system according to any one of claims 1 to 9, wherein the interface service module comprises an interpreter or engine for interpreting and executing procedure codes of the user application.
A method for generating a remote graphics interface, comprising: establishing a network connection between a remote computing device and a local terminal, and serving the local terminal as an operation terminal of a user; acquiring user account information and hardware configuration parameters from the local terminal, the hardware configuration parameters comprising at least one of a local operating system type, a screen size, a display resolution and an input device type; retrieving a graphics interface style and operational habits corresponding to a user account or local operating system type from the user database in the remote computing device; generating a browser window within the browser framework of the remote computing device based on the acquired screen size or resolution of the local terminal; configuring a renderer to generate a graphics interface layout based on the graphics interface style; determining operational gestures for the browser window based on the operational habits, thereby establishing a graphics interface environment for a user application running within the browser framework; and capturing a graphics interface image of the browser window and transmitting the graphics interface image to the local terminal for display.
The method according to claim 11, wherein the renderer of the browser framework in the remote computing device is provided with HTML and CSS interpreters for processing a web page file and a script file that are received from a web server to generate a runtime graphics interface of a user application via a JavaScript engine, wherein the runtime graphics interface is converted into a graphics interface image via an add-on running within the browser framework of the remote computing device, and wherein the local terminal is provided with a browser framework to allow a browser control to receive and display the graphics interface image.
The method according to claim 11 or 12, comprising: adjusting the graphics interface image to be transmitted from the remote computing device to the local terminal prior to transmission, based on at least one of a current network transmission status, an application scenario status, a user command, a control status, and a display resolution of the local terminal, wherein at least a portion of the graphics interface image is dynamically generated, and wherein the adjusting comprises at least one of: slicing at least a portion of the graphics interface image, compressing at least a portion of the graphics interface image, and comparing at least a portion of the graphics interface image.
A method for transmitting graphics interface image for the cloud operating system according to any one of claims 1 to 10, the method comprising: establishing an operation data interaction connection between the local terminal and the remote computing device, wherein a change to at least a portion of the graphics interface of the remote computing device is caused by the operation data transmitted from the local terminal; transmitting graphics interface images from the remote computing device to the local terminal for at least a time period; dynamically adjusting a graphics interface image to be transmitted from the remote computing device based on a transmission interval of the transmitted graphics interface images from the remote computing device to the local terminal, wherein the dynamically adjusting comprises: determining, within a predetermined time period, the interval between image transmissions is less than an interval threshold, and performing, in a subsequent time period, at least one step of: reducing the number of the graphics interface images transmitted to the local terminal; and reducing the quality of the entire or a portion of the graphics interface image through image compression.
The method according to claim 14, wherein the step of dynamically adjusting the graphics interface image to be transmitted from the remote computing device comprises: detecting, in real-time, the current transmission interval of the graphics interface images in the same graphics interface area from the remote computing device to the local terminal; upon determining the current transmission interval to be less than a first time threshold, abandoning a graphics interface image to be transmitted in the current time of transmission; and upon determining the current transmission interval to be less than a second time threshold, reducing the quality of the graphics interface image to be transmitted, wherein the first time threshold is less than the second time threshold.
The method according to claim 14 or 15, wherein the step of dynamically adjusting the graphics interface image to be transmitted from the remote computing device comprises: detecting the current transmission interval of the graphics interface images in the same graphics interface area from the remote computing device to the local terminal; and upon determining the current transmission interval to be greater than a third time threshold, restoring the quality of the graphics interface image to be transmitted, or acquiring a higher quality graphics interface image from the cloud server for transmission to the local terminal.
The method according to claim 14, comprising: receiving, by the local terminal, graphics interface images from the remote computing device; and dynamically filtering at least one image of the graphics interface images from the remote computing device based on a real-time monitored operation interval of the local terminal, and displaying at least a portion of the filtered image on the local terminal.
The method according to claim 17, comprising: determining, during at least a time period, that the operation interval of the local terminal is less than a fourth time threshold; discarding at least one image of the graphics interface images received from the remote computing device for display on the local terminal; and reducing the transmission frequency of operation data from the local terminal to the computing device.
The method according to claim 17, wherein the step of dynamically filtering at least one image of the graphics interface images from the remote computing device comprises: determining, during at least a time period, that the operation interval of the local terminal is greater than a fifth time threshold, and retaining all received graphics interface images for display on the local terminal; and determining, during at least a time period, that the operation interval of the local terminal is greater than a sixth time threshold, and intermittently selecting graphics interface images for display on the local terminal from the received graphics interface images until the next operation of the local terminal occurs, wherein the sixth time threshold is greater than the fifth time threshold.
The method according to any one of claims 14 to 19, comprising: determining, during at least a time period, that the operation interval of the local terminal is greater than a seventh time threshold, and reducing the display frame rate of the local terminal until the next operation occurs.

Description

TECHNICAL FIELD The present invention relates to a cloud computing operating system and methods therefor, belong to the field of software and communication technology. BACKGROUND Smart terminals, such as smartphones, automotive infotainment devices, smart wearable devices, smart home appliances, etc., have become indispensable network service terminals in people's daily lives. The operating systems of these smart devices not only vary in type but also exhibit significant version differences and severe fragmentation. This necessitates accommodating the requirements and conventions of diverse operating system platforms across various types and versions when developing, installing, upgrading, and using user applications, causing increasing difficulties for both developers and users. In addition, the hardware configurations and replacement cycles of various smart devices vary significantly, making it difficult to synchronously enhance the user experience. For example, due to the increasingly bulky APP, it is necessary to replace the entire smartphone more frequently to acquire more local storage capacity, but the upgrade of other hardware on the phone leads to excessive performance, resulting in waste. For another instance, due to the low replacement frequency of the automotive infotainment device or the smart home appliance, the upgrade frequency and experience of APP that require human-machine interaction (HMI) running therein is also far below similar APP in the smartphones. Therefore, there is a need for a cross-platform and web-based operating system that can be compatible with various smart terminals, providing a unified user APP ecosystem with rich user experiences and simplified program development. Additionally, thanks to the continuous development of new-generation mobile communication technologies and the comprehensive coverage of network base station facilities, data interconnection between smart terminals and external servers has become faster, lower-latency, and more stable, providing the technical foundation and operational guarantees for web-based operating systems. SUMMARY The present invention provides a cross-platform cloud operating system and related methods, browsers, storage medium, terminals, servers, and the like, to address at least one of the technical problem existing in the prior art. According to an aspect of the invention, a cloud operating system is configured in a remote computing device but not deployed on a local terminal. The remote computing device is connected to the local terminal via a network, with the local terminal serving as the user operation terminal. The cloud operating system includes: a base kernel for invoking physical and/or virtualized hardware resources of the remote computing device in response to a request; a runtime library for providing a runtime environment for at least one operating system platform based on the base kernel; an interface service module for providing at least one application programming interface corresponding to the runtime library; and an application service module for providing application interfaces and service integration to the local terminal. According to another aspect, the present invention relates to a method for generating a remote graphics interface based on the cloud operating system. The method for generating a remote graphics interface includes the following steps of: establishing a network connection between a remote computing device and a local terminal, and serving the local terminal as an operation terminal of a user; acquiring user account information and hardware configuration parameters from the local terminal, the hardware configuration parameters including at least one of a local operating system type, a screen size, a display resolution and an input device type; retrieving a graphics interface style and operational habits corresponding to a user account or local operating system type from the user database in the remote computing device; generating a browser window within the browser framework of the remote computing device based on the acquired screen size or resolution of the local terminal; configuring a renderer to generate a graphics interface layout based on the graphics interface style; determining operational gestures for the browser window based on the operational habits, thereby establishing a graphics interface environment for a user application running within the browser framework; and capturing a graphics interface image of the browser window and transmitting the graphics interface image to the local terminal for display. According to another aspect, the present invention relates to a method for transmitting graphics interface image based on the cloud operating system. The method for transmitting graphics interface image includes the following steps of: establishing an operation data interaction connection between the local terminal and the remote computing device, wherein a change to at least a porti