CN-116061810-B - Interactive display system based on carrier

CN116061810BCN 116061810 BCN116061810 BCN 116061810BCN-116061810-B

Abstract

The application discloses an interactive display system based on a carrier, which comprises the carrier, a controller, a computing unit and a display device, wherein the carrier is provided with a camera used for acquiring an environment image in a visual range in real time, the controller is used for controlling the movement of the carrier in a local environment, the computing unit is used for identifying whether the environment image acquired by the camera contains an obstacle in real time and acquiring corresponding virtual content information when determining that the environment image contains the obstacle, and the display device is used for receiving the environment image acquired by the camera and the generated virtual content information and displaying the environment image and the overlapped virtual content in real time. The interactive display system disclosed by the application is beneficial to improving the diversity of virtual display technology in the aspect of man-machine interaction.

Inventors

XIAO ANG
WANG QIGUANG
ZHAN WENJIE

Assignees

深圳松鼠机器人科技有限公司

Dates

Publication Date: 20260512
Application Date: 20230103

Claims (8)

1. A vehicle-based interactive display system, the system comprising: The camera is used for collecting environmental images in the visual range in real time; A controller for controlling movement of the vehicle in a local environment; the computing unit is used for identifying whether the environmental image acquired by the camera contains an obstacle or not in real time, and computing and acquiring the position data of the obstacle in the environmental image in real time and computing and determining the identity characteristic data of the obstacle when the environmental image contains the obstacle; calculating the association degree of the obstacle identity characteristic data and the characteristic data of the virtual content, determining the placement relation of the virtual content relative to the obstacle in the environment image according to the association degree and the position data of the obstacle in the environment image, wherein the placement relation comprises the mask relation between the virtual content and the obstacle in the environment image; The display device is used for receiving the environment image acquired by the camera and the generated virtual content information containing the placement relation, displaying the environment image in real time, and displaying virtual content in the environment image in a superposition mode at a position corresponding to the placement relation.
2. The system of claim 1, wherein the camera is mounted on the carrier via a rotary platform, the rotary platform being capable of horizontal rotational movement relative to the carrier, the controller comprising a camera rotation control module for controlling the horizontal rotational angle of the camera relative to the carrier.
3. The system of claim 2, further comprising a scanning unit for driving the camera to rotate horizontally with respect to the carrier for one revolution each time the camera is turned on, so as to obtain information on the surrounding environment of the carrier.
4. The system of claim 1, wherein the computing unit is further configured to compare the acquired location data with a preset area of an environmental image, and generate obstacle avoidance cues when the location data is within the preset area; and the display equipment receives the obstacle avoidance prompt information and displays the obstacle avoidance prompt information.
5. The system of claim 1, wherein the computing unit is further configured to calculate an area occupation ratio of the obstacle in the environmental image, and calculate a display proportion value of the corresponding virtual content based on the area occupation ratio; the display device displays corresponding virtual content in proportion to the display proportion value based on the display proportion value.
6. The system of claim 1, wherein the system further comprises a server, and the computing unit further transmits the generated virtual content information to the server for a display device in a different place to display virtual content corresponding to the local obstacle.
7. The system of claim 1, wherein the system further comprises a server that receives another piece of virtual content information, the another piece of virtual content comprising another piece of virtual content that is correspondingly generated based on an obstacle in the off-site environment captured by a camera on the off-site carrier; the display device is further configured to superimpose and display the other virtual content.
8. The system of claim 1, wherein the vehicle further comprises a first vehicle and a second vehicle, the first vehicle being controlled by a first controller and moving in a local environment, the second vehicle being controlled by a second controller and moving in a local environment; The computing unit is used for judging whether the environment image acquired by the camera of the first carrier contains an obstacle or not in real time, and generating corresponding first virtual content information when the obstacle is determined to be contained; the computing unit is also used for acquiring the position information of the first and second carriers in the local environment and generating virtual position content information of the second carrier relative to the first carrier; The display device receives the virtual position content information, and displays the environment image and the superimposed first virtual content, and simultaneously displays the content of the virtual position of the second carrier relative to the first carrier.

Description

Interactive display system based on carrier Technical Field The application relates to the technical field of computers, in particular to an interactive display system based on a carrier. Background With the development of technology, machine intelligence and information intelligence are increasingly popular, and virtual display technology has been put into daily life of people. For example, in the augmented reality technology, a real environment image is shot and displayed by a camera of an intelligent terminal, and a virtual object is generated by overlapping and displaying the real environment image, which is a common presentation mode. The existing virtual display technology lacks of diversified applications, and how to further improve the diversity of the virtual display technology in human-computer interaction has become an important research direction of technicians. Disclosure of Invention The application provides an interactive display system based on a carrier, which comprises the carrier, a controller, a computing unit and a display device, wherein the carrier is provided with a camera, the camera is used for acquiring an environment image in a visual range in real time, the controller is used for controlling the movement of the carrier in a local environment, the computing unit is used for identifying whether the environment image acquired by the camera contains an obstacle in real time and acquiring corresponding virtual content information when the environment image is determined to contain the obstacle, and the display device is used for receiving the environment image acquired by the camera and the generated virtual content information and displaying the environment image and the superimposed virtual content in real time. Further, the camera is installed on the carrier through a rotating platform, the rotating platform can horizontally rotate relative to the carrier, and the controller comprises a camera rotation control module for controlling the horizontal rotation angle of the camera relative to the carrier. Further, the system further comprises a scanning unit, wherein the scanning unit is used for driving the camera to horizontally rotate for one circle relative to the carrier when the camera is started each time, so that surrounding environment information of the carrier is obtained. Further, the computing unit is also used for computing and acquiring the position data of the obstacle in the environment image in real time when determining that the obstacle is contained, generating virtual content information containing the position information based on the position data, and the display equipment receives the virtual content information containing the position information and displays the virtual content in a superposition mode at the position corresponding to the position information in the environment image. Further, the computing unit is further used for comparing the acquired position information with a preset area of the environment image, generating obstacle avoidance prompt information when the position data are located in the preset area, and the display equipment receives and displays the obstacle avoidance prompt information. Further, the calculating unit is further used for calculating an area occupation ratio of the obstacle in the environment image and calculating a display proportion value of the corresponding virtual content based on the area occupation ratio; the display device displays corresponding virtual content in proportion to the display proportion value based on the display proportion value. Further, when determining that the obstacle is included, the computing unit is further used for computing and determining identity characteristic data of the obstacle, and generating virtual content information corresponding to the identity data of the obstacle based on the identity characteristic data. Further, the system further comprises a server, and the computing unit is further used for sending the generated virtual content information to the server, so that the local virtual content corresponding to the obstacle can be displayed by the display equipment at different places. Further, the system further comprises a server which receives information of another virtual content, the other virtual content comprises another virtual content which is correspondingly generated based on obstacles in a remote environment collected by a camera on the remote carrier, and the display device is further used for displaying the other virtual content in a superposition mode. The vehicle further comprises a first vehicle and a second vehicle, wherein the first vehicle is controlled by a first controller and moves in a local environment, the second vehicle is controlled by a second controller and moves in the local environment, the computing unit is used for judging whether an environment image acquired by a camera of the first vehicle contains an obstacle or not in real time and generati