US-20260127829-A1 - INTELLIGENT INTERFACE BASED ON AUGMENTED REALITY

US20260127829A1US 20260127829 A1US20260127829 A1US 20260127829A1US-20260127829-A1

Abstract

An interaction method implemented by a terminal apparatus includes: obtaining an interface underlayer of a space that has direction information and distance information; establishing a mapping relationship between an external device and an identification corresponding to the external device marked on the interface underlayer, the identification indicating a physical location of the external device; receiving, from the external device, property information of the external device; obtaining an image of a real scene in the space; determining that a target object is depicted in the image of the real scene; determining target presentation information of the target object according to the property information of the external device; and displaying the image of the real scene together with the target presentation information, the target presentation information being added to the image as an augmented reality (AR) mark at an image location corresponding to the target object.

Inventors

Xin Shi
David Xing

Assignees

NORTHWEST INSTRUMENT INC.

Dates

Publication Date: 20260507
Application Date: 20251229
Priority Date: 20160107

Claims (16)

1 . A method for a terminal apparatus to interact with an external device, comprising: connecting the terminal apparatus with an external device to exchange information; generating and updating a measurement drawing by performing a measurement in a real time measurement process; displaying an interface underlayer on the terminal apparatus, the interface underlayer including the measurement drawing having direction information and distance information; marking, in the measurement process based on a digital object, the identification of the external device on the interface underlayer at an identification point indicating a current location of the external device in the measurement drawing; receiving, from the external device by the terminal apparatus, property information of the external device; displaying the property information of the external device on the measurement drawing of the interface underlayer; and sending a control command to the external device to control an operation of the external device.
2 . The method according to claim 1 , further comprising: obtaining, by the terminal apparatus, the digital object corresponding to the external device based on at least one of: a recording performed by the terminal apparatus to generate the digital object or accessing the digital object from an internal data storage of the terminal apparatus, the digital object including one or more of: a picture, a video, a text, and an audio.
3 . The method according to claim 1 , wherein: the measurement drawing is generated based on a ranging device.
4 . The method according to claim 1 , further comprising: calculating a plurality of location points and connecting the plurality of location points to form the measurement drawing.
5 . The method according to claim 4 , further comprising: calculating the plurality of current location points using trigonometric formulas: X=OX +sin( R )* L Y=OY +cos( R )* L wherein X is an x-axis coordinate of a current location point, Y is a y-axis coordinate of the current location point, OX is the x-axis coordinate of a last point, OY is the y-axis coordinate of the last point, R is a directional angle value when obtaining a distance data, L is a difference value of the distances between the current location point and the last point.
6 . The method according to claim 3 , further comprising: during the measurement using the ranging device, pausing the measurement, and re-starting the measurement by selecting one or more previous identifications as a new starting point.
7 . The method according to claim 1 , further comprising: opening an existing generated measurement drawing and continuing the measurement from an end of the existing generated measurement drawing.
8 . The method according to claim 1 , further comprising: outputting alarm information when the information of the external device is abnormal.
9 . The method according to claim 1 , wherein the information of the external device comprises an inherent property and operating data of the external device.
10 . The method according to claim 1 , further comprising: finding a due north direction as an initial measurement direction by rotating an azimuth sensor disposed on the ranging device during the measurement.
11 . The method according to claim 1 , further comprising: updating the identification corresponding to the external device in real time.
12 . The method according to claim 1 , further comprising: synchronizing and uploading the identification point and the corresponding information of the external device to a server for storage and on-demand distribution.
13 . A terminal apparatus, comprising a memory storing computer-executable instructions and a processor, the processor configured to perform: connecting the terminal apparatus with an external device to exchange information; generating and updating a measurement drawing by performing a measurement in a real time measurement process; displaying an interface underlayer on the terminal apparatus, the interface underlayer including the measurement drawing having direction information and distance information; marking, in the measurement process based on a digital object and, the identification of the external device on the interface underlayer at an identification point indicating a current location of the external device in the measurement drawing; receiving, from the external device by the terminal apparatus, property information of the external device; displaying the property information of the external device on the measurement drawing of the interface underlayer; and sending a control command to the external device to control an operation of the external device.
14 . The terminal apparatus according to claim 13 , wherein the processor is further configured to perform: obtaining, by the terminal apparatus, the digital object corresponding to the external device based on at least one of: a recording performed by the terminal apparatus to generate the digital object or accessing the digital object from an internal data storage of the terminal apparatus, the digital object including one or more of: a picture, a video, a text, and an audio.
15 . The terminal apparatus according to claim 13 , wherein the measurement drawing is generated based on a ranging device.
16 . The terminal apparatus according to claim 13 , wherein the processor is further configured to perform: calculating a plurality of location points and connecting the plurality of location points to form the measurement drawing.

Description

CROSS-REFERENCE TO RELATED APPLICATION This application is a continuation of U.S. application Ser. No. 18/155,589, filed on Jan. 17, 2023; U.S. application Ser. No. 18/155,589 is a continuation-in-part application of U.S. patent application Ser. No. 17/380,287 filed on Jul. 20, 2021, which is granted on Jan. 17, 2023 as U.S. Pat. No. 11,556,170; U.S. patent application Ser. No. 17/380,287 is a continuation-in-part application of U.S. patent application Ser. No. 15/547,939, which is granted on Jul. 20, 2021 as U.S. Pat. No. 11,069,100; U.S. patent application Ser. No. 15/547,939 is a national stage application of PCT Patent Application No. PCT/CN2016/070454, filed on Jan. 8, 2016, which claims priority to Chinese Patent Application No. 201610008470.1, filed on Jan. 7, 2016, the entire content of all the above-mentioned applications are incorporated herein by reference. TECHNICAL FIELD The present disclosure relates to the field of interactive control, and more particularly to an intelligent interface. BACKGROUND Currently, using a ranging device to measure and plan routes and areas is required almost in all aspects of people's life and work, such as in the field of construction, road engineering, transportation, pipeline laying, garden landscape, etc. Commonly used ranging devices are laser rangefinder and ranging wheel. Various ranging device structures have been disclosed in prior art. For example, CN201420143325.0 discloses an inner and outer optical path switching system of a laser rangefinder for realizing switch of the laser rangefinder in two working status of an inner optical path and an outer optical path. The switching system includes a laser source, a half transmitting half-reflecting mirror, a reflecting mirror, a shading plate, a motor and a motor-driven circuit. The shading plate is fixed on a rotating shaft of the motor and is driven by the motor to select to be at a first shading position or a second shading position. The laser emitted by the laser source is divided into two light waves of ranging light and inner reference light through the half-transmitting half-reflecting mirror. The ranging light penetrates through the half-transmitting half-reflecting mirror and forms the outer optical path. The inner reference light is reflected by the reflecting mirror and forms the inner optical path. For another example, CN201410152898.4 discloses a single optical path laser ranging system for accurate determination of the distance of measured object. The ranging system comprises a microprocessor, a signal generator, a laser generator, and a photodiode and frequency mixer. The microprocessor controls the signal generator to output two groups of pulse signals. One group of pulse signals are respectively sent to the laser generator and the photodiodes, to form a photoelectric mixed signal used by the outer optical path. Another group of pulse signals are sent to the frequency mixer for frequency mixing to generate a reference signal used by ranging. The microprocessor synchronously samples the photoelectric mixed signal and the reference signal, and calculates the voltage values of both signals to accurately obtain a measured distance value. However, it can be seen, from the technical solutions disclosed above, that conventional ranging device can only perform straight line ranging, none of them is capable of achieving the following functions: 1. measuring both a curve line route and a straight line distance, generating measurement drawings, directly designating line marking and dotting; 2. adding remark and description text, images, voice and video to the identification point; 3. performing synthetic imaging on ranging routes and real scene photos to enhance the visualizability; 4. monitoring and controlling the status of an intelligent device on a map. These issues greatly limit the application of ranging device. SUMMARY In accordance with the disclosure, there is provided an interaction method implemented by a terminal apparatus. The method includes: obtaining an interface underlayer of a space, the interface underlayer including a measurement drawing having direction information and distance information; establishing a mapping relationship between the external device and an identification corresponding to the external device marked on the interface underlayer, the identification indicating a physical location of the external device; receiving, from the external device, property information of the external device; obtaining an image of a real scene in the space; determining that a target object is depicted in the image of the real scene; determining target presentation information of the target object according to the property information of the external device; and displaying, on a display screen corresponding to the terminal apparatus, the image of the real scene together with the target presentation information, the target presentation information being added to the image as an augmented reality (