US-12626575-B2 - Human sensing-based automatic control method, first electronic device, and system

US12626575B2US 12626575 B2US12626575 B2US 12626575B2US-12626575-B2

Abstract

The system includes a hub device, a first electronic device, and a second electronic device. The first electronic device includes a first ultra-wide band module and a millimeter-wave radar module. Position information of the second electronic device and position information of a user are obtained based on position measurement for the second electronic device, measurement for a human body position, and conversion that are performed by the first electronic device. At least one second electronic device automatically performs a preset operation based on the position information of the user and the position information of the second electronic device.

Inventors

Wei Dong
Haowei XU
PEI YAO
Xiao Wang

Assignees

HUAWEI TECHNOLOGIES CO., LTD.

Dates

Publication Date: 20260512
Application Date: 20220830
Priority Date: 20211025

Claims (20)

1 . A human sensing-based automatic control method for a human sensing-based communication system, the system comprising a hub device, a first electronic device, and one or more second electronic devices, any two of the hub device, the first electronic device, and a second electronic device of the one or more second electronic devices communicate in a wired or wireless communication manner, the first electronic device comprises a first ultra-wide band module and a millimeter-wave radar module, and the one or more second electronic devices include a playing device, the method comprising: obtaining, by the hub device, based on measurement and conversion performed by the first electronic device on a human body position and based on communication between the hub device and the first electronic device, a position information of a user in a whole-house coordinate system provided by the hub device; obtaining, by the hub device, an exception of the user that occurred, and sending a first message to the playing device; and receiving, by the playing device, the first message, and sending query information.
2 . The method according to claim 1 , wherein the obtaining, by the hub device, the exception of the user that occurred comprises: obtaining, by the hub device, that the user falls; or obtaining, by the hub device, that a heartbeat or a breath of a static user is not detected within a first duration.
3 . The method according to claim 2 , wherein the method further comprises: if the playing device receives a user reply speech within a preset duration after the playing device sends the query information, executing, by the playing device, a corresponding instruction based on semantics of the user reply speech.
4 . The method according to claim 3 , wherein the executing, by the playing device, the corresponding instruction based on the semantics of the user reply speech comprises: determining, by the playing device and based on the user reply speech, that the user needs help and sending alarm information to a remote device; or determining, by the playing device and based on the user reply speech, that the user does not need help, stopping receiving the user reply speech; or executing, by the playing device, a first instruction based on the user reply speech.
5 . The method according to claim 4 , wherein the method further comprises: sending, by the playing device, the alarm information to the remote device if the playing device does not receive a user reply within the preset duration after the playing device sends the query information.
6 . The method according to claim 2 , wherein the method further comprises: sending, by the hub device, the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved; and receiving, by the playing device, the first message, and sending the query information.
7 . The method according to claim 2 , wherein the playing device is closest to the user in the one or more second electronic devices.
8 . The method according to claim 1 , wherein the method further comprises: if the playing device receives a user reply speech within a preset duration after the playing device sends the query information, executing, by the playing device, a corresponding instruction based on semantics of the user reply speech.
9 . The method according to claim 8 , wherein the executing, by the playing device, the corresponding instruction based on the semantics of the user reply speech comprises: determining, by the playing device and based on the user reply speech, that the user needs help and sending alarm information to a remote device; or determining, by the playing device and based on the user reply speech, that the user does not need help, stopping receiving the user reply speech; or executing, by the playing device, a first instruction based on the user reply speech.
10 . The method according to claim 9 , wherein the method further comprises: sending, by the playing device, the alarm information to the remote device if the playing device does not receive a user reply within the preset duration after the playing device sends the query information.
11 . The method according to claim 1 , wherein the method further comprises: sending, by the hub device, the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved; and receiving, by the playing device, the first message, and sending the query information.
12 . The method according to claim 1 , wherein the playing device is closest to the user in the one or more second electronic devices.
13 . A hub device, wherein any two hub devices, a first electronic device, and one or more second electronic devices communicate in a wired or wireless communication manner, the first electronic device comprises a first ultra-wide band module and a millimeter-wave radar module, and the one or more second electronic devices include a playing device, the hub device comprising: a memory storing instructions; and at least one processor in communication with the memory, the at least one processor configured, upon execution of the instructions, to perform the following steps: obtain position information of a user in a whole-house coordinate system provided by the hub device, the position information being based on measurement and conversion performed by the first electronic device on a human body position and communication between the hub device and the first electronic device; and learn that an exception of the user has occurred; and send a first message to the playing device, the first message indicating the playing device is to send query information.
14 . The hub device according to claim 13 , wherein the hub device learns the exception of the user occurred comprises: the hub device learns that the user falls; or the hub device learns that a heartbeat or a breath of a static user is not detected within first duration.
15 . The hub device according to claim 14 , wherein the at least one processor further executes the instructions to perform the step of: the hub device sends the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved.
16 . The hub device according to claim 13 , wherein the at least one processor further executes the instructions to perform the step of: the hub device sends the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved.
17 . A human sensing-based automatic control method for a hub device, wherein any two hub devices, a first electronic device, and one or more second electronic devices communicate in a wired or wireless communication manner, the first electronic device comprises a first ultra-wide band module and a millimeter-wave radar module, the one or more second electronic devices include a playing device, the method comprising: obtaining, by the hub device based on measurement and conversion performed by the first electronic device on a human body position and based on communication between the hub device and the first electronic device, a position information of a user in a whole-house coordinate system provided by the hub device; obtaining, by the hub device, an exception of the user that occurred; and sending a first message to the playing device, the first message indicating the playing device is to send query information.
18 . The method according to claim 17 , wherein the obtaining, by the hub device, the exception of the user that occurred comprises: obtaining, by the hub device, that the user falls; or obtaining, by the hub device, that a heartbeat or a breath of a static user is not detected within a first duration.
19 . The method according to claim 18 , wherein the method further comprises: sending, by the hub device, the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved.
20 . The method according to claim 17 , wherein the method further comprises: sending, by the hub device, the first message to the playing device if the hub device learns, after the playing device sends the query information, that the user moved.

Description

This application is a National Stage of International Application No. PCT/CN2022/115867, filed on Aug. 30, 2022, which claims priority to Chinese Patent Application No. 202111243792.1, filed with the China National Intellectual Property Administration on Oct. 25, 2021. The disclosures of the aforementioned applications are hereby incorporated herein by reference in its entirety. TECHNICAL FIELD This application relates to the field of automatic control, and in particular, to a human sensing-based automatic control method, a first electronic device, and a system. BACKGROUND With rapid development of smart homes, more users install internet of things (IoT) devices (which may also be referred to as IoT devices, smart devices, or the like) in places such as homes or offices, and even install IoT devices throughout a house (which may also be referred to as whole-house intelligence, an all-in-one smart home, a smart manager, or the like). The users can experience convenience brought by the IoT devices. However, in the conventional technology, the user needs to carry a mobile device (for example, a smartphone or a wearable device) to implement automatic control of the IoT device through communication and sensing between the mobile device and the IoT device, and the like. The user sometimes forgets to carry the mobile device in places such as the home or the office, and cannot implement automatic control of the IoT device. As a result, inconvenience is brought to the user, and user experience is affected. SUMMARY On a basis of the foregoing background, how to make automatic control of an IoT device by a user more convenient, and further improve user experience becomes a problem to be considered. To resolve the foregoing technical problem, this application provides a human sensing-based automatic control method, a first electronic device, and a system. According to the technical solutions of this application, when a user approaches an IoT device, the IoT device automatically performs an operation, without performing any operation by the user or carrying any electronic device by the user neither. This greatly improves user experience. In addition, hardware of the IoT devices does not need to be modified neither. For example, a smart speaker generally has no camera and does not need to be additionally equipped with a camera. According to a first aspect, this application provides a human sensing-based communication system. The system includes a hub device, a first electronic device, and a second electronic device. Any two of the hub device, the first electronic device, and the second electronic device communicate in a wired communication or wireless communication manner. The first electronic device includes a first ultra-wide band module and a millimeter-wave radar module. The hub device obtains, based on position measurement for the second electronic device, measurement for a human body position, and conversion that are performed by the first electronic device, and communication between the hub device and the first electronic device, position information of the second electronic device and position information of a user in a whole-house coordinate system provided by the hub device. The hub device sends a first message to the second electronic device. The second electronic device receives the first message, and adjusts an air supply direction of the second electronic device based on a position of the second electronic device and a position of the user, so that the air supply direction of the second electronic device avoids the user. In this implementation, an air supply device automatically adjusts an air supply direction based on the position of the user, so that the air supply direction avoids the user. The user does not need to perform a manual operation, and the user does not need to carry any device neither. This improves convenience and comfort of using the air supply device by the user. According to the first aspect, the hub device further obtains an area of a region to which the second electronic device belongs, and sends a second message to the second electronic device. The second message includes first indication information. The first indication information indicates the area of the region to which the second electronic device belongs. The second electronic device receives the second message, and adjusts an air supply amount based on the second message. In this implementation, the air supply device automatically adjusts an air supply amount based on an area of a room or a region to which the air supply device belongs. A larger area indicates a larger air supply amount. This improves convenience of using the air supply device by the user. According to the first aspect or any implementation of the first aspect, before sending the first message to the second electronic device, the hub device determines, based on the position information of the user and the position information of the second electronic device, t