CN-122029009-A - Method, device, equipment and medium for acquiring article

Abstract

Methods, apparatus, devices, and media for acquiring items by robotic devices are provided. In one method, in response to receiving a user task, the robotic device moves to a target location specified by the user task, the user task instructs the robotic device to acquire a target item from the target location. The robotic device transitions to a pose for acquiring the target item. The robot device detects the target article based on the attribute information of the target article and the environmental information of the position. In response to detecting the target item, the robotic device places the target item into the target storage space. With the exemplary implementations of the present disclosure, the robotic device may find a matching target item according to the attribute information of the target item. In this way, the flexibility and accuracy of the robotic device in performing tasks in a complex environment may be improved, thereby completing the intended user tasks.

Inventors

• LI YIFENG
• ZHENG ZILIN
• KONG TAO

Assignees

• 北京有竹居网络技术有限公司

Dates

Publication Date

20260512

Application Date

20240910

Claims (17)

1. A method for acquiring an item, comprising: In response to receiving a user task, the robotic device moves to a target location specified by the user task, the user task instructing the robotic device to acquire a target item from the target location; The robot equipment is converted into a pose for acquiring the target object; the robot device detects the target object based on the attribute information of the target object and the environmental information of the position, and In response to detecting the target item, the robotic device places the target item into a target storage space.
2. The method of claim 1, wherein the environmental information of the target location comprises an image of the target location, and detecting the target item comprises identifying the target item from the image based on the attribute information.
3. The method of claim 2, further comprising: in response to the target item not being identified in the image, the robotic device moves a location of at least one item at the target location; Acquiring another image of the target location, and The target item is identified from the other image.
4. The method of claim 2, wherein the attribute information includes at least any one of an encoding, an image, and a feature of the target item.
5. The method of claim 2, wherein obtaining the attribute information comprises receiving user input for the image, the user input indicating a location of the target item.
6. The method of claim 2, wherein detecting the target item comprises: Determining a set of regions in the image, the regions in the set of regions comprising candidate items, and In response to receiving a selection for the region, candidate items corresponding to the region are acquired.
7. The method of claim 2, further comprising providing a message to indicate that the target item was not detected in response to determining that the target item was not detected at the target location.
8. The method of claim 1, further comprising: Receiving rules for acquiring the target items in response to detecting a plurality of target items at the target location, and The target item is selected from the plurality of target items based on the rule.
9. The method of claim 8, wherein the target item comprises a plurality of target items, and the robotic device placing the target item into the target storage space comprises: determining an order for acquiring the plurality of target items based on the rule, and The robotic device places the plurality of target items into the storage space in the order.
10. The method of claim 1, wherein the robotic device moving to the target location comprises: determining target position coordinates corresponding to a position code in response to determining that the target position is represented by the position code; Determining a navigation path between the current position coordinates of the robotic device and the target position coordinates, and The robotic device moves along the navigation path to the target location.
11. The method of claim 1, wherein the robotic device moving to the target location comprises: In response to determining that the target location is represented with a location image, the robotic device moves in a physical space including the target location to acquire an image of the physical space, and In response to determining that a location in the image is identified that matches the location image, the robotic device moves to the location.
12. The method of claim 1, wherein the user task further comprises a destination location, and the method further comprises: the robot device moving to an adjacent location corresponding to the destination location, and The robotic device moves the target item in the storage space to the destination location.
13. The method of claim 1, further comprising updating status data of at least one item at the target location in response to determining that the target item has been acquired from the target location.
14. An apparatus for acquiring an item, comprising: A movement module configured to, in response to receiving a user task, move a robotic device to a target location specified by the user task, the user task instructing the robotic device to acquire a target item from the target location; the conversion module is configured for converting the robot equipment into a pose for acquiring the target object; a detection module configured for the robot device to detect the target object based on the attribute information of the target object and the environmental information of the location, and A placement module configured to place the target item into a target storage space in response to detecting the target item.
15. An electronic device, comprising: at least one processing unit, and At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, which when executed by the at least one processing unit, cause the electronic device to perform the method of any one of claims 1 to 13.
16. A computer readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to implement the method of any of claims 1 to 13.
17. A computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 13.

Description

Method, device, equipment and medium for acquiring article Technical Field Example implementations of the present disclosure relate generally to the field of robots and, more particularly, relate to methods, apparatuses, devices, and computer-readable storage media for acquiring items using robots. Background Robotics have been rapidly developed and have been widely used in a variety of technical fields. A variety of specialized robotic devices have been developed, for example, in an industrial environment, robots may be used to perform a variety of tasks such as processing, grasping, sorting, packaging, and the like. As another example, in a home environment, a floor sweeping robot, a glass wiping robot, and the like have been developed. However, robots are generally only capable of performing a fixed task set in advance, and are not capable of performing different user tasks according to user demands. Disclosure of Invention In a first aspect of the present disclosure, a method of acquiring an item is provided. In the method, in response to receiving a user task, the robotic device moves to a target location specified by the user task, the user task instructs the robotic device to acquire a target item from the target location. The robotic device transitions to a pose for acquiring the target item. The robot device detects the target article based on the attribute information of the target article and the environmental information of the position. In response to detecting the target item, the robotic device places the target item into the target storage space. In a second aspect of the present disclosure, an apparatus for acquiring an item is provided. The device comprises a moving module, a converting module, a detecting module and a placing module, wherein the moving module is used for responding to the received user task, the robot device moves to a target position designated by the user task, the user task instructs the robot device to acquire a target object from the target position, the converting module is used for converting the robot device to a pose for acquiring the target object, the detecting module is used for detecting the target object based on attribute information of the target object and environment information of the position, and the placing module is used for responding to the detection of the target object, and the robot device places the target object into a target storage space. In a third aspect of the present disclosure, an electronic device is provided. The electronic device comprises at least one processing unit, and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, which when executed by the at least one processing unit, cause the electronic device to perform a method according to the first aspect of the disclosure. In a fourth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to implement a method according to the first aspect of the present disclosure. In a fifth aspect of the present disclosure, there is provided a computer program product comprising a computer program, wherein the computer program when executed by a processor implements the method according to the first aspect of the present disclosure. It should be understood that what is described in this section of this disclosure is not intended to limit key features or essential features of the implementations of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following description. Drawings The above and other features, advantages, and aspects of various implementations of the present disclosure will become more apparent hereinafter with reference to the following detailed description in conjunction with the accompanying drawings. In the drawings, wherein like or similar reference numerals designate like or similar elements, and wherein: FIG. 1 illustrates a block diagram of an application environment in accordance with one exemplary implementation of the present disclosure; FIG. 2 illustrates a block diagram of acquiring an item by a robotic device, according to some implementations of the present disclosure; FIG. 3 illustrates a block diagram of an image acquisition process, according to some implementations of the present disclosure; FIG. 4 illustrates a block diagram of a process of invoking a language model, according to some implementations of the present disclosure; FIG. 5 illustrates a block diagram of a process of a user selecting a target item, according to some implementations of the present disclosure; FIG. 6 illustrates a block diagram of a process of invoking an action model, in accordance with some implementations of the disclosure; Fig. 7A and 7B illustrate block diagrams of a process