Search

EP-4219090-B1 - TELEPRESENCE IN PERSON TO A ROBOT

EP4219090B1EP 4219090 B1EP4219090 B1EP 4219090B1EP-4219090-B1

Inventors

  • SAKARYA, TASKIN

Dates

Publication Date
20260513
Application Date
20230110

Claims (10)

  1. Tasks-Ins-Cubicle robot (TIC-Robot), for a system to be fully present in a remote site or location, which is a robotic structure which is configured to communicate with a person at a local site such that this person can see the complete environment around the TIC-Robot and can control all the capabilities of the TIC-Robot as if her/his own, where people around TIC-Robot can communicate and interact with TIC-Robot as if they are communicating and interacting with the person when she/he was personally at the remote location, characterized in that the TIC-Robot has inflatable cell layers on the surface, the TIC-Robot being configured to inflate the inflatable cell layers in accordance with the 3D Model of the person at the local site, such that people around the TIC-Robot can physically recognize the person immediately.
  2. TIC-Robot according to Claim-1 comprising display capabilities on the surfaces of the TIC-Robot either as digital display screens or as projection surfaces where projector units from outside or from inside the TIC-Robot or in combination of display screens and projections can be used such that people at the remote site can recognize the person from the local site.
  3. TIC-Robot according to Claim-1 comprising movement capabilities such that the person at the local site can move the TIC-Robot either using a simple wheel system or legs of the robotic system and can observe the movement actions at the local site.
  4. TIC-Robot according to Claim-1 comprising grab functionalities, such that it can take things from one place and put them to another, where the person at the local site controls such movements directly and can see the results immediately, as comparable to augmented reality.
  5. TIC-Robot according to Claim-1 comprising colouring options either integrated to the inflation cells or in combination with Claim-2, i.e. with display screens or with projections or a combination of both.
  6. TIC-Robot according to Claim-1 which is configured to also communicate directly with a 3D-Model designed in internet media, such that it can act on this virtual emulation and can communicate and interact with the people at the remote site.
  7. TIC-Robot according to Claim-1 which is configured to adjust its size according to the size of the person at the local site.
  8. TIC-Robot according to Claim-1 which is also configured to be of any size and shape to allow communication with other things and animals at the local site.
  9. System to be fully present in a remote site, comprising a TIC-Robot according to any one of the preceding claims and comprising a local site which is arranged such that a person at the local site can see the complete environment around the TIC-Robot and can control all the capabilities of the TIC-Robot as if her/his own, where people around TIC-Robot can communicate and interact with TIC-Robot as if they are communicating and interacting with the person when she/he was personally at the remote location.
  10. Method for communication, wherein a person or a thing or an animal, called here an object at a local site with a 3D-Modelling environment such as Task-Ins-Cubicle-Local, can interact with a TIC-Robot according to one of claims 1 to 8 at a remote site as if they are one of the same and the local site can control the TIC-Robot with or without morphing to its own shape.

Description

Summary This invention is about a robot at a remote location which is connected to a real person or a thing within a 3D-Modelling-System at a local place where the robot changes its shape to match exactly to the person(s) or things(s) at the local place. The invention is defined by the features of independent claims 1 and 10. Preferred embodiments are defined by the dependent claims. In a telepresence environment, persons or things in one place can be virtually presented at a remote place as holographic 3D presentation either in a task-ins-cubicle achieving full communication and interaction at the remote place as described in the following own patents. DE-Patent: DE 10 2012 007 441 B4PCT: EP2013/002769US-Patent: US 10,728,496 B2UK-Patent: GB2536370Indian Patent Application No. 201617012621 The quality of the holographic view depends on the quality of the screens and the transmission. Blind people has no benefit from the holographic presentation. Both of these drawbacks can be solved and the telepresence can be brought to a more real situation, in case the person appears on the remote site as touchable real person. This can be achieved, in that the 3D modelling made at the local site, for example using task-ins-cubicle local version, the remote site can utilize a morphing of a preliminary setup, for example a humanoid robot, via inflatable modelling system to present this 3D model as close to the real one as possible. Another perfect setup would be to get the 3D Modelling of the person(s) from one or more 3D Modelling Systems for example task-ins-cubicles and then bring them together in a virtual or semi-virtual environment, with their real, current appearance of the persons and things modelled. Robot at the remote site has at least for the front view a multimedia-system, integrating video-audio and control information and sending these back to the local 3D-Modelling-System, for example task-ins.-cubicle-local at the local site, so the person there feels to be at the remote site and can move around walking for example on a mechatronic walking-band, and also can move the hands of the robot synchronised with own, can also see the actions locally of course. This applies both to real and to virtual environments. Need It is a very big advantage to make a near real presentation of the person that appears at the remote site, because it is not any more dependent on the quality of the transmission or on the quality of screens as in task-ins-cubicle. As the occupied space is also smaller, its usage is more practical. On the other hand, because it is considered a big advantage to introduce not only a static model, i.e., there is need to have walking and talking abilities. So a robotics system could be employed. But not a robotics system that is remotely controlled and have own intelligence, but instead a robotics system that is coupled to a 3D-Modelling-System, for example task-ins-cubicle local and can be used as a telepresence hardware. i.e., decision making actions can be directly made via the person(s) within connected 3d-modelling-system for example task-ins-cubicle local. On the other hand, the remote robot should resemble exactly to the person in task-ins-cubicle local. So, it is a robot that morphs itself to the person situated at a remote place. By telepresence, a robotic presentation of the person at another site with many robotics abilities such as walking, moving functional arms, legs and hands and such as talking, with moving lips according to the spoken language, i.e., audible output would be a very big advantage for handling different tasks from a distance and for socialising. By telepresence, there is need that a local real person is connected to self as a hard duplicate but as own person with all actions and but also as important combines the advantages of task-ins-cubicle system, i.e., is able to feel himself/herself at the remote location. A hard appearance of the person makes it easier with blind people to interact too as they can not only hear the person at the remote site, but they can also feel the presence of the person. COMPARISON OF OUR INVENTION WITH THE DOCUMENTS IN THE SEARCH REPORT IN TERMS OF THE INVENTION STEP CRITERIA: D1: TACHI SUSUMU, Telexistence, 20150401, XP047648853 244 S. Tachi D1 Fig. 3 displays the expected telepresence or telexistence concept, however D1 in text does not seem to solve how the person in robotic form should look as a perfect duplicate of the person inside. D1 does not disclose how the person at the controls would have a perfect feeling of being at the remote site. In TIC-Robot application, the person in Task-Ins-Cubicle is able to see all the surroundings of the TIC-Robot with the highest resolution screens and the persons movements are immediately transferred to the TIC-Robot as there are cameras all around the cubicle to detect every action of the person inside without any additional gadget or device. D1 Fig. 9 displays on the right side how the person at the