How to take advantage of the robot in the future

How to take advantage of the robot in the future

Admitted it is human autonomy is the result of the seamless integration of our perception our cognition and our action. 

These autonomy is this integrated ability that enables humans to perform by themselves without the need to be tele operated. 

Autonomous Robots.

 Aim at these same capability. Acting without being Kelly operated.

 So they have sensors like distant sensors cameras. They use their computers to plan for their actions and they move. 

SOKOL bought these mobile robot at Carnegie Mellon performs tasks for users in our building picking up and delivering objects from location to location. 

Sensors provide a very large amount of complex numerical data from temperature levels to distance to obstacles walls people furniture from which robots need to interpret features about the scene so they can plan for their tasks. 

For example a robot needs to know their position and for that Koba uses their 3D scene images to try to extract plainer surfaces that are matched to walls and then to maps and the more accurate is these mapping the more confident the robot knows where it is. 

This is a robot that actually moves in our environment performing tasks going from location to location in very different environments in terms of their appearance from corridors to halls and even glass bridges with success. 

However in spite of the significant advances in having robots move. 

Robots have many cognitive perception limitations that the perception cognition and action level and they definitely cannot understand all natural language and perform all actions such going upstairs or opening doors.

 So at Carnegie Mellon

 We actually introduced the new concept of autonomy for robots. 

This symbiotic autonomy which enables robots to ask for help to overcome their limitations so please press the elevator button this says anomalous robot please put the envelope in my basket and humans can help with these very simple requests.

Cobalt can also go to the Web if it's their request involved something for which it misses knowledge.

 For example bring me coffee if cobalt does not know where coffee is is in the building. 

It queries the web and then goes to the most probable place returned by the Web where Ko where the object can be. 

In this case kitchen for coffee it also interacts with humans through dialogue and can ask for clarifications. 

And when it doesn't understand whether humans says it may pop up some kind of other representation such as a map where the humans can specify what they mean by conference room or what they mean by print of room and all these interactions with the humans and the Web are saved for future use by the robot. 

 Finally if the robot does not get its help it waited then nobody pressed the button. It also automatically can feel email. 

Messages templates. With the situation emails to the developers and asks for some remote help to come to the place where the robot didn't get the help we have been talking about the single robot.

But after all our research involves multiple robots multiple co bots that coordinate to actually. Optimize their task and share knowledge. Such robots have moved at Carnegie Mellon close to 1000 

kilometers in the last two years.

 Our Multi-robot coordination is motivated and builds upon a lot of the work we do in robot soccer in which robots beautifully plan for joint motion and teamwork that leads into this beautiful four way 

pass that ends with this successful goal.

 Our multiple robots at Carnegie Mellon in addition to actually doing their pickup and delivery tasks 

have introduced and have performed a very novel and new task of data collection.

 They are moving the buildings with their sensors and knowing their location and they can collect temperature humidity Wi-Fi signal strength data and provide these maps for a great policy making based on the data. So symbiotic autonomous robots. It's a reality.

 Multiple robots multiple humans the web the physical space.

 So we can see these robots as cyber physical social systems.

 Kind of a new species that coexists with humans.

 So the ultimate final question that we face is how to move these robots from our labs and our buildings to the real world is how do we we actually envision interacting with and getting help from 

these fascinating new artificial kind of intelligent creatures.