Robots can now learn to use tools—just by watching us
Despite decades of progress, most robots are still programmed for specific, repetitive tasks. They struggle with the unexpected and can’t adapt to new situations without painstaking reprogramming. But what if they could learn to use tools as naturally as a child does by watching videos?
Researchers have developed a new robotic framework powered by artificial intelligence -- called RHyME (Retrieval for Hybrid Imitation under Mismatched Execution) -- that allows robots to learn tasks by watching a single how-to video.
Cornell University researchers have developed a new robotic framework powered by artificial intelligence—called RHyME (Retrieval for Hybrid Imitation under Mismatched Execution)—that allows robots to learn tasks by watching a single how-to video.
Exploring a new way to teach robots, Princeton researchers have found that human-language descriptions of tools can accelerate the learning of a simulated robotic arm lifting and using a variety of tools.