News

This virtual training suite trains a robotic arm to move objects in complex scenarios

The Allen Institute for AI just announced a new framework called ManipulaTHOR that helps in creating various real-life scenarios to train a robot arm in manipulating objects. 

This new testing suite — part of the AI2-THOR update — has more than 100 physics-enabled physics-enabled rooms that have complex environments and obstructions that might get in the way of a robot arm while interacting with objects. ManipulaTHOR will enable faster training in more complex environments without needing to build real robots.

The new framework update allows these simulated robots to move in these rooms like humans and perform tasks such as navigating a kitchen, opening a fridge, or popping open a can of soda. Plus, through these features, robots are able to move objects in a room swiftly and accurately — despite many hindrances.

A lot of robots are trained to move in a very specific manner, and they find it difficult to overcome obstacles, making them unsuitable for a lot of real-life scenarios. This framework provides a way to solve such problems first in a virtual world, so some of those concepts could be applied to physical robots later.

The team has modeled this virtual arm based on the design of the Kinova Gen3 Modular Robotic Arm specification — a real-life robot. The platform allows the arm to move in six degrees of freedom. Plus, there are virtual sensors such as egocentric RGB-D images and touch sensors to better gauge the room and objects.