Categories: FAANG

RT-2: New model translates vision and language into action

Introducing Robotic Transformer 2 (RT-2), a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalised instructions for robotic control, while retaining web-scale capabilities. This work builds upon Robotic Transformer 1 (RT-1), a model trained on multi-task demonstrations which can learn combinations of tasks and objects seen in the robotic data. RT-2 shows improved generalisation capabilities and semantic and visual understanding, beyond the robotic data it was exposed to. This includes interpreting new commands and responding to user commands by performing rudimentary reasoning, such as reasoning about object categories or high-level descriptions.
AI Generated Robotic Content

Recent Posts

Chroma needs to ne more supported and publicised

Sorry for my English in advance, but I feel like a disinterest for Chroma in…

21 hours ago

Model Context Protocol: A promising AI integration layer, but not a standard (yet)

Enterprises should experiment with MCP where it adds value, isolate dependencies and prepare for a…

22 hours ago

Are there any open source alternatives to this?

I know there are models available that can fill in or edit parts, but I'm…

2 days ago

The future of engineering belongs to those who build with AI, not without it

As we look ahead, the relationship between engineers and AI systems will likely evolve from…

2 days ago

The 8 Best Handheld Vacuums, Tested and Reviewed (2025)

Lightweight, powerful, and generally inexpensive, the handheld vacuum is the perfect household helper.

2 days ago

I really miss the SD 1.5 days

submitted by /u/Dwanvea [link] [comments]

3 days ago