Back to Discover

Runway's Praxis-1 aims to give robots a head start by learning from video

Hardware partners are testing the model before a planned release of its weights

A two-armed robot picks up a tennis ball beside a cardboard box on a table, in Runway's video

Praxis-1 is Runway's new model for controlling real robots, built on what its video AI learned about how objects and hands move. Runway says that gives robots a head start, since real-world robot data is scarce and costly to collect.

Runway, which builds AI models that generate video, wants to put that know-how to work in robots. Its new model, Praxis-1, takes what the company's video AI learned about the physical world and turns it into control for real machines. Robots are hard to teach: Runway says the real-world data they need is scarce and expensive to collect, while video is plentiful.

The idea is to let a robot learn by watching first. Runway says training on huge amounts of video teaches its models how objects behave, how hands move and what a task looks like halfway through. It likens this to the way language AI learned from text that was already out in the world. In one Runway test, a robot model first trained on ordinary web video placed objects about as accurately as one first trained on footage of people steering robots by remote control.

Runway's bet is that robot makers can lean on video for much of the early learning, rather than only on costly recordings of people guiding machines by remote control. It says partners Noble Machines, Standard Bots and Ultra are already testing Praxis-1 on their own hardware, including a robot that works with both arms, a single robot arm and a mobile robot. Runway's clips show a robot putting a tennis ball in a box and a mobile robot going to a shelf, taking a book and putting it away. The company says the same model moved from a studio to a home setting without retraining.

For now, Runway is giving early access only to select partners. It says the testing is meant to check that Praxis-1 works well and safely across different robots and settings, and to close any gaps before a wider launch. When it goes public in the coming months, Runway plans to share the model openly rather than keep it closed, which it argues gives robot makers flexibility and control they lack today.

How Praxis-1 performs beyond Runway's own tests and its partners' early trials remains to be seen. Runway's announcement gives no firm release date or license terms.

Sources

About this video

  • Mixed footage: On-screen text at 0:11: "Runway Gen-4.5" Source
  • Limited access: “We are providing pre-launch access to select partners. If you are interested in testing Praxis-1 on your own hardware ahead of public release, contact our robotics team.” Source
  • The official sources don't say whether a person controls the robot or whether the video is sped up.

More on Robotics