Back to Discover

Sparse-WAM helps robot AI that predicts what its moves will do run about twice as fast, its authors say

Diagram from the Sparse-WAM paper comparing a robot AI that works from the current camera view with one that also generates predicted future video frames, which make up most of its work
Image: the researchers (arXiv)

Sparse-WAM is a shortcut for robot AI that predicts what its moves will do: it works out which parts of the predicted scene matter for the robot's next move and skips the rest, with no extra training. Its authors say it nearly doubled the speed of two such robot models while the robots still did their tasks about as well. No one outside the team has tested it yet.

Some robot AI plans by predicting the future: it predicts how a scene will change and which moves the robot can make to shape it, by generating the next video frames along with the robot's actions. That is slow and costly to run, because the model works on every part of every predicted frame, even though much of the picture never changes which move the robot should make. Sparse-WAM, a method that skips much of that work without any retraining, is described in a paper submitted on Sept. 30, 2026.

These models are built on AI that was first trained to generate video. Earlier ways of trimming their work kept whatever parts of the frames mattered for a sharp picture. Sparse-WAM instead keeps the parts of the predicted frames that the model's action predictions actually draw on, plus some context from across the frames.

The models refine their predictions over many rounds, and the authors found that the parts of the future the actions draw on overlap a lot from one round to the next, even as the predictions themselves keep changing. So Sparse-WAM picks those parts and reuses its picks across rounds. Because the picking itself can eat up the savings, the authors also built Pilot, a tool that keeps that checking light.

On two robot models, the authors say it nearly doubled their speed while the robots still did their tasks about as well. The speedups come from the authors' own tests, in a paper submitted Sept. 30 that has not yet been peer reviewed. So far only the authors have tested it, and it is not yet known whether the savings hold on other robots and tasks.

Sources

More on Robotics