Windflow

Neural World Models

Meta (FAIR) · Released December 2024

Navigation World Models predict what a robot's camera will see after a navigation action, and can plan a route by imagining trajectories before taking them. Code and weights are for non-commercial use.

Get the weightsCan I use it commercially?
Weights
Open weightsCC BY-NC 4.0 (per README)
Commercial use
Non-commercial
Real-time
No real-time claim
Where to try
Run it yourself

01 Controls

What you control

  • Past camera frames
  • Navigation actions

02 License

Can you use it commercially?

Non-commercial

No. Hugging Face metadata says CC BY 4.0, but the project README licenses code and weights under CC BY-NC 4.0. The stricter, non-commercial reading is shown.

Declared license: CC BY-NC 4.0 (per README) · Model card

A reading of the published license text, not legal advice.

03 Speed

Does it run in real time?

No real-time claim. The cited sources make no real-time claim.

Figures are the authors' own, with their settings and hardware. They are not comparable across models.

04 Setup

How to run it

  1. 01Clone facebookresearch/nwm and install the packages listed in the README.
  2. 02Download the pretrained model.
  3. 03Use isolated_nwm_infer.py to predict the next view after an action or to follow a recorded trajectory, and isolated_nwm_eval.py to score the results.

Summarised from the project's own instructions. Follow the source for exact commands and versions.

05 Access

Where to try it

No hosted version was verified. Run the published weights yourself.

Listed alphabetically. Windflow maintains this directory and is one of the hosts; a listing does not promise capacity at any given moment.

06 Questions

Neural World Models FAQ

Is Neural World Models open source?

Neural World Models publishes downloadable weights under CC BY-NC 4.0 (per README). Read the license terms before you build on it.

Can I use Neural World Models commercially?

No. Hugging Face metadata says CC BY 4.0, but the project README licenses code and weights under CC BY-NC 4.0. The stricter, non-commercial reading is shown.

Does Neural World Models run in real time?

The cited sources do not claim real-time operation.

Where can I try Neural World Models?

No hosted version was verified; run the published weights yourself.

What does Neural World Models take as input?

You give it past camera frames and navigation actions.

How do I run Neural World Models?

Following the official instructions: Clone facebookresearch/nwm and install the packages listed in the README. Download the pretrained model. Use isolated_nwm_infer.py to predict the next view after an action or to follow a recorded trajectory, and isolated_nwm_eval.py to score the results.

What are alternatives to Neural World Models?

Similar models in this directory include ABot-World (open weights, permissive license), AlayaWorld (open weights, custom terms) and DreamX-World (open weights, permissive license).

Similar world models

All 56 in the directory