Matrix-3D
Skywork AI · Released August 2025
Matrix-3D turns a single image or a text prompt into an explorable 3D scene: it generates a panoramic video along a camera path, then reconstructs the scene in 3D. Two reconstruction modes trade speed for detail, and the weights are MIT.
- Weights
- Open weightsMIT
- Commercial use
- Permissive license
- Real-time
- No real-time claim
- Where to try
- Run it yourself
01 Controls
What you control
- A single image or a text prompt
- A camera trajectory for the panoramic video
- Fast or detailed 3D reconstruction
02 License
Can you use it commercially?
The weights' model card declares MIT, a permissive license that allows commercial use. Downloads require accepting the card's terms on Hugging Face.
Declared license: MIT · Model card
A reading of the published license text, not legal advice.
03 Speed
Does it run in real time?
No real-time claim. The cited sources make no real-time claim.
Figures are the authors' own, with their settings and hardware. They are not comparable across models.
04 Setup
How to run it
- 01Clone SkyworkAI/Matrix-3D with its submodules, create a Python 3.10 environment, install PyTorch and run the installation script.
- 02Download the checkpoints with python code/download_checkpoints.py.
- 03Generate a panorama, turn it into a panoramic video, then into a 3D scene, with the scripts in code/. A Gradio demo is also included.
Summarised from the project's own instructions. Follow the source for exact commands and versions.
05 Access
Where to try it
No hosted version was verified. Run the published weights yourself.
Listed alphabetically. Windflow maintains this directory and is one of the hosts; a listing does not promise capacity at any given moment.
06 Questions
Matrix-3D FAQ
Is Matrix-3D open source?
Matrix-3D publishes downloadable weights under MIT. The declared license is permissive.
Can I use Matrix-3D commercially?
The weights' model card declares MIT, a permissive license that allows commercial use. Downloads require accepting the card's terms on Hugging Face.
Does Matrix-3D run in real time?
The cited sources do not claim real-time operation.
Where can I try Matrix-3D?
No hosted version was verified; run the published weights yourself.
What does Matrix-3D take as input?
You give it a single image or a text prompt, a camera trajectory for the panoramic video and fast or detailed 3D reconstruction.
How do I run Matrix-3D?
Following the official instructions: Clone SkyworkAI/Matrix-3D with its submodules, create a Python 3.10 environment, install PyTorch and run the installation script. Download the checkpoints with python code/download_checkpoints.py. Generate a panorama, turn it into a panoramic video, then into a 3D scene, with the scripts in code/. A Gradio demo is also included.
What are alternatives to Matrix-3D?
Similar models in this directory include HunyuanWorld 1.0 (open weights, custom terms), HY-World 2.0 (open weights, custom terms) and Marble (no public weights, service terms).
Similar world models
All 56 in the directory3D world builder
HunyuanWorld 1.0
Tencent Hunyuan
Text or an image, turned into a 360° 3D scene
Custom termsOpen weightsTry on the official site
3D world builder
HY-World 2.0
Tencent Hunyuan
Text, images or video, turned into a navigable 3D world
Custom termsOpen weightsTry on the official site
3D world builder
Marble
World Labs
Create, edit and explore persistent 3D worlds
Service termsNo public weightsTry on the official site
Robotics
1X World Model
1X Technologies
Robot action and video modeling
Permissive licenseOpen weights