Neural game rendering
Matrix-Game 4.0 API
The live game, re-rendered by the scene model, on main_video. Served on Windflow as a realtime session you can plug into your product and pay for by the second.
Overview
What Matrix-Game 4.0 does
Matrix-Game 4.0 is Skywork AI's neural game renderer. A real game runs movement, physics and combat, and a scene-specific 5B model redraws its frames. On Windflow you select one of three bundled games — a medieval castle shooter, an Ancient Egypt shooter, or city racing — and send held-key controls while generated video streams back. It does not take a text prompt or seed image in this profile.
A session keeps the model running: connect once, steer it with movement and look controls while it runs, and receive the live stream back on a named output track.
Every model in the catalog speaks the same typed session protocol, so switching between models changes the controls you send, not how you integrate.
- Architecture
- Scene-specific 5B causal video renderers (Wan2.2-Fun-5B-Control base, one denoising step) driven by an executable game
- Resolution
- 864 × 480
- Playout
- 24 fps
- Chunk
- One opening frame, then four-frame chunks with one block of game lookahead
- Control latency
- About 0.5 s from key press to screen in a same-region browser
- Inputs
- A scene choice and held keyboard controls; no prompt or seed image
- Outputs
- The live game, re-rendered by the scene model, on main_video
- Delivery
- WebSocket (H.264)
- Session protocol
- sdk.realtime.v2
- Price
- $0.0024 per billable second
$0.0024
Per billable second
Meter starts when generation begins
$8.64
Per billable hour
The same rate, held for an hour
Preview
Runtime status
Capacity is brought up on demand
Private beta
Access
Request access or a live demo
Use cases
What teams build with Matrix-Game 4.0
- Playable demos of neural rendering on top of a real game engine.
- Evaluating how a low-poly game reads once a video model redraws it.
- Research on game-engine-conditioned, frame-by-frame video generation.
- Comparing neural game rendering with source-video editors such as EdenLive.
Provenance
Where Matrix-Game 4.0 comes from
The model and its code are published by the upstream authors. Windflow runs it behind one session API and bills per billable second.
- SkyworkAI/Matrix-Game on GitHubLicence · Apache-2.0
- Skywork/Matrix-Game-4.0 on Hugging FaceLicence · Apache-2.0
FAQ
Questions about Matrix-Game 4.0
- Can I bring my own game or image?
- No. Each of the three scenes is its own checkpoint trained on its bundled game, so it only renders that game. Use EdenLive to restyle footage from your own game.
- Why do sessions stop after 60 seconds?
- The model does not hold scene detail over long play: a spot you return to after a minute or two can show different buildings. Sessions are capped at 60 seconds to keep each run short of that.
- What controls does it support?
- Shooters: WASD to move, arrow keys to look, mouse or J/K to fire and aim, Space to jump, R to reload, F to raise the shield. Racing: WASD to drive, Shift to brake, Space for the handbrake.
- Is this the same integration as Matrix-Game 2.0?
- No. The current Windflow Matrix-Game 4.0 profile runs bundled games with scene-specific checkpoints. Use its version-specific API guide and capabilities rather than carrying forward image-conditioning assumptions or controls from an older version.
- Does the game state guarantee visual consistency?
- The game engine owns rules and movement, but the generated rendering can still change details. Evaluate held-key release, revisiting a location and the session limit. A control acknowledgement or output FPS does not measure key-press-to-visible response.
- How much does Matrix-Game 4.0 cost on Windflow?
- Matrix-Game 4.0 costs $0.0024 per billable session-second ($8.64/hr of billable time). Billing starts at the session's first generation_started event and stops when the session is released or ends. Queueing, worker startup, time before generation starts and the documented reconnect grace are not billed. After generation starts, paused or unwatched time remains billable; release the owner session to stop the meter. There is no subscription.
- How do I get access to Matrix-Game 4.0?
- Windflow is in private beta. Request access from the sign-up page, or ask for a live demo of Matrix-Game 4.0. Approved accounts start with $5 and four concurrent sessions.
- Is Matrix-Game 4.0 always running?
- No. Model capacity is brought up on demand rather than kept standing. Live readiness for each model is published at api.windflow.online/v1/status, and a live demo can be arranged on request.
Guides and comparisons
- GuideChoosing a realtime video model: a decision guide for 12 hosted models
- Model API guideHow to use the Matrix-Game 4.0 API
- Use caseRealtime game rendering: restyle a game live with AI
- Use caseNavigable world models for games: an API with WASD control
- GuideWhat is a world model? How it differs from video generation
- GuideHow realtime video models work: autoregressive diffusion, chunks and the latency budget
Other models