Video to Game
A skill that teaches coding agents to turn a gameplay video into a real game you can play in the browser. A video model designs the game (its look, camera and one memorable mechanic); the agent studies the clip frame by frame, generates every image, 3D model and sound with fal to match it, writes the game in Three.js, then plays it with the keyboard and films its best seconds as proof. It works with Claude Code, Codex, Cursor, Gemini and others.
Play the 31 games: fal-video-to-game.vercel.app
31 original games, every one rebuilt from a 10 to 15 s video generated with MiniMax H3 Max on fal: 1,013 fal calls
(594 images, 194 3D models, 290 sounds and music tracks), 202 USD in total, about 6 USD per game. Every game is a
single index.html with Three.js and nothing else: no engine, no template, no other library.
Why
Agents cannot design a game's look. Asked for "a game where a boy glides between flying whales", they ship grey boxes, a default sky and a camera that fights the player. A video model is good at exactly that part, so let it go first, and make the agent match it:
- The video is the design document.
study_video.pyturns it into frames, a contact sheet, a palette and cut times; the agent writes a spec (camera, hero, the one mechanic, the key moment, the look) from named frames. - Every asset comes from fal, from the video's own frames. Concept sheets with Nano Banana Pro, clean cutouts,
image to 3D (Meshy, Tripo, Hunyuan 3D), rigging and animations, sound effects and music, all logged with
fal_asset.py. Nothing drawn by hand, nothing downloaded. - The look is a spec, not polish. Tone mapping, one grade, fog, bloom, vignette and grain from the first scene, and a side-by-side picture of the video and the game at the same three spots after every change.
- Calm the world so the game reads. One harmonized palette, dense but grouped, the hero and everything you can interact with standing out on a quiet background. No text on screen.
- The agent plays its own game. A keyboard scenario reads
window.__gamelike a player reads the screen,record_play.mjsfilms it at the real frame rate,best_window.pyfinds the liveliest seconds. Falls, walls and dead seconds get fixed before anyone else plays.
The gallery
Each GIF is the generated video (left) and the game (right). Click for the prompt, the fal models and the cost.
 |  |
| Skyfarer · 8.93 USD · play · code Courier boy running and gliding between giant flying whales above the clouds. | Tidebound · 11.01 USD · play · code Two-player co-op sailing game: two sailors crew a living ship grown from pink coral. One player steers the… |
 |  |
| Storm Surfer · 4.38 USD · play · code Photorealistic 3D game, cutting-edge real-time rendering quality, real-world materials: a surfer on a glowing… | Skyhook Rescue · 10.43 USD · play · code Two-player co-op rescue game during a thunderstorm: two small airships linked by a long cable fly together… |
 |  |
| Paper Dragon · 0.79 USD · play · code A girl rides a long red paper dragon kite through an autumn canyon, the dragon's paper body rippling as it… | Bubble Balloon · 2.18 USD · play · code A child floats inside a giant soap bubble over a sunny seaside village, steering it by leaning, bouncing… |
 |  |
| Kite Rider · 4.09 USD · play · code Watercolor-shaded 3D game: a girl stands on a giant kite, surfing the wind high above rice terraces, leaning… | Aurora Skiff · 2.79 USD · play · code A nomad steers a small sand skiff with a cloth sail across glowing blue dunes at night, catching the wind… |
 |  |
| Glass Greenhouse · 2.34 USD · play · code A tiny robot gardener tends a greenhouse inside a floating glass sphere above the clouds; it opens glass… | Bell Tower · 7.27 USD · play · code A bell-ringer swings on long ropes inside a giant pastel bell tower; each bell she rings sends a wave of… |
 |  |
| Fog Shepherd · 5.04 USD · play · code A cloaked figure with a lantern guides a herd of glowing white deer through a monochrome foggy forest; only… | Paper Moon Stairs · 6.13 USD · play · code A girl in a long white dress climbs a staircase of drifting paper lanterns into a pastel night sky; each… |
 |  |
| Whale Song · 5.45 USD · play · code A diver in a red scarf swims beside a giant translucent ghost whale through a deep blue gradient ocean; the… | Sky Library · 5.75 USD · play · code A girl swims through warm air between towering floating bookshelves; loose pages flutter like birds and she… |
 |  |
| Kintsugi Mountain · 8.60 USD · play · code A small monk walks up a black-and-white ink-wash mountain; every footstep blooms gold leaf, and golden… | Space Mower · 8.25 USD · play · code Bright stylized 3D game on a tiny round green asteroid: an astronaut drives a little lawn mower around the… |
 |  |
| Ember Path · 10.03 USD · play · code A girl carrying a small glowing ember walks through a charcoal-drawn burnt forest; the ember redraws the… | Clockwork Heist · 9.03 USD · play · code Four-player co-op heist game inside a colossal clock tower: four small thieves in red, blue, yellow and green… |
 |  |
| Starlight Train · 2.48 USD · play · code A little spirit in a white cloak rides on the roof of a night train crossing snowy mountains, jumping from… | Dune Surfer · 8.10 USD · play · code Low-poly desert 3D game at sunset, flat-shaded orange and purple dunes rolling like ocean waves: a hooded… |
 |  |
| Autumn Wind · 10.20 USD · play · code A child in a cloak of orange leaves surfs the wind over golden hills with a swirling swarm of leaves, painted… | Stained Glass · 8.67 USD · play · code A tiny cloaked figure crosses a vast empty cathedral; sunlight through stained glass windows casts colored… |
 |  |
| Deep Lights · 4.66 USD · play · code Bioluminescent deep-sea 3D game, dark navy water, simple glowing shapes: a small yellow submarine touches… | Snow Globe · 6.15 USD · play · code A tiny figure lives inside a snow globe; the whole world slowly turns upside down, the snow falls upward and… |
 |  |
| Sunflower Silhouette · 4.68 USD · play · code A small silhouette child runs through a field of giant sunflowers at golden hour, jumping across huge petals… | Rust Bloom · 8.45 USD · play · code A small grey robot wanders a colorless ruined city with a watering can; wherever it pours, rust turns into… |
 |  |
| Ink Fox · 3.14 USD · play · code Monochrome ink-wash 3D game, black ink on white rice paper with a single red accent: a small white fox spirit… | Mirror Sea · 10.02 USD · play · code A boy walks barefoot across an endless mirror-calm sea at dawn; each step sends ripples that reveal faint… |
 |  |
| Cloud Shepherd · 4.27 USD · play · code Soft pastel 3D game: a shepherd with a long crook herds fluffy little clouds like sheep across a blue sky… | Train Painter · 15.48 USD · play · code Bright cartoon 3D game: a tiny steam train lays its own rail tracks in front of it as it moves, the player… |
 | |
| Hourglass · 3.22 USD · play · code A tiny wanderer walks inside a giant glass hourglass; golden sand pours from above and piles into dunes that… |
Install
Claude Code (plugin marketplace):
claude plugin marketplace add lovisdotio/video-to-gameclaude plugin install video-to-game@video-to-gameOr copy the skill: cp -R skills/video-to-game ~/.claude/skills/.
Codex, Cursor, Gemini CLI, Copilot and other agents (via skills):
npx skills add lovisdotio/video-to-gameOr copy skills/video-to-game into your agent's skills folder (~/.agents/skills/ for Codex, ~/.cursor/skills/
for Cursor).
The scripts need Python 3.9+, ffmpeg, Node 18+ with playwright-core for the recorder, and
pip install fal-client with a FAL_KEY (fal.ai/dashboard/keys) for the assets.
Use
Turn
gameplay.mp4into a playable browser game with the video-to-game skill. The prompt that made it is ingameplay.txt. Generate every asset with fal, match the video's look, and show me side-by-side pairs and a recorded take of you playing it.
No video yet? Start from prompts/gameplay-video-prompts.md: the rules that made these 31 videos rebuildable,
and every prompt used.
Layout
skills/video-to-game/
SKILL.md workflow, hard rules, reference routing
references/ study the video, fal assets, game loop, look and post-processing, playtest
scripts/ study_video.py, fal_asset.py, side_by_side.py, best_window.py, record_play.mjs
templates/ game.html (Three.js skeleton with post stack and state contract), play.mjs
gallery/<game>/ poster.gif, README.md (prompt, controls, fal calls, cost), game/ (the code)
prompts/ gameplay video prompts
examples/plays/ real playtest scenarios from the galleryCredits
Videos generated with MiniMax H3 Max and Seedance 2.5 on fal. Games, assets pipeline and playtests by Claude Opus 5.5 with fal. Made by Lovis Odin.
MIT license.