Hailuo says MiniMax H3 became a world model with 0.199% trained parameters

• H3-World turns a MiniMax H3 video generation run into a controllable scene, with language standing in for character and camera input. Hailuo_AI's announcement says the team reused H3's existing language understanding rather than adding a separate action module.
• The adaptation trained only 0.199% of the 33B-parameter backbone on roughly 8,000 gameplay samples, according to Hailuo_AI's announcement and the published repository.
• H3 Max is already being used for interactive-format demos, including an open-world RPG in Hailuo_AI's RPG demo and a voice-steered education app in gokayfem's education demo, separate from the H3-World research release.
• A parallel 360-degree experiment made an H3 clip viewer-steerable, but a Reddit 360 walkthrough reports visible seams and limited resolution on an RTX 3080 Ti laptop run.

The H3-World project page includes a neon-alley fast pan, cave strafing, and an upward cathedral tilt. A separate H3 360 workflow write-up explains how a nine-second equirectangular clip becomes an 18-second forward-and-reverse loop that viewers can look around.

The research team used 7,872 clips for training and 128 held-out clips from ABot-World-Explorer-500h, according to the H3-World repository. It trained 65.6 million LoRA parameters, or 0.199% of the 33B H3 backbone, for 10,000 optimization steps.

The repository identifies the authors as researchers at Tencent, the National University of Singapore, and Hong Kong Polytechnic University. Their paper frames the result as lightweight adaptation of a pretrained video model's existing semantic representations.

H3-World converts a keyboard state into a language instruction for each future video latent, then uses directed attention routing to bind that instruction to its intended interval. The code release describes that routing as the mechanism that limits action control leaking into other moments of the clip.

The public command-line build exposes these presets:

• Movement: still, forward, back, strafe-left, strafe-right
• Camera: tilt-up, tilt-down, pan-left, pan-right, pan-left-fast, pan-right-fast

The project demos put those controls into distinct visual situations: a first-person neon-alley pan, lateral travel through a lantern cave, a third-person desert strafe, and a cathedral camera tilt.

The supplied inference command takes a first frame and a static scene prompt, then outputs a 5.2-second 832×480 clip with 50 denoising steps and 124 frames. That makes the released artifact a concrete image-to-video control loop, not just a research video.

The team released the Python and shell code, the action-routing patch for a pinned DiffSynth-Studio revision, and a downloadable H3-World LoRA checkpoint. The base MiniMax-H3 weights remain a substantial dependency at about 135 GB.

A custom image is center-cropped to 832×480 when needed; the user supplies a static description of its setting and subject, then selects an action preset. The training script uses rank-32 LoRA on qkv_proj and out_proj, running 20 epochs on four GPUs by default.

Hailuo's posts have been testing adjacent formats around H3 Max, not reporting H3-World evaluations. They include:

• A claim that every question can become a visual explanation in real time, from Hailuo_AI's visual-explanation post.
• A classroom and game as candidate formats in Hailuo_AI's post about classrooms and games, plus a proposed live showrunner or interactive-cinema engine in Hailuo_AI's interactive-cinema post.
• An interactive-video experience branded H3 Max Director in Hailuo_AI's Director demo and a real-time video version of Gartic Phone in Hailuo_AI's Gartic Phone demo.
• A claim that H3 can carry stories forward in Hailuo_AI's story post, followed by an open-world RPG demonstration in Hailuo_AI's RPG demo.
• A real-time interactive education demo in gokayfem's education demo.

Hailuo also posted that “every object” now comes with its own behind-the-scenes in Hailuo_AI's object post, a deliberately cryptic companion to that broader worldbuilding pitch.

A separate community experiment uses a specialized equirectangular ComfyUI workflow and 360-degree prompting to let the viewer move a viewport around an H3-generated environment on mobile or desktop. Its control happens at presentation time, while H3-World conditions future video latents from keyboard-derived actions.

The creator generated a nine-second clip, added a time-reversed layer for an 18-second loop, and ran it locally on an RTX 3080 Ti with 16 GB of VRAM. The full workflow write-up documents the resulting low resolution, visible seams, and other inconsistencies.