Skip to content
AI Primer
workflow

ComfyUI runs local MiniMax H3 renders for constrained motion studies

Creators used local ComfyUI renders of open-weight MiniMax H3 for constrained motion studies, including a growing paper forest, rain confined to a bowl, velvet movement, and a lemon squeeze. The outputs were upscaled after rendering.

4 min read
ComfyUI runs local MiniMax H3 renders for constrained motion studies
ComfyUI runs local MiniMax H3 renders for constrained motion studies

TL;DR

Comfy-Org's H3 reference-to-video template separates video and audio reference inputs, while its model package README lists several precision variants and 4-step and 8-step Turbo LoRAs. A fog jar counted by squeaks and an H3 camera orbit turned into a Gaussian splat, documented in GlennHasABeard's fog test and akatash23's tutorial, show where local video experiments are heading.

Locked cameras

GlennHasABeard's forest test and rain study each use a 15-second locked shot rendered locally in ComfyUI, then upscaled in Topaz to 4K. The prompts make one visual claim at a time:

  • Growth: “tiny green trunks” rise from paper, then branches and moss fill in.
  • Boundary: rain falls only within a bowl's rim.
  • Surface: a finger stroke flips velvet nap into a dark band, then opens a seam of warm light in GlennHasABeard's velvet pass.

Audio cues

The tests assign sound a structural role. In GlennHasABeard's fog jar, three lid squeaks at three seconds become three rotations; the creator attributes the count directly to the audio.

  • Layering: the lemon clip combines a wet squeeze under glass tinkles, which GlennHasABeard says establishes both actions at once.
  • Sequence: GlennHasABeard's domino study pairs ten one-per-second tinkles with a ten-tile run, even though the second tile becomes a water splash.
  • Duration: GlennHasABeard's sand test gives both the cut and the hiss eight seconds, a repeated duration cue.

Material and direction clauses

The prompts add short corrective clauses for things video models tend to simplify.

References and render time

Comfy-Org's template supports reference media alongside generation controls. Francky_B's Prompt Composer post adds a ComfyUI layer for swapping subjects with their linked LoRAs and RefMods; its repository includes the add-on and example workflows.

r/StableDiffusion

Possible with MInimax H3?

0 comments

  • Character continuity: In Voxyfernus's post, character sheets used as initial and final states produced bad reference style and poor transformations.
  • Silence: Leonviz reports in their post that voices persisted after explicit “zero audio” and “no speech” directions.
  • Render time: carmidian's report says a 10-second, 1280×736 reference-image-and-audio render rose from roughly 40 minutes to one hour and 17 minutes after workflow updates.

Gaussian splats

Akatash23's Reddit tutorial turns a local H3 orbit into a Gaussian-splat asset rather than a finished video. Its sequence is specific:

  1. Generate a continuous 360-degree orbit with the default FL2VA workflow, using the same still as first and last frame.
  2. At 768×1024 and 20 steps without a Lightning LoRA, the author reports about 35 minutes on 12GB of VRAM.
  3. Extract frames with ffmpeg, remove duplicated early frames, and replace the first frame with the high-resolution source image.
  4. Reconstruct camera poses in COLMAP, then train the splat in Brush.
  5. Remove invented background debris in the browser-based SuperSplat editor.

The same tutorial reports that a plausible orbit can still lack geometric consistency, including background colors bleeding into the subject and artifacts around its edges.

r/StableDiffusion

From a Single Image to Gaussian Splats (another tutorial)

0 comments

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 4 threads
TL;DR1 post
Locked cameras1 post
Audio cues2 posts
Material and direction clauses3 posts
Share on X