Skip to content
AI Primer
workflow

Techhalla uses Seedream 5.5 and Kling 4.0 Omni to animate generated worlds

Techhalla uses a green-screen performance to drive movement across generated worlds. The workflow builds character sheets and first frames in Seedream 5.5, then applies Kling 4.0 Omni video-to-video in Magnific.

3 min read
Techhalla uses Seedream 5.5 and Kling 4.0 Omni to animate generated worlds
Techhalla uses Seedream 5.5 and Kling 4.0 Omni to animate generated worlds

TL;DR

  • One fight drives four different casts and sets in techhalla's Magnific demo.
  • The source performance is AI-generated: Seedream 5.5 creates the starting image, Seedance 2.5 animates it, and Kling 4.0 Omni handles the world swaps, according to his breakdown.
  • The prompts and connected workflow are available in a shared Magnific Space, linked in the tutorial thread.

Techhalla's clever shortcut starts with a synthetic mocap stage, complete with tracking markers and head-mounted cameras. The replacement worlds stretch from Akkad in 2300 BC to a lunar mine in 2089.

An AI-generated green-screen take

Techhalla builds the motion source in two steps, explained in his tutorial:

  1. Seedream 5.5: Generate “frame 0,” a still of performers on a green-screen mocap stage.
  2. Seedance 2.5: Animate that still into a single 30-second fight, with no cuts.

That generated take supplies the choreography for every subsequent conversion.

Four worlds, one choreography

Each world gets four Seedream 5.5 assets, detailed in techhalla's reference layout:

  1. Heroine sheet: Front, side and back character views.
  2. Heavies sheet: The three opposing characters.
  3. Location reference: The empty setting.
  4. New frame 0: Characters placed in the replacement world, matching the green-screen take's framing.

The four destinations are:

  • Akkad, 2300 BC
  • Amsterdam, 1665
  • Arctic Ocean, 1974
  • Lunar Mine, 2089

Kling 4.0 Omni performs the video-to-video conversions, with the green-screen take driving every move, according to techhalla.

The shared Magnific Space

Techhalla says the shared Space contains every prompt and has the assets and conversions already connected for replacing the world, as he explains in the tutorial thread.

Access depends on permissions: Magnific's sharing documentation gives editors workflow-running rights, while viewers cannot edit or comment. Model-specific credit costs appear in the model selector, according to the video-node documentation.

Retro franchise remakes

Techhalla has also been publishing period-shifted shorts:

  • Men in Black, 1977: The alien-agent franchise gets an earlier setting in his remake.
  • Pirates of the Caribbean, 1974: Another entry appears in the Pirates thread.
  • Claude is down, 1981: The AI-outage premise gets a retro treatment in his earlier short.

Men in Black reimagined as 1977

Pirates of the Caribbean reimagined as 1974

Futurama, 1971

A viewer praised Dr. Zoidberg's cameo under the Pirates clip. Techhalla answered with “Futurama, but it's 1971” and a preview image.

He subsequently published the finished short:

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 5 threads
TL;DR1 post
An AI-generated green-screen take1 post
Four worlds, one choreography1 post
Retro franchise remakes5 posts
Futurama, 19712 posts
Share on X