Skip to content
AI Primer
workflow

Techhalla uses MIDI-driven Three.js animation to guide Seedance 2.5

Techhalla pairs Seedance 2.5 with a MIDI-driven Three.js animation and first frame to guide a character’s finger movements. The shared workflow includes prompts and a single-file HTML synchronizer.

2 min read
Techhalla uses MIDI-driven Three.js animation to guide Seedance 2.5
Techhalla uses MIDI-driven Three.js animation to guide Seedance 2.5

TL;DR

The final prompt can add moving waves around the performance. Suno’s export guide lists a 10-credit charge for extracting MIDI from an audio stem.

MIDI to Three.js

Techhalla’s workflow assigns a different job to each of four tools:

  1. Suno: supplies the music, with MIDI exported for the animation.
  2. Three.js: turns the MIDI into a 3D performance using a single HTML file.
  3. Magnific One: transforms an extracted first frame into the intended visual style.
  4. Seedance 2.5: generates the finished character video from the reference material.

The intermediate render gives the video model a visible performance to follow, with musical timing already represented in the animation.

Two references for Seedance

The original 3D video carries the performance reference; the One-treated first frame supplies the target appearance. Techhalla asks Seedance to use the animation as its reference for the notes the character plays.

Magnific offers Seedance 2.5, and its API documentation explicitly describes reference videos as sources of motion, action or style. Image references are supported alongside them.

The shared HTML and MIDI export

Techhalla says the shared Magnific Space contains the HTML synchronizer and the prompts used for One and Seedance. He describes the single file as able to synchronize other MIDI files, too.

For music made in Suno, the documented MIDI extraction route runs through individual stems:

  1. Audio is separated using the Stems panel.
  2. The relevant stem is selected.
  3. Get MIDI, in the stem’s context menu, analyzes the audio and generates a MIDI file representing its melodic or rhythmic content.

That file is extracted from audio, rather than being an original instrumental performance captured as MIDI.

More Magnific experiments

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 1 thread
More Magnific experiments3 posts
Share on X