Skip to content
AI Primer
release

AIandDesign releases a Claude plugin for beat-synced music video cuts

AIandDesign's Claude plugin assembles music videos with beat-synced cuts and timestamp-based revisions. A finished demo combines Archive.org footage, Runway imagery and Hedra lip sync.

3 min read
AIandDesign releases a Claude plugin for beat-synced music video cuts
AIandDesign releases a Claude plugin for beat-synced music video cuts

TL;DR

A history file records accepted videos so later songs get different overlays and title treatments. The song-analysis instructions even anticipate ballads with unreliable beats, where the edit shifts toward musical phrases.

Beat-grid cuts and archive footage

The plugin takes a song and a creative brief. Its documented pipeline covers three main jobs:

  1. Analyze the audio. Extract tempo, beat offset and song sections. A beat map follows tempo drift rather than assuming one BPM throughout.
  2. Build the cut. Source Archive.org footage, use supplied clips or photos, or request generated clips through a connected video-generation MCP. Write beat-aligned shots into edl.py.
  3. Finish and render. Apply grading and custom graphics through a GPU compositor, retaining the original audio. Output can be 16:9, vertical 9:16 or square.

AIandDesign said an earlier EDM video used at least 60% archive footage, with Seedance generating only some material. The archive-first mix is the clever part.

Runway imagery and Hedra lip sync

For “The Only Way Is Through,” credited to DJ FL-AI featuring Desiree, AIandDesign described this assembly:

  • Prepare performer imagery in Runway.
  • Generate lip-sync pieces through the Hedra MCP.
  • Combine those assets with Archive.org footage using the music-video skill.

The creator called the result “literally one-shotted” after supplying the desired direction. The Runway imagery was prepared beforehand.

Creative direction and timestamp edits

After a render, Claude can take feedback scoped to a particular passage, according to AIandDesign. The example request is: “Between 0:43-0:56, change so and so.”

The documented approval flow retains several checkpoints:

  • Collect the brief and wait for approval before downloading, spending credits or rendering.
  • Propose three concepts.
  • Show still frames before the full render.

Claude Code setup

AIandDesign shared the repository link for the plugin. Installation uses:

The README lists /music-video-generator:music-video as the direct plugin invocation. Its example brief is: “make a music video for song.mp3, moody and nocturnal, archive footage only.”

Local rendering requires the following, per the requirements page:

  • Claude Code.
  • Python 3.10-3.13 and ffmpeg on the PATH.
  • A GPU supporting OpenGL 3.3.

The plugin was developed and tested on Apple Silicon macOS. Linux and Windows have fallbacks but are untested; claude.ai chat and Cowork can load the skill but cannot render it.

AI-generated clips additionally require a connected video-generation MCP and credits with that provider. Archive-only videos need no video-generation provider.

Footage rights

Responsibility for footage rights stays with the video's creator under the repository's rights notice. The skill:

  • Reads license fields on Archive.org items.
  • Flags items without license information.
  • Places source credits on the end card.

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 4 threads
TL;DR1 post
Beat-grid cuts and archive footage1 post
Runway imagery and Hedra lip sync1 post
Claude Code setup1 post
Share on X