AIandDesign releases a Claude plugin for beat-synced music video cuts
AIandDesign's Claude plugin assembles music videos with beat-synced cuts and timestamp-based revisions. A finished demo combines Archive.org footage, Runway imagery and Hedra lip sync.

TL;DR
- Claude Code can assemble beat-synced music videos and accept timestamp-based revisions, according to AIandDesign's announcement.
- A finished demo combines Runway performer imagery, Hedra lip sync and Archive.org footage in “The Only Way Is Through”.
- Generated footage is optional: an archive-only preview uses none, while an earlier EDM demo reportedly used at least 60% archive footage.
A history file records accepted videos so later songs get different overlays and title treatments. The song-analysis instructions even anticipate ballads with unreliable beats, where the edit shifts toward musical phrases.
Beat-grid cuts and archive footage
The plugin takes a song and a creative brief. Its documented pipeline covers three main jobs:
- Analyze the audio. Extract tempo, beat offset and song sections. A beat map follows tempo drift rather than assuming one BPM throughout.
- Build the cut. Source Archive.org footage, use supplied clips or photos, or request generated clips through a connected video-generation MCP. Write beat-aligned shots into
edl.py. - Finish and render. Apply grading and custom graphics through a GPU compositor, retaining the original audio. Output can be 16:9, vertical 9:16 or square.
AIandDesign said an earlier EDM video used at least 60% archive footage, with Seedance generating only some material. The archive-first mix is the clever part.
Runway imagery and Hedra lip sync
For “The Only Way Is Through,” credited to DJ FL-AI featuring Desiree, AIandDesign described this assembly:
- Prepare performer imagery in Runway.
- Generate lip-sync pieces through the Hedra MCP.
- Combine those assets with Archive.org footage using the music-video skill.
The creator called the result “literally one-shotted” after supplying the desired direction. The Runway imagery was prepared beforehand.
Creative direction and timestamp edits
After a render, Claude can take feedback scoped to a particular passage, according to AIandDesign. The example request is: “Between 0:43-0:56, change so and so.”
The documented approval flow retains several checkpoints:
- Collect the brief and wait for approval before downloading, spending credits or rendering.
- Propose three concepts.
- Show still frames before the full render.
Claude Code setup
AIandDesign shared the repository link for the plugin. Installation uses:
The README lists /music-video-generator:music-video as the direct plugin invocation. Its example brief is: “make a music video for song.mp3, moody and nocturnal, archive footage only.”
Local rendering requires the following, per the requirements page:
- Claude Code.
- Python 3.10-3.13 and ffmpeg on the PATH.
- A GPU supporting OpenGL 3.3.
The plugin was developed and tested on Apple Silicon macOS. Linux and Windows have fallbacks but are untested; claude.ai chat and Cowork can load the skill but cannot render it.
AI-generated clips additionally require a connected video-generation MCP and credits with that provider. Archive-only videos need no video-generation provider.
Footage rights
Responsibility for footage rights stays with the video's creator under the repository's rights notice. The skill:
- Reads license fields on Archive.org items.
- Flags items without license information.
- Places source credits on the end card.