Skip to content
AI Primer
workflow

Sol and Claude Code build 3D scenes from reference images

Demos from Gokay and Meng To used video, object-view, and image references to generate HTML, Three.js, or Blender scenes. The builds paired Sol or Claude Code with tools including Reve, HyperFrames, and Blender MCP.

4 min read
Sol and Claude Code build 3D scenes from reference images
Sol and Claude Code build 3D scenes from reference images

TL;DR

OpenAI's launch post says GPT-5.6 is generally available, with Sol as the flagship model and ultra as the highest-capability setting for parallel workstreams. gokayfem's exact prompt made the agent care about contact points: no floating parts, matching materials, matching lighting in the prompt. MengTo's Skills repo turns screen recordings into super prompts for one-shot HTML. BlenderMCP lets Claude create and inspect Blender scenes over MCP, while HyperFrames renders HTML, CSS, media, and seekable animations into deterministic MP4.

Four views to Three.js

Gokayfem started from a multi-view reference image and asked GPT 5.6 Sol to produce one Three.js object, then wrap the result in a HyperFrames explanation video. The first note called it "10 minutes with 5.6 Sol Ultra" in gokayfem's post.

The stack in gokayfem's follow-up was compact:

  • Reve 2.1 for reference images
  • Three.js for the 3D representation
  • HyperFrames for the video
  • Claude Code on CLI as a critic, according to gokayfem's full prompt

The workflow is the interesting part: reference image as spec, code agent as modeler, Claude Code as critic, HTML video renderer as packaging.

Video-to-HTML skills

Video went from inspiration to input in MengTo's workflow. MengTo's walkthrough called one-shot video-to-HTML Sol's real superpower and linked the open-sourced skills behind it.

The MengTo/Skills repo describes Video to Super Prompt as a skill that turns a screen recording of a design, landing page, or animation into a detailed prompt for one-shot HTML.

His replies tightened the claim:

Blender MCP

Blender MCP is the other half: natural-language control of a live 3D tool. MengTo's Blender MCP demo said zero Blender experience plus skills was enough to create intricate, animated models.

The BlenderMCP repo says it connects Claude AI to Blender through MCP for prompt-assisted 3D modeling, scene creation, scene inspection, and object manipulation. It also lists viewport screenshots, Sketchfab downloads, Poly Haven assets, Hyper3D Rodin generation, remote hosts, and anonymous tool telemetry.

MengTo's own reaction was short: the detail level had "upgraded tremendously" in his reply.

Build burst

Minchoi gathered ten examples less than five days after launch in his GPT-5.6 roundup. The creator-relevant ones clustered around 3D, animation, and UI cloning:

Outside that roundup, bilawalsidhu's voxel city prompt asked Sol Ultra to recreate San Francisco as a 3D voxel city, and MengTo posted another Sol Ultra-made build with "What a time to be a builder."

Screenplay coverage loop

Rainisto used Sol for writing, not visuals: one agent revised a screenplay, another read it cold with the same evaluation criteria, and the human picked directions between rounds.

Scores moved from 79 to 90 over a few hours, with a caveat: repeated independent agents varied by about 2 to 3 points, while the written notes stayed aligned, according to rainisto's follow-up. Earlier in the same thread, rainisto used MCP Blender to block a primitive Miami night street, then asked gpt-image-2 to turn it into a polished Miami nightlife image.

Further reading

Discussion across the web

Where this story is being discussed, in original context.

On X· 5 threads
TL;DR3 posts
Four views to Three.js2 posts
Video-to-HTML skills4 posts
Blender MCP1 post
Build burst7 posts
Share on X