Multimodal

Venturetwins built a podcast clipping app with Thinking Machines’ Inkling. The app analyzes long-form audio, selects clip candidates by topic or best moment, and directs FFmpeg edits.

Google DeepMind unveiled GenCeption, which turns video into depth, segmentation, camera rays, 3D keypoints, and prompt-steered scene representations. The thread links project and Hugging Face materials.

Goodside compared Claude Fable 5 Max puzzle generation with GPT-5.6 Sol Pro solving attempts. Sol solved a 150-Pokémon empty crossword but failed the 1,025-Pokémon version, with one reported success traced to the answer key.

Goodside tested GPT-5.6 Sol and Claude Fable 5 with fake handwriting, constrained-vocabulary prompts, and Ghost Font. Sol often answered unreadable inputs, while Fable more often refused or pushed back.

Goodside fed GPT-5.6 Sol and Claude Fable 5 binary noise and meaningless handwriting. Sol often invented hidden text, while Fable also failed on noise but more often pushed back on scribbles.

Levelsio exported diet logs from Claude chat into Claude Code on a VPS, then built Caltrack with Telegram, SSH entry, database memory, and Grok vision food scanning. The case turned failed chat memory into a persistent app.

OpenAI staff said the new ChatGPT Voice is powered by GPT-Live-1 for more natural conversations. The launch also refreshed the ChatGPT shader with Blender prototypes translated to Metal and WebGL using Codex.

Posts say Meta AI began rolling out Muse Image and Muse Video in the U.S. Muse Image is described with web search, code execution, self-critique, multi-reference composition, and Content Seal watermarking.

xAI opened Grok Imagine 1.5 Preview in its Imagine API, moving the model from benchmark chatter into direct creator access. The same-day Cloudflare AI Gateway support gives teams another route to run Grok models in production.

Google’s new Gemma 4 12B ships as an encoder-free open model for text, image, audio, and video tasks with a 256K context window. Early GGUF ports and local benchmarks make it a plausible on-device multimodal option for creator tooling and experimentation.

A sponsored explainer thread described Speech Engine as a WebSocket layer that adds speech-to-text, turn detection, interruption handling, and text-to-speech to existing LLM agents. The pitch is that teams can keep their current model stack and add voice without rebuilding the whole agent.

Posts report SenseTime open-sourced SenseNova U1, a unified text-image model with interleaved generation, 8-step distilled LoRA and ComfyUI workflows. They cite 2K image times around 15 seconds and H100 inference cuts to about 2 seconds, so compare it against your current image pipeline.

Tencent released HY-World 2.0 with WorldMirror 2.0 code and weights for turning text, images, or video into persistent 3D scenes. The output includes navigable geometry and camera data instead of disposable video frames.