Edge Compute

Perplexity launched Portable Computer in its Windows app for supported NVIDIA RTX systems. Local inference requires at least 24GB of VRAM, while the update also adds local MCP support and scheduled tasks.

Perplexity open-sourced Lily, a Rust and Metal engine for Qwen3.6-35B-A3B in Perplexity Computer's hybrid workflow. Perplexity reports 1.23× faster prefill and 1.35× faster decode on an M5 Max MacBook Pro.

Perplexity's Mac app can route sensitive agent steps to local models while using cloud models for other work. The company also open-sourced the PII classifier used to decide where work runs.

A developer reports streaming 60% of Qwen3.8-Flash-Next experts from disk on demand, running the full model in 37 GB at 40 tokens per second. BF16 and GGUF weights are also available for local deployments.

Perplexity’s Portable Computer runs its orchestrator, subagents, and harness locally on NVIDIA DGX Spark with a post-trained 27B model. Frontier-model escalation requires user approval and flags PII before text is sent externally.

A LocalLLaMA post ran a 122B Qwen model on an older laptop with llama.cpp. The run had very long load and generation times, while another report put Qwen 3.6 35B at 21 tok/s on a Radeon 7600 after ROCm tuning.

Magnitude launched an open-source terminal coding agent that runs local models on-device without API keys. Its launch post says it profiles hardware and can use shell, file-editing, script, and skills tools.