Model serving Inference Optimization Open Models Inkling

TokenSpeed

A speed-of-light LLM inference engine.

An open-source LLM inference engine for agentic workloads, with a compiler-backed modeling layer, high-performance scheduler, KV-cache resource management, and modular kernels for heterogeneous accelerators.

Recent stories

1 linked story

newsSECONDARY2026-07-16

Inkling adds early llama.cpp serving via 1-bit GGUF

Inkling's 1-bit GGUF ran in llama.cpp at 30–40 TPS, and TokenSpeed added day-zero support with a flat KV cache pool. Arena posts put Inkling #10 among open models in frontend code and text, while docs drew scrutiny.