Skip to content

explore all stories all tools all skills

All Tools›Categories›LLM Inference & Serving

⚙️

LLM Inference & Serving

115 tools

Inference runtimes, model serving platforms, fine-tuning infra, and GPU/accelerator providers for LLMs.

OpenRouter, Inc.

The unified interface for AI models.

Easy, fast, and cheap LLM serving

A fast serving framework for large language models

Get up and running with large language models locally

Build with Gemini in AI Studio

Amazon Web Services

Build and scale generative AI applications with foundation models.

Build with Grok

OpenAI Platform

Build with OpenAI APIs and tools.

Georgi Gerganov

C/C++ LLM inference for local execution.

The AI Acceleration Cloud

Fast, memory-efficient LLM fine-tuning

The AI assistant from Anthropic

Serverless AI inference platform

Build with OpenAI models via API.

Deploy and serve AI models

Hugging Face Hub

The platform for models, datasets, and Spaces.

AI portal from Nous Research.

Inference microservices for AI models

Baidu's large-model development platform

Claude API console

Claude Platform on AWS

Decoupled DiLoCo

Google DeepMind

Decentralized, communication-efficient model training.

The go-to library for state-of-the-art diffusion models.

AI routing service

Gemini Live API

Build live, multimodal experiences with Gemini.

Cloud computing for building, deploying, and scaling applications on Google infrastructure.

Inference of LLMs in C/C++

Element Labs, Inc.

Discover, download, and run local LLMs.

Miles RL Training

RL training software

NVIDIA RTX Spark

NVIDIA RTX Spark

OpenAI Guaranteed Capacity

Guaranteed access to OpenAI capacity

Prime Intellect

Prime Intellect

Decentralized AI infrastructure

Hangzhou DeepSeek Artificial Intelligence Co., Ltd.

Tile-based GPU kernels from DeepSeek.

Zyphra Technologies Inc.

Zyphra Inference

Zyphra's hosted inference service

Playground for AFM

Gateway to AI models

Unified API for AI models

Enterprise AI platform for language-model workflows

Baidu AI Studio LLM API

API service for Baidu AI Studio

BytePlus Pte. Ltd.

Enterprise technology platform

Cerebras Systems

Hosted AI inference platform

Claude Code Router

Open-source Claude Code router

CloudMatrix-Infer

AI inference service

Build and run coding agents on Baseten

Conway Research

Conway by Conway Research

Core AI PyTorch Extensions

PyTorch extensions from Core AI.

DeepSeek + Claude

Communication library for expert parallelism.

Efficient FP8 GEMM library

DeepSeek-Reasonix

Unverified target name

Personal AI supercomputer

Antirez-associated software project

Distributed inference across devices.

Fireworks.ai, Inc.

AI inference and model deployment platform

Fast MLA decoding

Training tool for large-language-model workflows

Google's AI assistant product context

Google AI Edge Gallery

Explore and run AI models on-device.

Run large language models locally on your machine

Fast AI inference

Software product

Benchmarking tool for LLM serving systems

The AI community building the future.

JigsawStack, Inc.

Interfaze by JigsawStack

LangSmith LLM Gateway

LLM gateway for LangSmith

Lightning AI, Inc.

Build, train, and deploy AI products in the cloud.

Open-source LLM gateway

Element Labs, Inc.

Meta CLI for developer workflows

AI for customer support

Studio for building and managing AI workflows and agents.

Provisional catalog entry for the ModellixAI product name.

Open-source model community and platform

KV-cache software for LLM serving

Multimodal AI service

Reinforcement learning for LLM post-training

Novita AI sandbox for testing AI services.

NVIDIA DGX 8xB200

8x B200 GPU DGX system

Open Generative AI

Generative AI software product

Developer API for OpenAI models

Algorithmic SuperIntelligence Labs

AI/LLM optimization tool

AI model routing platform.

Cloud software from Ostris, LLC.

PaddlePaddle AI Studio

Baidu's AI development platform for PaddlePaddle.

C++ Parakeet implementation

Kyutai text-to-speech product

Prime Intellect Lab

Prime Intellect

Prime Intellect Lab

PrismML software product

Rosalind Biodefense

Biodefense-focused OpenAI tool

NVIDIA Corporation

Spark-branded NVIDIA product

Cloud GPU platform for AI

AI software platform

Thinking Machines

Thinking Machines Lab

Software product associated with Thinking Machines Lab

A language and toolchain for efficient GPU kernel development

TileLang-Ascend

TileLang support for Ascend

Together Fine-Tuning

Fine-tune open models on Together AI.

AI model training platform.

train-sentence-transformers

Train sentence-transformer models on Hugging Face Space

Fine-tune LLMs faster.

Unsloth's studio for language-model workflows.

GPU cloud marketplace

Developer API for Venice.ai models

A unified machine learning platform for building and using generative AI

Multimodal inference and serving platform

vLLM ecosystem software

AI platform from xAI

Terminal access to xAI services

AI Force Singapore Pte. Ltd.

Unverified software product.

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.