Skip to content

explore all stories all tools all skills

All Tools›Categories›LLM Inference & Serving

⚙️

LLM Inference & Serving

115 tools

Inference runtimes, model serving platforms, fine-tuning infra, and GPU/accelerator providers for LLMs.

Build with Gemini

Build with Grok

Serverless AI inference platform

Google's AI assistant product context

Get up and running with large language models, locally.

OpenRouter, Inc.

The unified interface for AI models.

BytePlus Pte. Ltd.

Enterprise software platform

The AI assistant from Anthropic

Claude API console

Hugging Face Hub

The platform for models, datasets, and Spaces.

Element Labs, Inc.

Run AI models locally on your computer.

NVIDIA RTX Spark

NVIDIA-branded software product

AI platform from xAI

Playground for AFM

A single gateway for AI model access and routing.

Unified API for AI models

Amazon Web Services

Build and scale generative AI applications with foundation models.

Enterprise AI platform for language-model workflows

Baidu AI Studio LLM API

API service for Baidu AI Studio

Baidu's large-model development platform

Deploy and serve AI models

Cerebras Systems

Hosted AI inference platform

Claude Code Router

Open-source Claude Code router

Claude Platform on AWS

CloudMatrix-Infer

AI inference service

Build and run coding agents.

Conway Research

Conway by Conway Research

Core AI PyTorch Extensions

PyTorch extensions from Core AI

Decoupled DiLoCo

Google DeepMind

Decentralized, communication-efficient model training.

AI service combining Claude and DeepSeek-style reasoning

Communication library for expert parallelism.

Efficient FP8 GEMM library

DeepSeek-Reasonix

Unverified target name

Personal AI supercomputer

Diffusion models in PyTorch and beyond.

Antirez-associated software project

Distributed inference across devices.

AI request routing for Factory

Fireworks.ai, Inc.

AI inference and model deployment platform

Fast MLA decoding

Training tool for large-language-model workflows

Gemini Live API

Build live, multimodal experiences with Gemini.

Google AI Edge Gallery

Explore and run AI models on-device.

Cloud computing for building, deploying, and scaling applications on Google infrastructure.

Run large language models locally.

Fast AI inference

Software product

Benchmarking tool for LLM serving systems

AI platform for models, datasets, and apps.

JigsawStack, Inc.

Interfaze by JigsawStack

LangSmith LLM Gateway

LLM gateway for LangSmith

Lightning AI, Inc.

Build, train, and deploy AI apps

All LLM APIs in the OpenAI format

Inference of LLMs in C/C++

Georgi Gerganov

Port of LLaMA to C/C++

Element Labs, Inc.

Meta CLI for developer workflows

Miles RL Training

RL training software

AI for customer support

Studio for building AI applications on Mistral AI

Provisional catalog entry for the ModellixAI product name.

Open-source model community and platform

KV-cache software for LLM serving

Multimodal AI service

Reinforcement learning for LLM post-training

AI portal from Nous Research.

Novita AI sandbox for testing AI services.

NVIDIA DGX 8xB200

8x B200 GPU DGX system

Inference microservices for AI models

Open Generative AI

Generative AI software product

Build with OpenAI models.

Developer API for OpenAI models

OpenAI Guaranteed Capacity

Reserved capacity for OpenAI models and APIs

OpenAI Platform

Build with OpenAI APIs and tools.

Algorithmic SuperIntelligence Labs

AI/LLM optimization tool

AI model routing platform.

Cloud-based software product from Ostris, LLC.

PaddlePaddle AI Studio

Baidu's AI development platform for PaddlePaddle.

C++ Parakeet implementation

Kyutai text-to-speech product

Prime Intellect

Prime Intellect

Decentralized AI infrastructure

Prime Intellect Lab

Prime Intellect

Prime Intellect Lab

PrismML software product

Rosalind Biodefense

OpenAI biodefense software product.

NVIDIA Corporation

NVIDIA software product

Cloud GPU platform for AI

A fast serving framework for large language models

Edge AI platform

Thinking Machines

Thinking Machines Lab

Hangzhou DeepSeek Artificial Intelligence Co., Ltd.

Tile-based GPU kernels from DeepSeek.

A language and toolchain for efficient GPU kernel development

TileLang-Ascend

TileLang support for Ascend

The AI Acceleration Cloud

Together Fine-Tuning

Fine-tune open models on Together AI.

AI model training platform.

train-sentence-transformers

Train sentence-transformers models on Hugging Face

Fast, easy, and cheap fine-tuning for LLMs.

Fine-tune LLMs faster.

Fine-tuning and model management platform

GPU cloud marketplace

Developer API for Venice.ai models

A unified machine learning platform for building and using generative AI

Fast and easy-to-use library for LLM inference and serving.

Multimodal inference and serving platform

vLLM ecosystem software

Terminal access to xAI services

AI Force Singapore Pte. Ltd.

Unverified software product.

Zyphra Technologies Inc.

Cloud AI access

Zyphra Inference

Hosted inference service

AI Primer

Your daily guide to AI tools, workflows, and creative inspiration.

© 2026 AI Primer. All rights reserved.