Desktop software for downloading, running, and serving large language models locally, including through an OpenAI-compatible local API server.

Recent stories
1 linked story
Desktop software for downloading, running, and serving large language models locally, including through an OpenAI-compatible local API server.
