llama.cpp
Port of LLaMA to C/C++
An open-source C/C++ software project for running LLaMA-family language models locally, with multiple backends and command-line/server tooling.
Recent stories
0 linked stories
No linked stories yet.
Port of LLaMA to C/C++
An open-source C/C++ software project for running LLaMA-family language models locally, with multiple backends and command-line/server tooling.