llama.cpp
Inference of LLMs in C/C++
Open-source C/C++ software for running large language models locally, with efficient inference tooling and support for GGUF models.
Recent stories
0 linked stories
No linked stories yet.
Inference of LLMs in C/C++
Open-source C/C++ software for running large language models locally, with efficient inference tooling and support for GGUF models.