llama.cpp
LLM inference in C/C++
Open-source C/C++ software for local inference with large language models, including running GGUF models and serving them through local APIs.
Recent stories
0 linked stories
No linked stories yet.
LLM inference in C/C++
Open-source C/C++ software for local inference with large language models, including running GGUF models and serving them through local APIs.