Llama.cpp

Open-source, high-performance C/C++ port for running LLMs locally on consumer hardware with minimal memory overhead.

Explore on Agidapp Global