MODEL-RUNNER / LLAMA-CPP

llama.cpp

GGUF inference engine underneath most local runners.

model-runnerfreelocal