#1 AIFree
LLMKube — alternative #1 to llama.cpp
Kubernetes operator for self-hosted LLM inference with pluggable runtimes (llama.cpp, vLLM, TGI, Ollama, vllm-swift), multi-GPU sharding, NV...
Catalogue source
Recorded alternatives
Alternatives to llama.cpp
Every candidate below sits in AI. What ends up on this page is decided entirely by a recorded score — not by bidding, not by editor taste. Review both records, check current vendor terms, then decide.
#2 AIPaid
Local CLI/SDK — alternative #2 to llama.cpp
Foundry Local is Microsoft's offline, on-device runtime for running models like Phi entirely on your own hardware - no Azure subscription, A...
Catalogue source
#3 AIUnknown
memra-server — alternative #3 to llama.cpp
Inference engine for NVIDIA Blackwell cards with per-device tuned defaults, serving GGUF and safetensors over an OpenAI-...
Catalogue source
#4 AIFree
transcribe.cpp — alternative #4 to llama.cpp
C/C++ speech-to-text inference library running 16+ model families on the ggml runtime with GPU acceleration.
GitHub source
#5 AIUnknown
LlamaChat — alternative #5 to llama.cpp
LlamaChat allows you to chat with LLaMa, Alpaca and GPT4All models1 all running locally on your Mac.
Catalogue source
#6 AIUnknown
mistralrs — alternative #6 to llama.cpp
Fast, flexible LLM inference engine supporting multimodal models, quantization (GGUF/GPTQ/ISQ), and OpenAI-compa...
Catalogue source
#7 AIUnknown
shimmytok — alternative #7 to llama.cpp
[shimmytok] - Pure-Rust tokenizer for GGUF models, compatible with llama.cpp tokenization.
GitHub source
Questions about this page
How were these alternatives selected?
Each candidate is a live catalogue record in the same primary category, picked by a deterministic score that Oryxen records in its catalogue: how many meaningful words the two listings share, whether their pricing classes oppose (a paid product against a free one), whether both are open source, and whether either record is featured. The same catalogue state always produces the same list — no randomness, no manual ranking.
Are these alternatives ranked by payment?
No. Rows are ordered only by the recorded score, highest first, with alphabetical ties — payment never influences the order, nothing here is paid placement, and Oryxen charges no listing or placement fee.
Always verify current terms with llama.cpp directly — Oryxen records pricing classes, not live quotes.