llama.cpp

This guide walks through deploying Ornith-1.0-35B locally with llama.cpp, wiring it into Hermes Agent, and finally grafting on an MTP head to push inference speed even higher.