Comment by tpae

I'm working on Osaurus - https://github.com/dinoki-ai/osaurus, native, Apple Silicon–only local LLM server. Open Source + MIT-License