Comment by everlier
I work on Harbor (https://github.com/av/harbor), it is a project to save hours when setting up LLMs locally.
I pre-integrated over 50 different LLM-related projects, added a nice CLI and a Desktop app on top to manage the configs.