Comment by davnicwil

Isn't what you're describing just a set of APIs with native bindings that the LLM can call?

I'm not sure I understand why it's necessary to even couple this to a runtime, let alone own the runtime?

Can't you just do it as a library and train/instruct the LLM to prefer using that library?