Comment by sid-the-kid
Comment by sid-the-kid 5 days ago
Thank you! We are considering to release an open-source version of the model. Somebody will do it soon. Might as well be us. We are mostly concerned with the additional overhead of releasing and then supporting it. So, TBD.
Overhead? None Your real concern is: will potential customers run the model by themselves and skipping us?
Answer is no because you will eventually release a subpar model not your sorta model.
Also people don't have infrastructure to run this at scale (100-500 concurrent users) at best they can run it for 1-2 concurrent users.
This could be a good way for peoples to test it then use your infra.
Ah but you do have an online demo, so you might think this is enough, WRONG.