Comment by yjftsjthsd-h
Comment by yjftsjthsd-h 2 days ago
> Does mean it pulls the model every time on startup though which isn't ideal
Surely it just downloads to a directory that can be volume mapped?
Comment by yjftsjthsd-h 2 days ago
> Does mean it pulls the model every time on startup though which isn't ideal
Surely it just downloads to a directory that can be volume mapped?
Yep. I just didn't spend the time to track down the location tbh. Plus huggingface usually does links to a cache folder that I don't recall the location of
Literally got cuda containers working earlier today so haven't spent a huge amount of time figuring things out