Comment by riffraff

It is well reported that meta (and open ai and basically everyone) trained on contained obtained via piracy (LibGen).