Comment by NitpickLawyer

To paraphrase that quote about hydrogen: Give gradient descent a few billion parameters, and it starts wondering where it came from and what does it all mean.