Comment by encomiast

Comment by encomiast 14 hours ago

2 replies

I’m not sure what ‘successfully’ means in this context. If it means training a model that is noticeably better than previous models, it’s not hard to see how that is challenging.

MikeTheGreat 12 hours ago

Ah. Thanks for posting - this makes a lot of sense.

I can totally see how they're able to pre-train models no problem, but are having trouble with the "noticeably better" part.

Thanks!

mudkipdev 14 hours ago

OpenAI allegedly has not completed a successful pretraining run since 4o