Comment by jcranmer
> This was all before the advent of ChatGPT. I have no idea if that 15-page paper would be such a killer today.
The thing about ChatGPT is that it's not very good at producing essays. For a freshman-level class, it's likely to produce a C-quality paper, but my understanding is that trying to get it to produce a coherent longer essay is much more difficult, to the point that it'd be dubious if it would be a passing grade.
I've seen this insane take frequently, and I think I've found an explanation:
1. Almost NOBODY, I mean literally nobody I've ever met that uses LLMs besides myself, uses the paid version. It shocked me to learn people are actually USING the free version. These people are commonly of low intelligence, exactly the sort of people who cheat. Cheaters are using the shittiest models lmao, and many of them are using some knockoff on data-harvesting websites whose models are even worse than the free ChatGPT.
2. AI skeptics are frequently old people, and in any case are so skeptical that they formed an opinion about all AI services based on extremely limited experimenting with the free ChatGPT a whole year ago. They don't know about Claude 3.5 Sonnet, they've never compared it to GPT-4 (may 2024 version, API not the chatbot) let alone to GPT-4o. There's absolutely no way they know about Gemini 1.5 Pro 0826 via AIstudio.
These people have no capacity to recognize that AI services are making huge leaps in capability and the quality of outputs (ESPECIALLY if iterated on and hand-held). They say things like "the thing about ChatGPT is that it's not very good at producing essays".
How about this? I have a 4.0 in college. I never cheated because I don't need to. I've taken some intelligence tests (and learned that some standardized tests are essentially a proxy for intelligence testing) and learned that I'm kind of smart—OK whatever, this is to establish that I don't need to cheat. Even when ChatGPT was new and not very good (albeit, the original GPT4 which was decently capable), I was able to use it as a writing aid (you give it the assignment and it generates an outline, but then you feed it back the assignment and its outline, and have it generate the first section, then you iterate on that section, then you do all the sections, then you feed it the assignment and the completed essay and iterate on THAT, then you change a lot of the parts so it seems like a human wrote it) and earned an award for the best essay the department had seen in a long time. Again, that was when the AIs were shit compared to now.
People who think AIs are not capable are just a little out of touch, they're using them wrong or uncreatively, or they're not using them at all, or they're using the free version, or they're judging AIs by the results of low intelligence people who use the free version.