Comment by jcranmer

Comment by jcranmer 2 months ago

3 replies

> This was all before the advent of ChatGPT. I have no idea if that 15-page paper would be such a killer today.

The thing about ChatGPT is that it's not very good at producing essays. For a freshman-level class, it's likely to produce a C-quality paper, but my understanding is that trying to get it to produce a coherent longer essay is much more difficult, to the point that it'd be dubious if it would be a passing grade.

starfezzy 2 months ago

I've seen this insane take frequently, and I think I've found an explanation:

1. Almost NOBODY, I mean literally nobody I've ever met that uses LLMs besides myself, uses the paid version. It shocked me to learn people are actually USING the free version. These people are commonly of low intelligence, exactly the sort of people who cheat. Cheaters are using the shittiest models lmao, and many of them are using some knockoff on data-harvesting websites whose models are even worse than the free ChatGPT.

2. AI skeptics are frequently old people, and in any case are so skeptical that they formed an opinion about all AI services based on extremely limited experimenting with the free ChatGPT a whole year ago. They don't know about Claude 3.5 Sonnet, they've never compared it to GPT-4 (may 2024 version, API not the chatbot) let alone to GPT-4o. There's absolutely no way they know about Gemini 1.5 Pro 0826 via AIstudio.

These people have no capacity to recognize that AI services are making huge leaps in capability and the quality of outputs (ESPECIALLY if iterated on and hand-held). They say things like "the thing about ChatGPT is that it's not very good at producing essays".

How about this? I have a 4.0 in college. I never cheated because I don't need to. I've taken some intelligence tests (and learned that some standardized tests are essentially a proxy for intelligence testing) and learned that I'm kind of smart—OK whatever, this is to establish that I don't need to cheat. Even when ChatGPT was new and not very good (albeit, the original GPT4 which was decently capable), I was able to use it as a writing aid (you give it the assignment and it generates an outline, but then you feed it back the assignment and its outline, and have it generate the first section, then you iterate on that section, then you do all the sections, then you feed it the assignment and the completed essay and iterate on THAT, then you change a lot of the parts so it seems like a human wrote it) and earned an award for the best essay the department had seen in a long time. Again, that was when the AIs were shit compared to now.

People who think AIs are not capable are just a little out of touch, they're using them wrong or uncreatively, or they're not using them at all, or they're using the free version, or they're judging AIs by the results of low intelligence people who use the free version.

  • uneoneuno 2 months ago

    You have to be smart enough to know how to prompt and how to iterate on the LLM response. If you can't use the tool effectively, you're gonna get bad results.

    I'm in my mid 30's, well into my professional career as an engineer.

    I frequently use gpt to tune / tweak / see if I am missing anything in proposals and other documents I create. I'll give GPT a broad idea of what I'm writing and ask for bullet points, then review what it came up with and compare to what I've written. It almost always makes my output better - I find there's some customer disclaimer or other scope clarification that the gpt came up with that I incorporate into my document.

    Asking GPT to make you something or "do your essay" wont work. You have to know enough about the thing you want out of it in order to be able to ask GPT for it.

    So yes, the people who know things and know how to use a LLM are going to have more polished outputs. Most other people just plugging and chugging get junk or uninspired goop.

  • BeFlatXIII 2 months ago

    > they're using the free version

    …and they're not going to spend their own money to try out the real deal, for understandable skepticism on the RoI.