Comment by zwnow

Comment by zwnow 2 days ago

6 replies

> Being able to not only look up but automatically integrate things into your codebase that already exist in some form in the training data is incredibly useful.

Until it decides to include code it gathered from a stackoverflow post 15 years ago probably introducing security related issues or makes up libraries on the go or even worse, tries to make u install libs that were part of a data poisoning attack.

MontyCarloHall 2 days ago

It's no different from supervising a naïve junior engineer who also copy/pastes from 15 year old SO posts (a tale as old as time): you need to carefully review and actually grok the code the junior/AI writes. Sometimes this ends up taking longer than writing it yourself, sometimes it doesn't. As with all decisions in delegating work, the trick is knowing ahead of time whether this will be the case.

  • spzb 2 days ago

    Naive junior engineers eventually learn and become competent senior engineers. LLMs forget everything they "learn" as soon as the context window gets too big.

    • MontyCarloHall 2 days ago

      Very true! I liken AI to having an endless supply of newly hired interns with near-infinite knowledge but intern-level skills.

    • cheevly 2 days ago

      There are like a dozen well-established ways to overcome this. Learn how to use the basic tools and patterns my dude.

  • zwnow 2 days ago

    I have yet to see a junior trying to install random/non existing libs.

    • pigpop 2 days ago

      If you forced them to try it from memory without giving them access to the web you sure would.