Comment by tsimionescu

Comment by tsimionescu 2 days ago

6 replies

While I believe you're probably right that getting any productivity gains from these tools requires an investment, I think calling the process "engineering" is really stretching the meaning of the word. It's really closer to ritual magic than any solid engineering practices at this point. People have guesses and practices that may or may not actually work for them (since measuring productivity increases is difficult if not impossible), and they teach others their magic formulas for controlling the demon.

gtaylor 2 days ago

Most countries don’t have a notion of a formally licensed software engineer, anyway. Arguing what is and is not engineering is not useful.

  • tsimionescu 2 days ago

    Most countries don't have a notion of a formally licenses physicist either. That doesn't make it right to call astrology physics. And all of the practices around using LLM agents for coding are a lot closer to astrology than they are to astronomy.

    I was replying to someone who claimed that getting real productivity gains from this tool requires engineering and needs to be approached as such. It also compared learning to use LLM agents to learning to code in emacs or vim, or learning a programming language - things which are nothing alike to learning to control an inherently stochastic tool that can't even be understood using any of our regular scientific methods.

  • llbeansandrice 2 days ago

    I think it's relevant when people keep using terms like "prompt engineering" to try and beef up this charade of md files that don't even seem to work consistently.

    This is a far far cry from even writing yaml for Github/Gitlab CICD pipelines. Folks keep trying to say "engineering" when every AI thread like this seems to push me more towards "snake oil" as an appropriate term.

    • stingraycharles 2 days ago

      Prompt engineering is a real thing though, but it’s not related to markdown files etc.

      If you’re not benchmarking and systematically measuring the impact of your changes, it’s not prompt engineering, it’s just improving stuff.

stingraycharles 2 days ago

Well it requires a lot of planning, spec’ing, and validation.

The whole point is to get a process around it that works and gets the “ritual magic” out of it.

I labeled that as engineering.

bdangubic a day ago

everything you wrote is true (and much worse) when humans are "engineering" shit