Comment by nemo1618

Comment by nemo1618 3 hours ago

6 replies

This strikes me as a very agent-friendly problem. Given a harness that enforces sufficiently-rigorous tests, I'm sure you could spin up an agent loop that methodically churns through these functions one by one, finishing in a few days.

AndyKelley an hour ago

hallucinations in a libc implementation would be especially bad

[removed] 3 hours ago
[deleted]
henning 3 hours ago

Have you ever used an LLM with Zig? It will generate syntactically invalid code. Zig breaks so often and LLMs have such an eternally old knowledge cutoff that they only know old ass broken versions.

The same goes for TLA+ and all the other obscure things people think would be great to use with LLMs, and they would, if there was as much training data as there was for JavaScript and Python.

  • ezekiel68 2 hours ago

    To be fair, this was true of early public LLMs with rust code too. As more public zig repositories (and blogs / docs / videos) come online, they will improve. I agree it's a mess currently.

  • Graziano_M 2 hours ago

    You must have not tried this with an LLM agent in the past few months.

    • ale an hour ago

      i tested sonnet 4.5 just last week on a zig codebase and it has to be instructed the std.ArrayList syntax every time.