xg15 5 hours ago

Doesn't it do exactly that?

> As a consequence of 1 and 5, we only add a property to an object once we have the entire key and enough of the value to know that value's type.

Reply View 2 replies
  • 0x6c6f6c an hour ago

    Their example in the README is extremely misleading then. It indicates your stream output is

    name: A name: Al name: Ale name: Alex

    Which would suggest you are getting unfinished strings out in the stream.

    Reply View 1 reply
    • __jonas 3 minutes ago

      How is it misleading? It shows that it gives back unfinished values but finished keys.

      Reply View 0 replies
rictic 7 hours ago

Cumulative is a good term too. I come from the browser world where it's typically called incremental parsing, e.g. when web browsers parse and render HTML as it streams in over the wire. I was doing the same thing with JSON from LLMs.

Reply View 0 replies
simonw 8 hours ago

If you're building a UI that renders output from a streaming LLM you might get back something which looks like this:

  {"role": "assistant", "text": "Here's that Python code you aske
Incomplete parsing with incomplete strings is still useful in order to render that to your end user while it's still streaming in.
Reply View 5 replies
  • trevor-e 6 hours ago

    In this example the value is incomplete, not the key.

    Reply View 0 replies
  • cozzyd 7 hours ago

    incomplete strings could be fun in certain cases

    {"cleanup_cmd":"rm -rf /home/foo/.tmp" }

    Reply View 3 replies
    • stronglikedan 6 hours ago

      If any part of that value actually made it, unchecked, to execution, then you have bigger problems than partial JSON keys/values.

      Reply View 0 replies
    • rictic 7 hours ago

      Yeah, another fun one is string enums. Could tread "DeleteIfEmpty" as "Delete".

      Reply View 1 reply
      • Waterluvian 7 hours ago

        I imagine if you reason about incomplete strings as a sort of “unparsed data” where you might store or transport or render it raw (like a string version of printing response.data instead of response.json()), but not act on it (compare, concat, etc), it’s a reasonably safe model?

        I’m imagining it in my mental model as being typed “unknown”. Anything that prevents accidental use as if it were a whole string… I imagine a more complex type with an “isComplete” flag of sorts would be more powerful but a bit of a blunderbuss.

        Reply View 0 replies