Comment by WillNickols

The conversation itself is sent to the LLM in regular text, and in addition it sees the feature tree (also text) and often a screenshot of whatever the current model looks like. This is usually enough for the model to know what's going on.

Yes - we're likely looking into other 3D systems in the future.