Comment by drak0n1c
For those averse to LLM defeating the social aspect of tabletop roleplaying, perhaps a better entry role for an LLM agent is as NPC party companions/followers. Set up the agent with a detailed character sheet and hidden backstory/motivations and set it to listen in on conversations or VTT chat, and interject dialog on a non-spammy basis. Could lead to unusual situational ideas or at least humorous moments.
This is what our DM does. It works really well for NPCs and saves him a shit ton of time and effort.