It just doesn't happen, and chatting over VC isn't the same as meeting people in real life anyway. In the office, I'll randomly bump into people I've known from years back and have small chats, but I never in a million years would have specifically scheduled to do so (sometimes I don't even remember their names, just what they look like!).
This wouldn't work for me because I don't listen to anything when I'm working. You're making the assumption that everyone is just constantly listening to music, but I focus best with silence and with my ears unencumbered. I suppose it would be doable with desktop speakers that would only play something when remotely triggered, but then there's the secondary issue that I'm not always at my desk, vs in the office people can obviously see who's there and who's listening in (and easily go grab someone else to join in as necessary). There's just way less friction to conversations when people are in the same room.
The office broadcast conversations can be a mali and boni. Sometimes you get updated by a background conversation- sometimes you get distracted by a conversation. It would be great if you could auto-flag a conversation you have on teams as relevant for others or not - and it would just start playing merged into the music of others remote, one way.