Comment by jabl
It's going to be slower, as in lower throughput, due to more locking and scheduling overhead in the kernel. Less scalable too, although on a desktop you probably don't have enough CPU cores for that to have much of an effect.
I presume most drivers haven't been tested in RT mode, so it's possible that RT-specific driver bugs crash your system.