Comment by wrsh07

Clean RL is a great library if you're looking to get started doing some deep reinforcement learning! That plus gymnasium are pretty standard.

It's good for the world if we keep publishing improvements and optimizations to understandable primitives.

I am curious why not contribute back upstream, though.