Comment by tuckerman
I'm a huge proponent of e2e learning for robotics (worked at two places doing e2e before Tesla adopted it) and personally believe its the right approach long term. I also have FSD on my Model 3 and love it for L2+. That said, my experience with disengagements is very different than yours.. I have a few a week for things like road works, school zones, route map following. Perfectly fine for L2+, L4 it would be unacceptable.
If these robotaxis end up looking more like my experience than yours then another layer of trouble will be root causing and fixing failure modes. Training models e2e makes both of these much more difficult.
e2e is good, but why limit yourself to only cameras? e2e with cameras, radar, and lidar is going to perform better.