Comment by yreg
What GP describes sounds to me like having a friend control the computer and dictate to them what to do.
No matter how capable the friend it, it's oftentimes easier to do a task directly in a UI rather than to have to verbalize it to someone else.