I think the keyboard in such setup needs a disruption, because it is the last piece which keeps us in the old world of typing machine on a table.
I am thinking about some kind of wearable keyboard, either attached to trousers on laps, or kind of gloves. But gloves usually have no tactile response.
The setup in the post plus a speech to text system and aidertmux and aider would be sufficient for a very wide range of tasks. Or a multi screen setup with the phone as a multimodal input system and the AR as the screen.
I agree and have experimented with related ideas. In a sibling comment thread.
https://news.ycombinator.com/item?id=43985513#44016985
https://kbd.news/Tackle-keyboard-2549.html
I want to try some version of this next. I’ve tried tap strap (overlaps with glove idea) and I currently use a retractable lap approach, where the keyboard folds out from chest to be used, it’s still too much friction and too awkward.
This Tackle keyboard approach is a bit obvious once you see it if one can be fully touch type without crossing middle then a split keyboard mounted on torso could work… perhaps … these things require actually trying I’ve found.
Why so physical?
Researchers ate already able to translate thoughts into text[1][2] by wearing a special cap with a fair amount of accuracy.
[1]: https://www.extremetech.com/science/new-cap-uses-ai-to-read-...
[2]: https://arxiv.org/abs/2309.14030