Comment by bradfa
I feel that my highest productivity was the 4 years I spent on the same team working remotely but having many interactions per day with my coworkers and manager. I only physically was in-person with my team for 1 week during that 4 year span. But every day I was working WITH my teammates, interactively. My manager was open and honest about things and the company culture embraced discussing "What if we did X?" to debate how we could improve things and dream up new ideas.
Prior to that I worked in-person in offices doing similar types of engineering. I was never as productive there but I did see more sides of the business and I got to do more varied tasks. Having lunch or going for a short walk physically with teammates and non-teammates definitely spawns opportunities which otherwise don't naturally happen.
Now, I do consulting/contracting remotely. Often I'm working on weeks to months long contracts. All my customers are remote. It's very clear that my value is in short term results, to get the customer past their current problem. If any planning for the future is found, I recommend it, but unless the customer wants me to pursue it then the recommendation is all I give.
All 3 kinds of work have pros and cons. I do miss regularly having lunch with coworkers. I MUCH prefer my remote work commute, flexibility, and work/life balance.
Not to simplify too much, but I think it comes down to accountability and responsibility.
I've worked remotely with a team where everyone was very engaged, saw similar shared goals to work towards and everyone took accountability for doing work to reach that.
I've also worked remotely with people who basically barely noticed the work everyone else even did, nor cared, nor appreciated it. There was a sense of, let's just get any interactions over with and go back to our doing the minimum we can to not get fired.