This is awesome to see. I've been working on something similar: a remote Wayland compositor for the Oculus Quest, Magic Leap, and other AR/VR devices. Last night I hit a milestone, getting a terminal running on another machine to render inside Unity, then on the Magic Leap itself. https://twitter.com/daeken/status/1205762441285685248
I really believe that 2020 is going to be the year of VR/AR productivity, and I'm committing myself to working full-time from within the environment.
I love your enthusiasm so you got my upvote :) With that said, it's hard for me to see why some people are so bullish on VR/AR productivity. The headset seems heavy, taking it off-and-on is cumbersome, AR fidelity seems like it leaves a lot to be desired, etc.
My sister has a VR headset, and so does my cousin. I think it's a cool toy, but I'm not really sold... maybe you can convert me. After all, Christmas is just around the corner.
So, I've been working much of the time (30-50%) through the Quest, using ImmersedVR to have 3 screens from my Mac in VR. The headset is super comfortable, even for long periods of time; the only downside comfort-wise is that if I'm breathing out of my nose, it'll end up blowing upwards into my eyes, drying them out (but I'm going to be making a little buffer piece to fix that).
The fidelity is at the low end of what's usable for productivity without causing discomfort, but it's just going to get better from here. To me, $400 for the Quest is a total no-brainer; the Magic Leap .... not so much. I'd rather stick entirely to VR, but I have a kid to watch much of the time, so AR it is!
Ever increasing improvements are not guaranteed. My hope is it will improve too, and ideally be done with a lower carbon footprint. But it's still an unknown.
Ever-increasing improvements aren't required; the eye has a (more or less) fixed resolution. In fact, HMDs with extremely high resolutions already exist, e.g. the Varjo VR-2 Pro and the XR-1, they just cost an arm and a leg. In a few years we'll get them at consumer-level prices instead of having to drop $6-12k.
I really believe that 2020 is going to be the year of VR/AR productivity, and I'm committing myself to working full-time from within the environment.