One of the advantages of the Vision Pro and Quest 3 over previous VR headsets is its ability to handle mixed reality. This is the blending of virtual objects into actual reality where cameras on the headset show your surroundings and place objects within it. So you’re not fully immersed in some virtual world; you’re still in your studio, where you can see all your synths, your computer and other gear. This means you can still see and play your physical piano while benefitting from overlayed software augmentation.
There are some specific mixed reality music apps which I’ll cover further down, but for the moment we’re talking about the viability of bringing desktop music apps into the mixed reality space. With both the Vision Pro and the Quest 3 you can run a desktop projection as a window. You can place and enlarge this window to be huge. So, rather than running off a laptop screen you can place a huge virtual screen of Logic Pro or Studio One or whatever DAW you’re using right on top of your piano, or along side your guitar amp, above your drum kit etc. You can do the same with virtual instruments, effects, and potentially clip launching in something like Ableton Live.
However, the virtual desktop in both cases doesn’t magically acquire a touchable, VR-compatible interface. So with the Vision Pro the eye and finger tracking doesn’t translate to the mouse movements you need to control your DAW, neither to the controls on the Quest 3 handheld controllers. But in mixed reality you can still see your mouse or trackpad and so it becomes a truly mixed experience.
The Vision Pro can run most existing iPad apps as flat applications within Vision OS. So there are lots of music apps you could be playing with that will also support the touch and pinch interface. The focus of this article, however, is on applications designed for 3D space. But in both cases, for Apple and Meta, there are 2D applications that can be accessed within the environment that offer something over the traditional screen.