The headset has to keep track of your head motions to decide what is supposed to be rendered at any given time, on top of keeping track of what your character is doing in-game. It basically needs to keep track of both real world objects and game objects simultaneously, which requires way more number-crunching than just processing inputs and displaying the reaults to a static screen.
Latest Answers