JioGlass Controller

Controllers are representations of a physical controller. They are created by device managers and are responsible for communicating with the corresponding underlying system and translating that data.

Paradigms of Controller Based Interaction

Controller based interactions can be further categorised into three paradigms based on the input mechanism and the physics of focusing on objects and interacting

  • Abstracted​ The abstracted method of interaction is like using a mouse on a traditional 2D Graphical User Interface. Here the motion of the interaction tool (mouse) is in a different coordinate system than the action (mouse pointer)​

  • Ray​ The ray method utilizes the depth information in any Spatial User Interface to projected an extended control emitting from the interaction tool (mouse)​

  • Volumetric​ Volumetric method is the most natural form of interaction since it allows the user to directly manipulate the virtual objects in 3D just as if they were real objects.​

JioGlass Controller

Generally, a controller's lifecycle will involve:

  1. A controller gets created by a device manager upon detection of a new source (for example, the detects and starts tracking a hand).

  2. In the controller's Update() loop, it calls into its underlying API system.

  3. In the same update loop, it raises input event changes by calling directly into the core input system itself (for example, raising HandMeshUpdated, or HandJointsUpdated).

Interactions in Tesseract Mixed Reality​

Input Actions Key Bindings

Last updated