X-Plane 4 min read

How do I use VR hand tracking in X-Plane 12?

Ian Stephens
In short

Learn how VR hand tracking works in X-Plane 12, set up motion controllers, understand bare-hand limits, and fix unresponsive cockpit controls.

X-Plane 12 does not natively use controller-free optical hand tracking for cockpit input. Its virtual hands are normally driven by tracked VR motion controllers. Pair those controllers in your PC-VR runtime, enable VR in X-Plane, and use their trigger or grip controls. Bare-hand tracking requires a third-party bridge that emulates motion controllers.

Does X-Plane 12 support bare-hand tracking?

Not directly: X-Plane 12 expects VR controller actions rather than raw skeletal hand-tracking data. Enabling hand tracking inside a standalone headset does not automatically pass usable hand input to the PC version of X-Plane.

A third-party bridge may translate pinch and grab gestures into trigger and grip actions. Compatibility depends on the headset, active PC-VR runtime and translation software; there is no guarantee that every gesture or aircraft control will work. Bare hands also provide no physical buttons or haptic feedback. Our comparison of headset tracking and PCVR controller compatibility explains the hardware differences that matter here.

How do I set up tracked hands with VR controllers?

The reliable method is to use the headset's tracked motion controllers, which X-Plane displays as virtual hands.

  1. Complete the basic VR setup. Connect the headset, start its PC-VR runtime and confirm that both controllers track correctly before opening X-Plane. Follow our full X-Plane 12 headset and controller setup steps if VR itself is not yet working.
  2. Enable VR hardware. Open X-Plane 12's VR Hardware settings and enable VR. Wake both controllers if they have entered standby.
  3. Re-centre the cockpit. Sit in your normal flying position and use the VR recenter command. Correct alignment matters because switches can otherwise appear within reach while their interaction points are not.
  4. Test a default aircraft. Point a virtual hand at a switch, knob or lever and use the controller's trigger or grip action. Some controls respond to a direct grab; others use a pointer or drag-style manipulator.
  5. Keep the VR mouse available. Enable the VR mouse cursor as a fallback for small controls, touchscreens and third-party cockpits whose manipulators do not behave well with controllers.

How do I connect controller-free hands through a bridge?

Bare hands work only when the bridge presents them to X-Plane as recognised controller poses and actions.

  1. Verify hand tracking first. Both hands must track reliably in the headset's PC-VR environment, not only in its standalone home interface.
  2. Use one VR runtime path. Configure the bridge for the same runtime used by X-Plane. Mixing competing OpenXR or SteamVR translation layers commonly produces missing or duplicated input.
  3. Assign deliberate gestures. Pinch is normally mapped to trigger, while grab is mapped to grip. Reserve menu and recenter actions for gestures that will not fire while operating the yoke.
  4. Start components in order. Start the headset runtime, then the hand-tracking bridge, then X-Plane. Confirm that the bridge exposes two virtual controllers before troubleshooting the simulator.
  5. Test simple switches first. Use a default aircraft and a large toggle or rotary control. A bridge cannot make a cockpit manipulator VR-compatible if the aircraft itself does not provide one.

Why are my hands visible but the cockpit controls do not work?

Visible hands with unresponsive controls usually indicate an input-action or aircraft-manipulator problem rather than failed tracking.

  • Test a default aircraft: if its controls work, the third-party aircraft probably uses custom manipulators or plugin-driven controls that do not accept VR interaction.
  • Check the interaction point: the clickable area may not match the visible switch exactly. Try the controller pointer as well as direct grabbing.
  • Wake the real or emulated controller: a sleeping controller or suspended hand-tracking bridge may leave a frozen hand model in the cockpit.
  • Remove duplicate inputs: disable any second bridge or controller-emulation layer that is sending the same trigger and grip actions.
  • Re-centre after changing seats: an incorrect room origin or floor height can offset the virtual hands from their interaction points.
  • Stabilise tracking and frame rate: judder, reprojection and camera tracking loss make precise pinching or grabbing unreliable. Use our VR judder and tracking-stability fixes when the hands shake or drift.

Should I use hand tracking, controllers or physical controls?

Motion controllers are the best-supported option for virtual cockpit interaction, while physical controls remain better for flying the aircraft.

Input methodBest useMain limitation
Tracked motion controllersSwitches, knobs, levers and direct cockpit interactionNo physical resistance; awkward for sustained yoke or throttle use
Optical bare-hand trackingExperimental switch and knob operationRequires a bridge, lacks haptics and may misread gestures
VR mouseSmall controls and incompatible manipulatorsLess natural and requires a mouse surface or controller pointer
Physical yoke, pedals and throttlePrimary flight controls and precise handlingCannot operate every virtual cockpit control by itself

A practical arrangement is a physical yoke or stick, throttle and pedals for flying, with motion controllers or the VR mouse for cockpit switches. Controller-free hand tracking is usable for experimentation, but it is not a direct replacement for X-Plane 12's supported motion-controller input.

AI Assistant New

Still stuck? Ask Fly Away

Ask Fly Away is our AI flight-sim assistant. Ask your exact question and get a direct, step-by-step answer in seconds — free to try.

Ask Fly Away Free preview · unlimited for PRO members