VRHow / VR History / The evolution of VR controllers

The evolution of VR controllers

Short answer: VR input moved from instrumented gloves and tracked props, to remotes that mainly sensed rotation, to handheld controllers whose position and orientation are tracked in six degrees of freedom (6DoF). Modern headsets can also infer bare-hand pose with cameras. Those are overlapping branches—not a single invention—with “first” depending on whether the claim means first research glove, first commercial glove, first consumer 3DoF remote or first widely sold 6DoF system. Last checked October 11, 2026.

What changed: 3DoF versus 6DoF

Three degrees of freedom (3DoF) describes rotation—roll, pitch and yaw—without an independently measured location. A 3DoF remote can point or detect a gesture, but it does not continuously know where the handle is translating in the room. Google’s archived Daydream documentation explicitly calls its bundled controller “3DoF.” Google’s Daydream View documentation supports that classification.

Six degrees of freedom adds translation—movement along X, Y and Z—to rotation. A 6DoF controller therefore needs a spatial reference: external optical beacons, an inside-out camera system, or another tracker. The distinction is about the tracked state, not whether a device has buttons, vibration or a visible ring.

1970s–1980s: gloves and props turn gestures into data

The Sayre Glove, developed by Richard Sayre, Daniel Sandin and Thomas DeFanti in 1976 and documented by the University of Illinois Electronic Visualization Laboratory in 1977, is a strong early milestone for a wired data glove. Flexible light-conductive tubes and photocells measured finger flexion; it was used with the GRASS system and mainly controlled sliders. It was not a modern tracked hand: the cited account describes finger bend sensing, not a complete 6DoF palm pose. EVL’s Sayre Glove record is the basis for the date and mechanism.

The VPL DataGlove brought the glove idea to market in 1987. Britannica describes it as one of the first commercial VR products and says it translated hand and finger movement into actions in a simulated environment; its contemporary visibility included the October 1987 Scientific American cover. That makes “first VR glove” ambiguous: EVL calls Sayre the first wired data glove, while VPL is an early commercial product. Neither wording proves that it was the first glove-like input device in every research or industrial context. Britannica’s VPL DataGlove entry and EVL’s account show why the claims should be kept separate.

Early VR also used tracked physical objects as input: a wand, stylus or other prop could stand in for a virtual tool. The important design pattern was not a particular consumer product but the coupling of a real object to a tracked coordinate system. Because historical systems mixed finger sensors, buttons and different position trackers, it is safer to describe them by what they measured than to label one universal “first VR controller.”

2006–2016: motion remotes and the 3DoF interlude

Nintendo’s Wii Remote made motion input familiar to a mass audience when the Wii launched in 2006. Its accelerometer sensed motion, while its infrared camera could measure the image displacement of the sensor-bar LEDs; an Oberlin physics demonstration documents those two sensors directly. That is useful motion input, but it is not equivalent to a headset-tracked 6DoF VR controller: acceleration and pointing can estimate gestures and direction without maintaining a full room-relative pose. Oberlin’s Wii Remote instrument page documents the sensor behavior, and Nintendo’s 2006 launch details record the Wii launch timing.

Google’s Daydream View, released to stores on November 10, 2016, represents the smartphone-VR 3DoF branch. Google described the included controller as combining a simple interface with 3DoF functionality. It could point and register orientation-based gestures while the phone handled head tracking, but it did not provide the room-relative controller position associated with later 6DoF systems. Google’s launch announcement supplies the date; Google’s archived product documentation supplies the 3DoF description.

2016: tracked 6DoF controllers become a consumer VR standard

The HTC Vive Pre shown at CES in January 2016 paired redesigned handheld controllers with redesigned base stations. HTC’s account describes controller triggers, haptics and the base stations’ improved tracking; the commercial Vive then made that lighthouse-tracked controller pattern visible to consumers. This was an external-reference design: the room’s base stations established the tracking frame rather than the controller estimating its position from orientation alone. HTC’s CES 2016 recap is the primary source for the documented prototype-era system.

Oculus Touch launched on December 6, 2016. Oculus described precise tracking, hand poses, gestures and “hand presence,” but its launch post does not call it the first 6DoF controller. That restraint matters: Vive Pre/Vive and other research and development systems overlap in date, and “first” can mean first announced, first shipped, first bundled, or first to popularize the format. The defensible statement is that 2016 was the consumer turning point in which independently tracked handheld VR controllers became a mainstream interaction model. Oculus/Meta’s launch record verifies Touch’s date and its tracked interaction features.

2019 onward: cameras recognize the hands themselves

In September 2019, Oculus announced hand tracking for Quest, planned as an early-2020 consumer feature. The system used Quest’s existing monochrome cameras and deep learning to estimate hand shape and produce 3D points for finger movement, with no controllers, external sensors, gloves or PC required. This is a different input category from a glove: the user’s skin is uninstrumented, and computer vision infers pose from images. Meta’s technical announcement documents the method and timing, while the OC6 announcement records the no-controller product promise.

Questions worth asking about “the first”

Was the Sayre Glove the first VR controller?

It is a well-supported “first wired data glove” claim in EVL’s own historical record, but that is narrower than “first VR controller.” It measured finger flexion and predates the commercial VPL DataGlove; it did not establish a universal definition for every tracked prop or glove.

Was Oculus Touch the first 6DoF VR controller?

Not as a blanket claim. HTC’s Vive Pre documentation already describes tracked controllers and tracking base stations in January 2016, while Touch shipped in December. “First” needs a stated boundary such as first consumer shipment, first inside-out design, or first widely adopted system; the sources here do not establish a single uncontested winner.

Did hand tracking replace controllers?

No. It removed the need for a physical controller in supported experiences, but controllers still provide tactile buttons, a grip and reliable input when hands are occluded or a task benefits from physical feedback. The historical change is an added input path, not a clean replacement.