The History of AR/VR
Virtual Reality is a widespread term that is often misused. This blog will address these errors and explain the categorization of (AR/VR/MR) otherwise known as extended reality (XR).
The ‘X’ in XR does not stand for Extended, but rather is a variable, meaning it can be interchanged. The types of Extended reality include augmented reality, mixed reality, and virtual reality of course.
The Etymology of ‘Virtual’
As the most known term, we will begin with Virtual Reality. The word ‘virtual’ has changed over the centuries.
Stemming from the Latin word virtus, then virtualis, virtual in the 15th century meant “being something in essence or effect, though not actually or in fact” then in 1959 the meaning changed in common use to the computer sense of “not physically existing but made to appear by software”.
VR is a fully immersive experience composed entirely of computer-generated environments and objects or 360o videos. So, what this means is, the term ‘virtual reality’ can only be applied to programs that completely change the environment around the user.
To explain, Virtual reality is created by using sensory stimulators to trick the user’s brain into believing they are in a separate reality. This can be accomplished by using headsets known as head-mounted displays (HMD).
The HMD has small OLED or LCD monitors in front of the eyes for rendering stereoscopic graphics and binaural audio systems. And so, this technology allows the user to see a 3D view and hear with depth and directionality.
The HMD also obtains positional and rotational real-time head tracking for 6 degrees of freedom (DOF), allowing the user to turn their head to look around in the virtual world.
Some VR even has motion controls to allow for movement within the world. Motion controls can be used with handheld controllers like Oculus, but more immersive systems have omnidirectional treadmills with waist supports. This lets users walk or run in real life as well as the virtual world without falling or getting tangled from discombobulation.
From virtual reality, we will move on to augmented reality. Augmented reality is different in that it is not a completely immersive, virtual experience. It is the merging of the real and virtual worlds with additive or destructive overlaid sensory.
The purpose is to enhance or alter the real world rather than replace it like virtual reality. Virtual objects or displays lay over the real world with positional tracking, typically through a set of smart glasses, goggles, monocles, or HMD.
Augmented reality lets its user see the real world with an enhanced display for information needed without looking away. This technology is especially useful for military and medical purposes as both require much focus and information in high-stress, timely scenarios.
A great example of augmented reality in the military is the Apache monocle, a head display unit like the HMD, which allows for infrared sight and tracking. Alternatively, Augmented Virtuality is the addition of real-world objects to a virtual environment.
Mixed reality, in a sense, is a spectrum between VR and the real world. As Milgram and Kishino put it, Mixed reality is anywhere between the extrema of the virtual continuum. This includes AR and AV. Similar to augmented, mixed reality is a merging of the real and virtual worlds. However, with mixed reality, the virtual world can integrate with the real world to allow interactions between the two.
To clarify, mixed reality is different than AR in that MR has occlusion and integration with AV. Occlusion lets virtual objects be obscured by real objects. This makes the user feel as if the virtual environment is immersed in the real world rather than feeling immersed in a virtual world like VR.
Mixed reality has many practical uses, one of them being interactive product content management (IPCM). IPCM is used to allow customers to view furniture, paint, and other products in their homes or workspace virtually before they buy.
Other uses of MR include artistic expression, studies in AI, digitized human consciousness, and of course, military and medical training. Another major use is in the MR subbranch, Augmented Virtuality (AV). AV integrates real-world objects in a virtual space. Green screen and video chat backgrounds are great examples of AV. This technology was especially important in 2020 because it supported and improved remote working during the COVID-19 pandemic.
History of XR – Timeline
Details and Sources
- Sir Charles Wheatstone describes stereopsis and binocular vision
- Wheatstone invents the first stereoscope
- Sci-fi filmmaker, Stanley Weinbaum makes Pygmalion’s Spectacles. A story involving a set of VR goggles.
- Sensorama is invented
- Morton Heilig, filmmaker and inventer
- Feeling of a 3D immersive world
- Heilig invents the first HMD called the Telesphere Mask
- Thomas Furness begins work on instrumentation and visual displays for USAF cockpits
- Comeau and Bryan, Philco Corp engineers, invent 1st HMD with head tracking for remotely looking at hazards for the military.
- Ivan Sutherland invented 1st VR HMD
- Founder of Sketchpad
- CAD’s predecessor
- “The ultimate Display”
- Sword of Damocles
- Stereoscopic Display with overlayed wireframed 3D shapes that changed perspective to the movement
- Birth of AR
- Sutherland, I. E. (1965). “The Ultimate Display“. Proceedings of IFIP 65, vol 2, pp. 506-508
- Myron Kruger Creates Glowflow
- General Electric (GE) builds a computerized flight sim with 180o field of view
- Myron Kreuger’s VIDEOPLACE, the 1st interactive VR platform with no HMD or gloves was invented
- Aspen movie map
- MIT and DARPA
- Street view with VR
- Slideshow of photos from a 1st person view in the car
- Needed several laserdiscs, a computer, and a touch screen display
- McDonnell-Douglas Corp integrates VR into HMD called the VITAL helmet for military use
- StereoGraphics invent Stereo Vision Glasses
- Sandin and Defani invent Sayre gloves.
- The first wired gloves for monitored hand movements.
- Myron Kreuger releases his book, Artificial Reality.
- Myron Krueger. Artificial Reality, Addison-Wesley, 1983.
- Jaron Lanier and Thomas Zimmerman founded VPL Research, Inc.
- 1st to sell VR goggles and gloves
- Thomas Furness develops the Super Cockpit
- 1st flight sim w computer-generated 3D maps
- Included infrared, radar, and avionic data.
- Way ahead of its time
- Scott Foster and Crystal River Engineering develop real-time binaural 3D audio processing
- John Lanier Coins Virtual Reality
- Jonathan Waldern presents Virtuality, the first VR arcade game, at the Computer Graphics 90 exhibition in London, England.
- Tom Caudell coins Augmented Reality
- Sega attempts to release the 1st launch of a public consumer VR headset
- Louis Rosenburg, at Armstrong Laboratories USAF, invents Virtual Fixture for the 1st immersive mixed reality system
- Paul Milgram and Fumio Kishino define Mixed reality as anywhere between the extrema of the virtual continuum (VC)
- Georgia Tech and Emory U. create VR war zones for PTSD therapy
- Robert Abascal Founded AVT Simulation
- SAS Cube
- The 1st PC-based cubic room invented by Z-A Production
- It led to Virtools VR pack
- Google invents street view. A virtual map allowing anyone to virtual travel anywhere in the world Google has recorded.
- Google adds the stereoscopic 3D street view on April 1st. The advanced technology being release on April Fools Day led many to believe it was a hoax
- 18-year-old entrepreneur, Palmer Luckey, creates the Oculus Rift prototype which is the first AR with a 90o field of view
- Thanks to the development of technology VR is widely accessible to the world at cheaper costs.
P. Milgram and A. F. Kishino (1994). “Taxonomy of Mixed Reality Visual Displays”. IEICE Transactions on Information and Systems. pp. 1321–1329. Retrieved 2013-10-17
Want to learn about simulators? Check our Simulation Training Course here: https://trainingcenter.avtsim.com/
Learn more about how AVT Simulation helps change the simulation training industry here: https://avtsim.com/products-and-services/
Initially, Applied Visual Technology Inc., AVT has been developing modeling and simulation expertise through engineering services since 1998. This is due to our founder who has accumulated over 30 years of military MS&T expertise in aviation applications. Nonetheless, everyone at AVT specializes in making old training systems new again and making new ones for less. Consequently, for 20 years AVT has served our Air Force, Army, Navy, and Marine customers by providing the highest quality of service and solutions. Following its inception, AVT’s highly specialized staff of engineers has included some of the top leaders in the simulation industry. With over 20 years of simulation experience, our dedicated team provides specialized solutions for customers with complex problems.