Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Teleimmersion Fazel Fakhrieh Overview • • • • • Introduction: what is teleimmersion? Teleimmiersion and the grid Application of teleimmersion Teleimmersion technologies Teleimmersion performance requirements Definitions of Teleimmersion • networked/distributed/collaborative virtual environments • “[teleimmersive applications] enable the interaction between geographically remote participants within a shared, threedimensional space.” – - Watsen & Zyda Definitions (cont) • “The term Tele-immersion was first used… as the title of a workshop … to bring together researchers in distributed computing, collaboration, virtual reality and networking” – - Jason Leigh Definitions (cont) • “[teleimmersion is] a broad multidisciplinary research area that includes all aspects of computer science, virtual reality, virtual worlds, teleoperation and telepresence. A variety of network elements are required to scale up virtual environments to arbitrary sizes, simultaneously connecting thousands of interacting players and all kinds of information objects” – - Brutzman, Macedonia & Zyda Definitions (cont) • “The ultimate synthesis of networking and media technologies” – - Smith & Weingarten Definitions (cont) • Merging Virtual Reality with Collaboration Technology -- Rick Stevens VR Haptics VR VR Haptics Haptics Definitions (cont) • a notion of some underlying virtual world • a visual (usually 3D) representation of the world, possibly augmented with audio and haptic representations • multiple participants in the world, aware of one another • interactions between participants, directed to some (possibly frivolous) end --Sam Taylor Virtual Reality Concept: immersing the user in a computer generated world that provides suspension of disbelief (i.e. transports the user into the world). – Immersive high-resolution real-time stereo graphics – Point of view rendering – High-quality (spatialized or surround) audio – Haptics (touch and force feedback) – Basis for creating shared work spaces VR Haptics Examples of Teleimmersion • scientific visualisation - big data, big compute • cooperative design - architects and CAD • education - distance learning, outreach • entertainment - multi-player games • military - training and simulation Teleimmersion and the grid • Symbiotic relationship • A key is bandwidth latency ,jitter of network • Integration of computer and data base • Judgment how far we are from pervasive use of teleimmersion Application of teleimmersion Teleimmersion application classes •• Interactive Interactivescientific scientificvisualization visualization •• Education, Education,training, training,and andscenario scenariosimulation simulation •• Art Artand andentertainment entertainment •• Industrial Industrialdesign, design,architectural, architectural,evaluation evaluation Teleimmersion application classes (cont) • Information visualization and data mining • Telecollaboration environments and human factors • Telepresence for exploration, construction, and recreation Tele-immersion case study Teleimmertion technologies •• Information visualization Projection based system and data mining • Telecollaboration environments and human ) – CAVE( Cave Automatic Virtual Environment factors – ImmerDesk • Telepresence – PowerWall for exploration, construction, recreation • and Monitor based system – Head-mounted displays( HMDs) – Binocular Omni-Orientation Monitors( BOOMs) Teleimmertion technologies (cont) personal Information infrastructure Individuals Desktop collaborative environment CAVE ImmersaDesk Work groups collaborations PowerWall Institutions Teleimmertion technologies (cont) • CAVE • Smaller VR devices CAVE • Multi-person, room-sized, high-resolution, 3D video and audio environment • Graphics are rear-projected in stereo onto three walls and the floor and are viewed with stereo glasses CAVE Capability • A user is presented with dynamically moving stereo full-color at multi-thousand-pixel horizontal resolution on the walls and floor. • The primary user’s position is tracked so that the correct perspective view is generated in real time • The primary user can navigate with variety of intuitive navigational devices currently under test and construction. • … Immersive Virtual Environment Audio Synthesizer Virtual Environment Generator Audio Localizer commands Speech Recognizer graphics Display Electronics eye position head position Head/Eye/Hand Tracking hand position Electronics Haptic/Tactile kinaesthetics system User Environment headmounted display or projection display system Teleimmersion performance requirements • Teleimmersion data flows • VR lag and communications performance • Performance requirement Teleimmersion data flow • • • • • • • • • Control Text Audio Video Tracking Data base Simulation Haptics Rendering Synchronization of events Tele-immersion management Type of flow in collaborative virtual reality Control Text Audio Video Tracking Database and Event Transactions Simulation Data Haptic Drivers Remote Rendering VR lag and communication performance • Caused by: Rendering, display, tracking, simulation, communication, synchronization • Communication’s latency source: – – – – – Transmission Bandwidth Switching or routing Contention Protocol • Asynchronous teleimmersion model Performance requirement • • • • Bandwidth requirement Latency Reliability Multicast Bandwidth requirements Type Latency Control < 30 ms Text < 100 ms Audio < 30 ms Video < 100 ms Tracking < 10 ms Database < 100 ms Simulation < 30 ms Haptic < 10 ms Rendering < 30 ms Bandwidth 64Kb/s 64Kb/s Nx128Kb/s Nx5Mb/s Nx128Kb/s > 1GB/s > 1GB/s > 1 Mb/s >1GB/s Reliable Yes Yes No No No Yes Mixed Mixed No Multicast Security Streaming DynQos No High No Low No Medium No Low Yes Medium Yes Medium Yes Low Yes Medium Yes Low Yes Medium Maybe Medium No High Maybe Medium Maybe High Maybe High Maybe High Maybe Low Maybe Medium Further reading For more information on the topics covered in this chapter, see www.mkp.com/grids also following references: • Kalawsky’s reference text on virtual environments is comprehensive • Two national research council reports discuss open research topics in environments and user interfaces • Burdea provides a comprehensive survey of haptics, and Minsky a wonderful haptices bibiography • Matlin and Foley survey human sensory and perception systems, from which many of the requirments of teleimmersive and virtual environment derive