Algorithms for Accurate, Realtime Stereo Computation for 3D Tele-Immersion

University of California System: University of California, Berkeley
posted on 05/23/2010

• request more info 
•   
•  LICENSE ONLINE

Tele-immersion technology has great potential in a broad range of applications. However, much of this potential can’t be realized till accurate realtime creation of 3D content can be achieved. To address this performance challenge, UC Berkeley researchers have developed a multi-camera system and corresponding software algorithms that enable highly accurate (on the order of a centimeter), realtime (under 30 ms) 3D reconstruction of an environment that allows for remote interaction between users.  In contrast to existing alternatives, the Berkeley approach with scalable matching and global optimization is not only fast and accurate, it also doesn’t have restrictions in the observed scene and it can be implemented on modern desktop computers. 

The Berkeley approach can be used to generate realtime 3D content for a variety of use including, next generation gaming, virtual realities, and 3D teleconferencing. More specific applications include remote training, teaching, scientific collaboration, and healthcare interactions. 

• Realtime, accuracte computation;
• No restrictions on the observed scene;
• Can be implemented on modern desktop computers (specialized hardware isn’t required);