Play "GO" game with a remote opponent in an augmented 3D environment
Aims: demonstrate the featured capabilities of the HMPD technology such as: augmentation and registration, occlusion, and remote collaboration.
Setup:
As
illustrated in the following Figure , through an HMPD, a computer-generated 3D “GO” board
is projected onto a tabletop retro-reflective screen. The local player,
wearing the HMPD, perceives the virtual board as if it was a real object on the
tabletop and manipulates his real stone pieces on the virtual board. A vision-based tracking setup detects the locations of his pieces on the
virtual board and transmits this information via network to the remote player.
The remote player uses a PC-based game interface
in which all game components are visualized on a PC monitor and stone
manipulation is achieved via a standard mouse. When the remote player adds a
piece to his board, a corresponding computer-generated piece is projected
onto the HMPD user’s virtual board. Therefore,
the HMPD player perceives the virtual board, his own real pieces, which
correctly occlude the virtual board, and the virtual pieces of his remote player
in a seamless augmented environment. A
head tracking system is used to maintain the correct registration of the real
and virtual elements. 
Result: The virtual and direct views of both players are shown in the following figures. With the “GO” game simulation, we implemented the capabilities of augmentation, registration, and occlusion of real/virtual objects, as well as interaction and remote collaboration with a remote participant using HMPD technology. Eventually, the remote player can have a similar 3D interface as the player if visualization facilities are available at his/her site, or video-streamed 3D visualization is transported to him/her through networking once acquisition and streaming components are equipped.
Publications:
1. J. P. Rolland, H. Hua, C. Gao, and F. Biocca. "Innovative displays for augmented reality applications and remote collaborations", Medicine Meets Virtual Reality (MMVR), Newport Beach, CA January 27, 2001.
2. Hong Hua, Leonard D. Brown, Chunyu Gao, Narendra Ahuja, Jannick Rolland, Frank Biocca. "A head-mounted projective display and its applications in interactive augmented environments," in SIGGRAPH 2001 Conference Abstracts and Applications--Sketches & Applications, Aug. 12-17th, 2001, Los Angeles
3. Hong Hua, Chunyu Gao, ,Leonard D. Brown, Narendra Ahuja, and Jannick P. Rolland , "Using a Head-Mounted Projective Displays in Interactive Augmented Environments," Proceedings of IEEE International Symposium on Augmented Reality 2001, In press.