Possibly of interest: a project from the Mixed Reality Lab at Keio University. From this description, we could probably replicate it--though I don't know if we would want to. :-)
See their web page for an explanation:
http://ringu.mixedrealitylab.org/