Facial Performance Sensing Head-Mounted Display

Virtual Reality aims at creating a new digital world to be explored by a real user. Overcoming boundaries between Virtual Reality and real world, by mixing elements of these two worlds, will allow the user to enjoy a more realistic experience.

It is well known that virtual reality applications could be a valid and useful instrument both for work and entertainment. And in both of these fields, interaction among people could really affect the experience and the results achieved. Team work is often crucial to success. Online video-games found their success in interaction among human players. These are just two examples, but interaction among humans is still fundamental in every field of our society.

However, although fundamental, interaction among different users in a virtual reality application is still far from being natural. I would like to present to the class a new work developed by researchers of the Univeristy of Southern California. To advance virtual reality as a next-generation communication platform, they develop a novel tool that enables 3D facial performance-driven animation in real-time. I would like to talk about technical details of the hardware and software platforms, and about the possible applications of this new tool.

Reference: http://www.hao-li.com/publications/papers/siggraph2015FPSHMD.pdf