Toward Perceptual Computing: Vision-based Human Computer Interaction

With the ubiquity of powerful, mobile computers andrapid advances in sensing and robot technologies,there exists a great potential for creating advanced,perceptual computing environments. In this work, weinvestigate techniques for integrating passive,vision-based sensing into such environments, whichinclude both conventional interfaces and large-scaleenvironments. We discuss a methodology forvision-based human-computer interaction called theVisual Interaction Cues (VICs) paradigm. In theVICs paradigm, users interact with the computersystem through natural hand gestures. We capture alanguage of interaction" in which individualgestures are the words and sequences of gestures arethe sentences. We give examples of both individualgestures and the gesture language and present themon our next-generation interaction platform the 4DTouchpad. Ultimately our work takes a concrete steptoward perceptual user interfaces."