Interactive Prototyping with SAR

This project investigates how to use Spatial Augmented Reality (SAR) in the design process of creating a prototype for a device. A “blank” prototype is made and any complex components, such as buttons or dials, are projected directly onto the surface of the prototype.

The user is also able to interact with any of the components by tracking the position of the user’s fingers. This allows a user to press virtual buttons, move virtual sliders, and turn virtual dials.


A user interacting with virtual buttons.
A user interacting with projected buttons.


We are aiming to create a toolkit that will assist designers in the development of a prototype. For example, this could include adding different types of components such as dials or sliders, as well as being able to change the layout of the components. These features are still being developed.


A user changing the layout of several projected buttons.
A user changing the layout of several projected buttons.