Augmented Environments are physical spaces where people can work and learn, collectively or individually, by using day-to-day tools such as pen and paper, or other quotidian objects.
This affordable and extensible system augments the user’s capabilities without being invasive, recognising their natural language and humane behaviours.
We present a physical space for people to work and collaborate, where the computer’s job is to augment our capabilities.
This application showcases a fundamental property of computers as a meta-medium for human learning: simulation of other mediums.
Our Augmented Desk aims to leverage the power of computation using natural language and our own bodies.
Augmented desk users directly manipulate physical objects as part of the interface, this is a key feature for the interaction model, as it theoretically allows for computationally-enabled embodied knowledge.
Hand-written text is understood and interpreted using deep learning techniques.
This capability boosts the flexibility of the system, since users can communicate with machines using their own language, and the work of the machine is to understand and interpret it, not the other way around.
One key aspect is the possibility of modifying a tabula rasa system (a clean, extensible projected surface) by means of QR codes, without having to touch the underlying system.
Thanks to the advances in computation and computer vision, the team is able to build a fast and accuracte object-recognition model for our system.
Objects surrounding us can easily become part of the computational environment.
Multiple Object Cohabitation
Multiple objects (or text) can simultaneously co-exist without interfering the attached behaviours or applications.
Computers should be able to augment our capabilities while we, as users, inhabit the physical world and cooperate with other humans.
We used modern manufacturing techniques like 3D printing and low-cost computing platforms.
The prototype is also equipped with commodity camera and projector.