Symposium on Apps

Mixing Graphics and the Real World

Saturday, 01 December 16:15 - 18:00 |  Tourmaline 207

Mobile Mixed Reality Interface Developments

Mixed reality systems employ either augmented virtuality (AV) or augmented
reality (AR) techniques. In the mobile world, the former may be implemented
with 3D representations, and the latter by overlaying graphics on top
of a camera feed. These systems act as exocentric and egocentric
gateways to our environment, catering for alternate sets of tasks.
While an AR interface innately follows users gestures, a 3D interface
allows a rich, but possibly a cumbersome browsing experience. We
present developments toward integration of both interfaces in pursue
of the best possible combination for given spatial task.
Dr. Antti Nurminen, Helsinki Institute for Information Technology HIIT



GoldFish: Real-world GUI Framework for Android

We introduce the "GoldFish" framework for Android with which users can
easily develop "Real-World GUI" applications in JavaScript. A user
can write various RWGUI applications just by writing a JavaScript code
on the Web and defining the relation between the URL and the ID of an
NFC tag. If a user wants to implement a "slider" in the real world,
he can put an NFC tag on the wall, write a JS program which detects
the motion of an Android phone and control the value based on the
motion, and link the tag ID and the URL. With this settings, when a
user puts his Android phone on the tag, the phone detects the tag and
displays the URL based on the defined relations. Then the JavaScript
program on the page is invoked and used to detect the motion of the
Android phone and control data based on the motion. Using this
technique, any RFID tag in the real world can work as GUI gadgets like
sliders, menus, etc.
In this presentation, we'd like to describe the concept of RWGUI and
show how an off-the-shelf Android can be used as a GUI control device
if we use the GoldFish framework.
Toshiyuki Masui, Keio University