The intelligent agent facility (IAF) incorporates a rule-based expert system for natural-language understanding, voice and text input facilities, a hierarchical clickable command list, an interface for multimodal devices such as menu-based wireless handheld devices and gesture recognition devices, and human-like avatars acting as virtual assistants.
There will obviously be advances in both hardware and software over the next two years, but there are three advances that are in development now that will completely change the world of personal devices and technology in general forever: augmented-reality products, smart-home devices and gesture interfaces.
In the second case study, immersive approach was used, namely Head-Mounted Device, tracking and gesture recognition systems, to test and improve ergonomics of the whole workplace.
"So many of us are now participating in fiction building, creating characters and narratives, it seems to me the art of storytelling is simply taking a new form, while we build new languages to pursue this most ancient of needs".. "Alongside these most recent storytelling devices and gestures we continue to share the book at bedtime, perform plays, make films, sit around the campfire and so on.
The rest of the device is all touchscreen and gesture based.
In the future, consumer mobile devices will routinely incorporate voice and gesture input, and as hardware features change, the AI algorithms will also evolve.
Jiawen Chen and David Kim, both of the Interactive 3D technologies team, showed off, respectively, KinEtre technology for animating scanned objects, and a wrist device for gesture control.
The interactive yarns can then wirelessly transmit touch and gesture data to mobile devices, connecting the textiles to apps, the Internet, and other electronic features. .
The thought, I presume, was that PC gamers and hackers would like a native device and an open platform for gesture-based game and OS controls.
