Gestural Interfaces: Are Wii having Fun in Physical Therapy?

Gestural interfaces were in their infancy not even a decade ago and they have really come a long way very recently.  About ten years ago when I was at NASA-GSFC, I attended a presentation by Joe Paradiso from MIT on his Gesture Wall.  I think Jeff Han’s presentation at TED in 2006 really grabbed some attention in terms of interacting with systems with a gestural interface.

The iPhone may have an abysmal battery life, but it is the first widespread consumer device to really have a gestural interface with its touchscreen.  Now the BlackBerry Storm and other phones are implementing the same kind of touchscreen technology. Like the iPhone and the iPod Touch, the Wii is a good example game system that uses a gestural interface.  I recently came across an innovative use for the Wii game system:

Nintendo Wii as Therapeutic Tool
Jon Udell’s Interviews with Innovators
20 minutes, 9.4mb, recorded 2008-12-15
Topics: Health and Medicine Science and Technology (general)

Although host Jon Udell isn’t an avid gamer, and neither is his wife Luann, he was intrigued when she came home from a physical therapy session raving about the Nintendo Wii. In this episode Luann talks about how the Wii, the Balance Board, and the Wii Fit application are helping her retrain the proprioceptors in her legs. Then we’ll hear from Anna Domyancic who, with Darren Gerber, runs Keene Physical Therapy and Sports Medicine. Like other physical therapists, they’re finding that the Wii can be a valuable therapeutic tool.

A number of research articles published in the past year show that the Wii game system has been used by many in physical therapy. Some are calling the use of this system in physical therapy ‘wiihabilitation’.

From having my own Wii and just using it out of the box, it’s amazing how sensitive the controllers are and the haptic feedback that some of the games provide to the game controllers.  It’s also amazing how immersive the games can be with having the Wii hooked up to an LCD projector when playing Metroid.

O’Reilly just published a new book on Designing Gestural Interfaces:

Designing Gestural Interfaces, 1st Edition
by Dan Saffer
Publisher: O’Reilly Media, Inc.
Pub Date: December 3, 2008
Print ISBN-13: 978-0-596-51839-4
Pages: 272

Designing Gestural Interfaces provides you with essential information about kinesiology, sensors, ergonomics, physical computing, touchscreen technology, and new interface patterns — all you need to know to augment your existing skills in “traditional” web design, software, or product development. Packed with informative illustrations and photos, this book helps you: Get an overview of technologies surrounding touchscreens and interactive environments. Learn the process of designing gestural interfaces, from documentation to prototyping to communicating to the audience what the product does Examine current patterns and trends in touchscreen and gestural design Learn about the techniques used by practicing designers and developers today See how other designers have solved interface challenges in the past Look at future trends in this rapidly evolving field.

In the movie Minority Report, it seems that gestural interfaces are science fiction.  However, science fiction has quickly become science fact with technological innovations and a number of social and market forces at play.  Going from conventional keyboard and mouse to gestural and interactive environments., there are so many future possibilities in terms of how we design and develop these new interfaces.

Word Up for Wordle.net

Old-school Librarians will recall those dusty reference tomes called concordances.  Such works were handy for providing a list of words used in a body of work, with their immediate contexts and frequencies of occurrence within a particular work or set of works such as one or more Shakespeare plays.

Of course, concordances are generally about as visually appealing as a phonebook (white pages…not that the yellow pages are all that great) and don’t lend a great deal of insight at a glance.  However, many new applications provide visualization with interpretive appeal.

Wordle (Wordle.net) is a toy for generating “word clouds” from text that you provide. The clouds give greater prominence to words that appear more frequently in the source text. You can tweak your clouds with different fonts, layouts, and color schemes. The images you create with Wordle are yours to use however you like. You can print them out, or save them to the Wordle gallery to share with your friends.

Word or tag clouds are certainly not a new invention in a Web2.0 world, but this application deserves extra points for the degree of customization that’s provided for the visualization.  Also, you can do a visualization from several sources — from raw text that you copy and paste into a form on the Wordle site, to submitting a URL for a Web page, to submitting a del.icio.us username.

Unfortunately, there’s no direct link (or drill down) between the word cloud and the text that you provide (like a hyperlink between your tags in del.icio.us and the related sites indexed with that tag), but again this is more of a visualization than a true concordance.  However, from marketing your words to gaining a greater introspection to the words in your text, Wordle is worth a look.

One feature, though, that’s particularly lacking with Wordle is a way to save or output the file as something useful such as an image file.  It’s easy enough to print to PDF and there’s lots of options for changing font type, colour scheme, and layout, but ScreenGrab! (an extension for Firefox) didn’t seem to catch anything from the Wordle Web page or the Wordle Java Applet that was opened (just a blank page).  There’s probably some way to grab the image with some screen capture version, but Wordle doesn’t make this feature readily available with the site.

You can save your Wordle visualization to the Gallery on the Wordle site, though, and embed it on your site (such as the one made below on August 6th, 2008 with my del.icio.us bookmarks):

Follow

Get every new post delivered to your Inbox.