How many ways can you use Google Earth?

What can Google Earth tell us about interface navigation design? Today, I’ve covered several basic navigational methods within Google Earth. It is a free software that allows you explore the earth and view satellite images, maps, terrain, etc of just about anywhere in the world.  Google Earth is available for PC/Mac and iPhone/iPod Touch. I will also be reviewing Google Earth using a Wiimote and two different GlovePIE scripts.

There are four basic navigational controls in Google Earth:

(Note: Pitch is tilting the Wiimote up/down. Roll is tilting the Wiimote left/right. IR refers to the Wiimote’s infrared motion sensing capabilities, i.e. pointing on an xy plane.)

Zoom

Slider on right (mouse click)
Scroll wheel up/down (mouse)
Right click up/down (mouse)
Ctrl+Shift+Up/Down (keyboard)
=/- (keyboard)

Pinch (iPod gesture)
Double tap (iPod gesture)

+/- buttons (Wiimote)
B+IR (Wiimote)

Pan

Hand wheel (mouse click)
Drag (mouse)
WASD (keyboard)

Up, Down, Left, Right (keyboard)
Drag (iPod gesture)
Pitch/Roll (Wiimote)
A+IR (Wiimote) 

Tilt

Up/down on eye wheel (mouse click)
Ctrl+Drag up/down (keyboard/mouse)
Shift+Drag up/down [centered] (keyboard/mouse)
Ctrl+Up/down (keyboard)
Shift+Up/down [centered] (keyboard)

Tilt up (iPod gesture)
B+Pitch (Wiimote)

Rotate

Round slider (mouse drag)
Left/right on eye wheel (mouse click)
Right click left/right (mouse)
Ctrl+Drag left/right (keyboard/mouse)
Shift+Drag left/right [centered] (keyboard/mouse)
Ctrl+Left/right (keyboard)
Shift+Left/right [centered] (keyboard)

2-finger rotate (iPod gesture)
B+Roll (Wiimote)
A+B+IR (Wiimote)

It’s quite interesting to note that the Wiimote, as a tangible user interface and game controller, is used similarly to keyboard and mouse gestures. The buttons act as a keyboard replacement, and the Wiimote’s IR capabilities are used for pointing as in a mouse. However, when relying on the Wiimote’s accelerometers (pitch/roll), the functions are more gesture-based, i.e. rotating and tilting the Wiimote to create similar functions on the screen.

If there are buttons or keys involved (keyboard/mouse, Wiimote), they will inevitably be used in interface navigation. The iPod Touch, which features mainly a touch-screen interface, uses intuitive finger gestures for navigation. These devices are designed for a purpose with a specific type of interaction in mind, and the Wiimote’s is gaming-related. For example, in a bowling game, a computer’s interface might involve clicking and dragging to roll the ball, the iPod Touch would require a “rolling” gesture with the device as if one was throwing it as a bowling ball (ex. iBowl), and a Wii game would involve a similar rolling gesture with the Wii remote (Wii Sports Bowling).

One of the research questions that my thesis tackles is, how can we move beyond using the Wiimote as a traditional game controller (similar to function mapping, like on a keyboard), and take advantage of its gesture recognition features? For inspiration, we can look to the kinds of gestures used in Wii games. We can design applications where gesture-based interaction is more intuitive than a point and click interface. Similarly, we can take an existing application (like Google Earth) and re-map its functions to fit a gesture-based user interface.

Posted in Undergrad thesis | Tagged , , , , | 3 Comments

Twitter Wordle

I came across Ankit Ahuja’s blog today and saw his Twitter Wordle blog post. For those of you who don’t know, Wordle is a simple online application that lets you create word clouds from text files or websites, emphasizing words that are used more often. I wanted to make my own but couldn’t find the right resources from the site, so I ended up doing a Google search for a script that would allow me to download all of my tweets into a text file. I found a python script by Zach Seifts that I ran after downloading BeautifulSoup, a Python HTML/XML parser required to run the script. Nick helped me tweak it a little bit so that it worked. Here is the code that I used:

import time
from urllib2 import urlopen
from BeautifulSoup import BeautifulSoup

# Replace USERNAME with your twitter username
url = u'http://twitter.com/USERNAME?page=%s'
tweets_file = open('tweets', 'w')

for x in range(10*10000):
f = urlopen(url % x)
text = f.read()
text = text.replace("sc'+'ript", "script")
soup = BeautifulSoup(text)
f.close()
tweets = soup.findAll('span', {'class': 'entry-content'})
if len(tweets) == 0:
break
[tweets_file.write(t.renderContents() + '\n') for t in tweets]
# being nice to twitter's servers
time.sleep(5)
print "working...Page",x

tweets_file.close()

This exported all of my tweets into a text file that included all @ replies and HTML tags. Since Wordle would easily pick them up, I had to get rid of all HTML tags and @’s so that they wouldn’t dominate the word cloud. To do so, I used Emacs to create macros that automatically found and deleted them, leaving only raw text that I could plug into Wordle. The result is this glorious Twitter Wordle cloud à la @chloester:

chloester's Twitter Wordle

Posted in Musings | Tagged , | Leave a comment

Wintersession update

Here are a few things I’ve done for my thesis project so far this Wintersession:

- Test a GlovePIE script to control Google Earth with a Wiimote.
- Research other ways of using Google Earth with the Wiimote. Google at Macworld had a program that allowed you to “surf” in Google Earth using a Wii Balance Board.
- Brainstorm ways one can use 2 Wiimotes and gestures (without IR) to control Google Earth.
- Short writeup about interaction methods in Google Earth coming soon.
- Read a few recent ACM articles that mention Wiimotes. Nothing new; Wiimotes are still used as a game controller.
- Got WiiFlash 0.4.5 running on Vista using Toshiba’s Bluetooth Stack 6.10.10. This means I no longer need to rely on VMWare to use Windows XP!
- Last WiiPaint 1 update soon, then working on WiiPaint 2.

Some inspirational projects that I found:
- Acura Interactive Oracles – An interactive tabletop interface developed for Acura. The interface allows multiple users to play with it, creating shapes, sounds, and interactions between users.
- reactable – The reactable is a collaborative electronic music instrument with a tabletop tangible multi-touch interface that allows several people to compose music using blocks representing different components of a classic modular synthesizer. This is a really cool device that is intuitive and user-friendly.

Posted in Undergrad thesis | Tagged , | Leave a comment

Social media explosion!

As I write this blog post, my hands twitch in frustration with old systems and excitement for some new changes.  These last few days I’ve been getting a little more into Twitter, following and reading a lot of posts and making little progress doing everything else I’m supposed to. As my panic level rises in small doses, so does something else in the back of my brain that struggles and cries out for liberation. I’ve read some thoughtful articles ranging from irrational psychology to social technology encouraging face-to-face interaction (Thanks @EvanMPeck) that my brain ruminated on. It felt like the influx of information was demanding that I say something in response that encapsulated my voice and reader relevance at the same time.  It has been a while since I’ve written, and reading about the art of one-butt-cheek blogging got me started again.

Social Media Landscape by Fred Cavazza

Social Media Landscape by Fred Cavazza

What is the role of Social Media in my life? How much time should I spend on it? Is it worth that time that I could be spending on something else? It was clear to me that I couldn’t go overboard or else I wouldn’t get anything done, and a balance had to be found between my Twitter community and my projects. At the same time, the internet is ironically one of the few and best ways to find sources of inspiration related to creating technology that encourages face-to-face interaction, my favorite topic to think about these days leading up to graduate school. I was compelled by these questions to write down my thoughts lest they scurry away like field mice.

My attraction to online social anything seems to be rooted in the fundamental human need for social contact and community. This isn’t to say that my real life communities are not satisfying, au contraire, they are the best that I could ask for and are extremely fulfilling and important to me. But there is something irresistible about being part of Twitter that I can’t get enough of. What started out as a handful of personal follows and followers turned into a place where I could network with people with similar interests, and in turn be exposed to equally awesome things. That rarely happens in real life, or maybe I just haven’t found the right place yet. It is like meeting strangers while taking public transportation and striking up friendly and interesting conversation, or asking people in the bookstore for recommendations and talking about your favorite book. Except, for some perverse reason, we are more open to strangers online; we are more likely to have these conversations online even though in real life, these opportunities are everywhere if we look for them. And having my website allows me to show the whole world who I am and what I like to do, so that perhaps by chance, a stranger will stumble upon it, leading to some conversation that will make us both feel intellectually satisfied. The apparent lack of a social barrier online is something that we need to bring to real life so that we can really connect with each other in person.

Perhaps the reason why social sites like Twitter are so successful is that by being ourselves, we know we can reach out to other people “out there in the world” with similar interests, and they will reach back. It gives us a feeling of connectedness, but what does that mean in a society where connections come from iPods, cell phones, and wi-fi? Perhaps online interaction is slowly replacing real life interaction because it is less disappointing, more efficient, and we can reach more people faster. If that is the case, then we need to find ways to bring a part of that back to our interactions with others in real life. I hope to tackle this question in graduate school and through conversations both online and in person. Here’s to discovering and understanding humanity better through social media so that we can use it to make a positive impact on social interaction.

Posted in Musings | Tagged | Leave a comment

WiiPaint site live!

The WiiPaint project website is now up and running :)  Please take a look and feel free to email me with any questions or feedback.

Posted in Undergrad thesis | Tagged | Leave a comment
  • Twitter::chloester

    • Testing out Rapportive for my Gmail inbox (adds contact profiles to right-hand side) http://www.rapportive.com 1 week ago
    • Speaking of Flickr, just realized they deleted all my pics 'cause pro account expired. Some advance notice would have been nice! Not happy. 1 week ago
    • Considering a fresh start on my Flickr page...only show the best w/story, while everything else can go on Picasaweb. 1 week ago
    • Omg, Wild River Kettle Corn from Strip District is BEST EVER. #cantstopnomming 1 week ago
    • Celebrated completion of communication requirement talk by buying a 27" monitor :] http://amzn.to/af4GX0 Current 23.6" will go in office. 1 week ago
    • Old School Color Cycling with HTML5 http://bit.ly/cQYG5o 2 weeks ago
    • Copenhagen! So tired from exploring the city for 4 hours. Caught Hej Matematik concert at Tivoli. Canal tour tomorrow then off to Amsterdam! 2 weeks ago
    • Chihiro Sato presents model for calculating curiosity in public places by measuring walking speed. #dis2010 2 weeks ago
    • Skipping afternoon sessions and exploring Aarhus in sunny weather #dis2010 2 weeks ago
    • A couple of us are going to dinner/ARoS museum tonight after designer's eve (M trip). Reply if interested! #dis2010 3 weeks ago
    • More updates...