Role

Graphic Designer · MFA, MICA

Type

Thesis research & publication

Advisor

Ellen Lupton

Focus

Micro-gestures & emerging interaction

The Brief

How do we talk to computers we can't see?

In the near future, once devices are screen-less, small wearables, or integrated beneath our skin, how will we communicate with them? Will everyone be speaking out loud? Will it somehow sync up to our thoughts? Will it be like Minority Report?

The future will be full of ways to communicate with the technology at hand, but I believe gestures will be the primary form of communication. Working closely with Ellen Lupton, I created a small publication based on my thesis research: a gestural language set conveying the various tasks that can be performed in a human-integrated computer.

Gestural communication should feel natural and easy without being fatiguing. One of the main issues with movies like Minority Report is the broad, sweeping movements, which are hard to maintain if you're interacting with a computer all day. With fatigue in mind, I developed micro-gestures: small-scale, preferably one-handed movements that can be performed without expending much energy. Humans are, after all, quite lazy.

I drew inspiration from sign language as well as simple gestures we perform daily, like checking someone's pulse, which became the gesture for turning the system on. Feel free to message me for more on the research.

The Work

Human Computer Interaction — publication cover Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread Human Computer Interaction — gestural language spread

Want the full walkthrough?

Happy to talk through the process, tradeoffs, and what I'd do differently.