PLAY – Palm to fist motion. PAUSE – Fist to palm motion.
VOL UP – Slide palm facing up. VOL DN – Slide palm facing below. MUTE – “O” Shape.
FORWARD – Slide right with palm. BACKWARDS – Slide left with palm.
Sounds (can be heard while the gestures play):
Besides the volume sounds, all other sounds were me interacting with different object (pen, coins, lighter, cup of coffee, etc.) above my dining table and lightly hitting the table or rolling said object on the table. All the sounds were imported into Audacity and edited to match the action the user is performing while the sound plays. For example, the sounds for volume are pitched so they start low and end up high (vol up) or the other way around (vol dn.). That sound was actually me scrolling through the dial wheel on my camera.
For my Initial Prototypes, I sketched out the plan on a notebook which contained raw drawings of my gestures and ideas for sounds. Most of the gestures I had picked in the beginning made it to the final cut of the in initial prototype, while all my sound ideas were replaced by other ideas, as most of them didn’t sound right or did not match the context. Some serious brainstorming was needed in order to come up with the sounds, which was in my opinion the hardest part.
For the evaluation, my user was asked to watch the video above and after it’s done, react and comment on the gestures and come up with possible improvements. My user was a close friend (classmate), and although the results may have been influenced by our friendship, the feedback received from him was unexpectedly impressive for my first time designing sounds and gestures. The gestures he understood clearly but he came up with the improvement that for rewinding and forwarding, it could have been left hand swipe left (backwards) and right hand swipe right (forwards).
While discussing the sounds used, the biggest remark and most frequent one was that most sounds were too basic, although I have to agree with that, the sound-creating part of the process I found tricky to ideate on. The creation process of the sounds was especially hard for someone with no prior knowledge of sound-recording and editing, and while my user mentioned the fact that “more positive synthetic sounds” I had no idea how to come up with such sounds using only household sounds.
Reflection (after Evaluation):
After evaluating the product’s sounds and gestures with a user, I decided a few changes could be made in order to make the product more appealing sound-wise and gesture-wise.
When discussing sounds, using another application, a more complex sound recording app, would sure come into hand, as using sound effects on my recordings would make them sound more appealing. General feedback from the test also suggested making sure all sounds can be distinguished one from another, as sometimes they were really similar, which caused confusion at times for the user.
Making the gestures distinguishable one from another was also an essential piece of feedback I received which could be used to refine the gestures, as for example forward and backward could have been changed with a gesture done with a different limb (i.e. right vs. left arm).
In conclusion, using sound libraries would’ve been the easy way out in the case of sounds, but recording your own sounds makes you think about the meaning of a certain sound and makes you really think outside the box while planning you app. Thinking of gestures that would work with your app and would be easy enough for the user to remember and recall makes you think forward to the future, where everyone will be controlling their technology with gestures and voice commands.
I think starting to experience testing for sound and motion was a really fun assignment that helped explore new fields in which we had previous knowledge, and although the sound recording part didn’t go as planned, I think the project had a positive influence on my experience with prototyping, as I learned new ways to prototype that I’m sure I’ll use in the future. Using sound libraries would’ve been the easy way out in this case, but recording your own sounds makes you think about the meaning of a certain sound and makes you really think outside the box while planning you app.