Embodied Gestures Interfaces

Back to the main Embodied Gestures main website

The second phase of the Embodied Gestures project is focused on the design and production of functional musical interfaces. The outcomes of this phase, informed by the knowledge gained during our previous user study, are musical interfaces whose physical configuration affords ways of playing compatible with particular sound gestures.

In order to fully evaluate the project, we decided to employ the same five electroacoustic compositions of the user study to inspire new physical interfaces. After observing clear patterns of compatible actions we discussed possible implementations of the following gestural ideas:

C1 IMPLEMENTATION

Two main sound producing actions can be observed after the study

Design Proposal:

We decided to create an instrument affording the action of scratching with ample movements. Our ideas was creating a handheld object inserted along a physical cord fixed at both ends. It would afford this sound-producing action while it offers a tangible feedback of the position of the object (not like in the case of a typical Wiimote sensor). The central handheld object can be moved inside the cones defined by the cord and its endings. Orientation sensors within the object also allow wrist rotation detection. We used old Gametrak controllers for the lateral parts.

IMPLEMENTATION OF C2

Rummaging and scrachting with objects of a recipient were the most present sound-producing actions observed.

Design Proposal:

An augmented bowl full of small objects able to detect impacts with great sensibility and equipped with 3D orientation and distance sensors informing of bowl’s angle and distance in respect to its original position.

IMPLEMENTATION OF C4

Two objects being scratched was the most possible action envisioned by participants

Design Proposal

An artefact which can be held with both performer’s hands, affording being pushed in and rotated. We created the following metal structure equipped with encoders and pressure sensors to capture the gestural activity.

Prototype:

IMPLEMENTATION OF C5

Bending was observed as the most possible sound-producing action for C4

Design Proposal

A brass metal piece, inspired by a singing saw, incorporating bend and orientation sensors affords the sound-producing action of bending while it also allows the control of different transformations.

We decided to incorporate a Sensel Morph interface to trigger the attack of the sound gesture.

IMPLEMENTATION OF C3

Some type of bar or mallet attacking an object was the envisioned artefact for C3

Design Proposal (in progress):

We are producing a cavity with multiple sensitive points which can be activated with a mallet.