Opto-Phono-Kinesia (OPK): Designing Motion-Based Interaction for Expert Performers

Research output: Contribution to conferencePaperpeer-review

3 Citations (Scopus)
37 Downloads (Pure)


Opto-Phono-Kinesia (OPK) is an audio-visual performance piece in which all media elements are controlled by the body movements of a single performer. The title is a play on a possible synesthetic state involving connections between vision, sound and body motion. Theoretically, for a person who experiences this state, a specific colour could trigger both a sound and a body action. This synesthetic intersection is simulated in OPK by simultaneity of body movement, and audio-visual result.

Using the Gesture and Media System 3.0 motion-tracking system, the performer can dynamically manipulate an immersive environment using two small infrared trackers. The project employs a multipart interface design based on a formal model of increasing complexity in visual-sound-body mapping, and is therefore best performed by an expert performer with strong spatial memory and advanced musical ability. OPK utilizes the “body as experience, instrument and interface” for control of a large-scale environment.
Original languageEnglish
Number of pages6
Publication statusPublished - 18 Mar 2018
EventTwelfth International Conference on Tangible, Embedded and Embodied Interactions - KTH Royal Institute of Technology, Stockholm, Sweden
Duration: 18 Mar 201821 Mar 2018
Conference number: 12


ConferenceTwelfth International Conference on Tangible, Embedded and Embodied Interactions
Abbreviated titleTEI2018
Internet address


Dive into the research topics of 'Opto-Phono-Kinesia (OPK): Designing Motion-Based Interaction for Expert Performers'. Together they form a unique fingerprint.

Cite this