Protocol is an interactive art installation that attempts to realize a new form of human-machine symbiosis. Through a multi-modal interface, the piece networks the human with a group of sensing, artificially intelligent entities. It features a set of intelligent acoustic drums that can “bite back” whenever they are struck. The multi-modal interface allows these intelligent drums to sense and communicate with a participant via sound, rhythmic patterns and electrical stimulation of the participantʼs skin. A typical participant experience is as follows: the installation space is almost completely dark and consists of a group of drums (typically four), located in the center. Prior to entering the space, the participant puts on as a set of wearable electronic components. These include accelerometers that sense arm motion and electro-tactile stimulators attached to the abdomen. The system responds to the participant’s arm movements and striking of the drums by generating synthesized sounds, processing the live acoustic signals of the drums and electrically triggering mild muscle stimulation patterns in the participant. These patterns serve as a means for the drums to “touch” and manipulate the participant’s body and — along with the rhythmic patterns generated by the participant — constitute a sort of informal protocol that both human and machine co-develop and that each must learn and adapt to. The drums can also, when sufficiently “excited,” electrify the air and emit colored electrical streams or sparks. Through visceral and corporeal interactions, Protocol seeks to examine how humans and intelligent technological systems can intertwine, interrelate and give rise to posthuman, cybernetic experiences.

Each drum is equipped with a microphone placed near the head that transmits the audio signal to a computer for processing whenever it is struck. Vibration and distance sensors are attached to the shells that allows them to sense when they are touched and when someone is approaching. On the participant's body are two accelerometers (one on each arm) and the electro-tactile stimulators (attached to the abdomen via an elastic belt fitted with electrodes). Each stimulator is mapped to a drum. When a particular drum is struck, its corresponding stimulator is activated. The electrical sparks are achieved by attaching a high voltage power source to a series of small metal rods placed several meters from the drums. The rods serve to focus the electrical energy, resulting in a blue-ish glow and the emission of electrical sparks (known as corona discharge). Like the electro-tactile stimulators, each rod corresponds to a particular drum.

Protocol system diagram

July 2010:
Protocol is currently in progress. Documentation below.