A Playful Engagement with Light and Sound in Public Space
Proposal version: 1.6
When you enter Co-related Space, you are immediately surrounded by playful laser lines on the floor responding to your movement. A musical score also keyed to your movement reverberates through the spartan physical space. Kids and adults dance through the space, experimenting with ways their interactions affect the musical soundscape and laser light. Co-related Space transforms its location into a playground of sound and light.
Co-related Space is an interactive multimedia installation that engages the themes of presence, interaction, and place. Using motion tracking, laser light and a generative soundscape, it encourages interactions between participants, visually and sonically transforming a regularly trafficked space. Co-related Space highlights participants’ active engagement and experimentation with sound and light, including complex direct and indirect behavior and relationships.
Sonically, the piece draws inspiration from ambient sound, developing the complexity and dynamism of each participant’s sonic “voice” as they interact within the space. Visually, the piece sketches laser lines around and between participants with the thickness, quality, and dynamics of the lines determined by the nature of their participation and the relationships between them. In Co-related Space, sound, light, and your fellow participants are everything.
The key to Co-related Space is a sophisticated visual tracking system combined with complex data aggregation. The system observes people’s movements over time, including moving fast or slow, dancing, standing close, hugging, and synchronizing their movement. Visually and sonically, these observed and inferred behaviors are highlighted with sound and light.
A conductor subsystem leads the piece through a series of subtle movements. The nature of the piece remains the same, but some of the details change. For instance, perhaps only the most active participants are highlighted, or perhaps only the most quiescent. Perhaps, in one movement, the piece creates a connector between people who have no connection already, encouraging interactions between strangers.
Co-related Space is an innovative new media work. Each of the major systems of the piece — the playful laser light sketches, the high-tech motion tracking system, and the generative musical soundscape — break new technical ground. However, the real joy of Co-Related Space will be watching children and grown-ups playfully moving through the space and with each other in response to the dance of light and sound.
The installation will be available to be sited in public spaces, at festivals and events, and in gallery settings. The debut of Co-related Space will be at the Digital Art and New Media Open Studios, University of California Santa Cruz in May 2014. In October, it will appear as part of the Santa Cruz Museum of Art and History’s GLOW Fire Festival. We are negotiating with the San Jose Tech Museum of Innovation for an extended summer 2014 exhibition.
Forms and Materials
Sonically, Co-related Space provides participants with distinct musical instruments that respond to movement within the space and to interactions with other participants. With increasing engagement, a participant’s voice will expand its gamut, develop a more complex timbre, gain dynamic range, and achieve spatial independence. The most active participants will achieve the ability to control a responsive and flexible instrument. Participants’ musical voices will be accompanied by a musical ground, which provides context for and continuity to the sonic experience. The sound will be realized across four channels.
Visually, Co-related Space will create a playful synthesis with the aural components. Using a white laser projector coordinated with motion tracking sensors, the piece will represent its current analysis of the state of the location space and the presence of participants within it. For instance, the piece will sketch lines around and between participants with the thickness, quality, and dynamics of the lines determined by the nature of their participation and the real and symbolic relationships between them (Figures 1 and 3). The piece was partly inspired by and, in terms of line style and variation, takes on some of the visual character of Robert Henke’s Fragile Territories (Figures 4 and 5).
Physically, the piece remains invisible, working hard not to call attention to itself while highlighting the behavior and interaction of the participants. Speakers, sensors, audio equipment, and projection equipment will remain as hidden as possible. Through its audio and visual responses, the work acknowledges presence in a space in a way that unobtrusively rewards immersion in its interactive environment.
Figure 4. Still from Robert Henke’s Fragile Territories.
Figure 5. Still from Robert Henke’s Fragile Territories.
Co-related Space is designed to be located in a space through which people regularly pass, but which is not populated too densely. The artists envision the installation in a darkened lobby, a gallery, or a similar space. An ideal space is 30 foot square with very high ceilings, low intensity lighting, sonically semi-isolated from other sound, and facilitates the discrete placement of speakers, sensors, projector, and other equipment. However, the piece has the flexibility to adapt to different locations.
Dimensions: Co-related Space requires an indoor space with a minimum small dimension of 20 feet (6 meters) and a maximum large dimension of 60 feet (18 meters). High ceilings at least 30 feet (9 meters) are important for safety as well as well as ability to cover the full floor.
Lighting: Dim lighting is preferred.
Sound: Piece requires a sonically isolated space. It doesn’t have to be silent, but on the quiet side of the loud-silent spectrum is preferred.
Here is the timeline for Co-related Space.
|Feb 2014||Phase 1: formalize a project plan and a lexicon; create basic expressive vocabulary for both visual and audio output; establish correlations between participant and space state and output; acquire and set up test equipment; establish basic functionality of laser, music, and movement tracking subsystems; set up master coordination system; make sure all parts are talking to each other; create basic software controls for laser and for music subsystems|
|Mar 2014||Phase 2: acquire remaining equipment; create data schema, programming, and communications framework; translate vocabulary into visual output; translate vocabulary into audio output; create detailed audio elements; create detailed visual elements; program motion tracking subsystem to populate and update the database; limited testing|
|Apr 2014||Phase 3: refine visual and audio elements; complete master control program; live test; early critique; revise, debug, and extend as necessary; Soft GoLive at selected venue; plan for installation|
|May 2014||Exhibit at Open Studios; burn-in time; final problem-solving and diagnostics|
Here are the planned exhibit dates for Co-related Space.
|June 6, 2014||Digital Art and New Media Open Studios, University of California Santa Cruz|
|June to August (tentative)||The Digital Music Temporary Exhibition at the San Jose Tech Museum of Innovation|
|October 17, 2014||GLOW: A Festival of Light, Museum of Art and History, Santa Cruz|
Our debut exhibition will be at UCSC Spring Open Studios, a free event open to the entire community and promoted vigorously on-campus and throughout the wider off-campus community. Our primary exhibition will be at the GLOW Fire Festival at the Museum of Art and History, an event that draws 4000 people annually from a wide demographic. Currently, we are talking to the San Jose Tech Museum of Innovation about an extended summer 2014 exhibition as part of The Digital Music Temporary Exhibition, a planned six-month program featuring interactive music and audio-related installations.