During our stay in Stavanger with iolab, we were luck enough to visit IRIS (International Research Institute Stavanger), a marine-centered research institute working in environmental sensing, data collection, and applied research. We were received by Jan-Borsth, the research director, and were given an extensive tour, as well as a chance to participate in a roundtable discussion where we explored the possibilities of artistic investigation to sit alongside scientific research.
The largest takeaway for me was the idea of ‘sense-making’ – i.e. techniques for artists to present data in different ways – such as sonification – that would allow for the ‘viewer’ to experience more immediate impressions, diverse readings, and/or allow for different faculties and intelligences to be engaged when taking in scientific datasets.
Tapio mentioned a previous prototype from a previous Marin residency where environmental conditions were monitored on a small island in Finland, and the Arduino controller directly controlled various flag positions that would arrange themselves depending upon the data collected, allowing a longer range visual recognition of the data (and not requiring the user to even embark onto the island itself). Niki’s current project is another example of this, where his ‘auqalung‘ , if I can use that phrase, will organize it’s breath according to realtime Ph-balance readings of the water environment where it sits.
Coming from my paradigm and experience, I thought of a more extreme, aestheticized example; the Marin team could collaborate with IRIS and iolab to produce a concert event, where the IRIS personnel would be responsible for installing a mussel tank where each specimen would be monitored for how often they open and close their shell (apparently an indicator of stress, based upon the water quality), and we could be fed the data stream in realtime. The data could then be used to control a software patch, perhaps in Pure Data, where the opening and closing of the shells could individually control the playback of audio samples. Over the course of the event, the IRIS staff could slowly induce the tank environment with ‘pollutants’ that would effect the water quality and thus increase stress in the mussels, prompting them to change the pace of their activity. A separate sensor could feed us the level of pollutants, which could be used to effect realtime filtering and effects, or to shift through different sample sets in Pure Data.
The resulting event could produce a scientifically-relevant experience where the audience has the chance to use several senses – visual, auditory, and cognitive – to make a clear connection between environmental factors and the health of our natural world, allowing for a vastly different experience of science to emerge. Just a thought…