Lifestreams Redux

March 24, 2016 by · 4 Comments 

IMG_3679

This week I presented a new generation of lifecharm data shells at a symposium on ethics in data science for the Alan Turing Institute. The shells were created by Stefan Kueppers using the Lifestreams process for data manifestation, and used data from a research project led by Professor George Roussos at Birkbeck University of London which records symptoms of Parkinson’s Disease as experienced by sufferers.

These shells are an initial experiment flowing just 3 data sources into the shell growth parameters, which we hope to expand with further data sources and increase the complexity of the model in future generations. The aim is to capture the high variation in symptoms experienced by those with Parkinson’s as an alternative to the way in which patients’ complex symptoms are collapsed into the single summary statistic of the Universal Parkinson’s Disease Rating Scale.

Read my provocation piece for the ATI symposium for more information.

Visualise: Making Art in Context

January 20, 2014 by · 3 Comments 

Visualise book_cover
Anglia Ruskin University has published a book, edited by Bronac Ferran, reflecting on the Visualise public art programme. We have contributed a short piece describing our Lifestreams collaboration with Philips Research.

Visualise: Making Art in Context
Published by Anglia Ruskin University
Edited by Bronac Ferran
Designed by Giulia Garbin
ISBN: 978-0-9565608-6-5
Published 28th November 2013
Copies can be ordered from : Pam Duncan, Bibliographic Services Manager, University Library, Anglia Ruskin University

The book brings together essays by artists featured in the Visualise public art programme, which took place from Autumn 2011-Summer 2012 across Cambridge, managed by Futurecity with guest curator Bronac Ferran. It includes reflections on the development of the programme by Professor Chris Owen Head of Cambridge School of Art and from Andy Robinson of Futurecity on the role artists can play in our cities ecology and contested public realm. Among the essays are newly commissioned pieces relating to poetry, composition, music, code, language and place by Liliane Lijn, Eduardo Kac, Tom Hall, Alan Sutcliffe and Ernest Edmonds as well as interviews with Duncan Speakman and William Latham, reflections on two art and industry collaborations by Bettina Furnee and Dylan Banarse, and Giles Lane of Proboscis and David Walker of Philips Research and a previously unpublished holograph by Gustav Metzger.

About Visualise: Making Art in Context
From tales of a transgenic green bunny to a singing painting, from computer-generated lifecharms to a soundwalk at dusk through Cambridge’s streets, parks and arcades, this publication conveys some of the myriad happenings which characterised Visualise; a programme of public art, curated for Anglia Ruskin University in 2012. Funded by the University from Percent for Art sources, Visualise brought new life to hard streets, providing opportunities for public engagement through challenging visual art and sound installations, temporary events and exhibitions. It connected in direct and indirect ways to perceptions of Cambridge as context and site of scientific discovery and technological inventiveness. The book weaves the history of Cambridge School of Art and the Ruskin Gallery (the place where Syd Barrett of Pink Floyd played his first gig and Gustav Metzger, renowned founder of auto-destructive art, had his first arts education before the end of the Second World War) with today’s digital developments. A series of newly commissioned essays provide intriguingly personal insight into how world-leading international and local artists create lasting ‘mark and meaning’ (Eduardo Kac) working in contexts of historical time as well as in physical space.

Lifestreams at Mosaic3DX

October 31, 2013 by · 3 Comments 

IMG_0445

This week we exhibited the Lifecharm shells, datalogger and Lifestreams film at the Mosaic3DX conference, held at Microsoft Research in Cambridge. The exhibition was organised by Karen Jinks of Cambridge Creative Network and also featured Jenny Langley, Gareth Wild of Apropos, Nick Edwards, Jon Heras of Equinox Graphics and Circuit Cambridge.

This slideshow requires JavaScript.

 

Digital Alchemy

September 25, 2013 by · 17 Comments 

Digital Alchemy – transforming data into poetry

“The real nature of matter was unknown to the alchemist: he knew it only in hints. In seeking to explore it he projected the unconscious into the darkness of matter in order to illuminate it.”
Carl Gustav Jung, Psychology and Alchemy

visualise-best-pics---27

From the late Middle Ages alchemists were frequently depicted as seekers of eternal life and unending riches, a wholly materialist set of objectives that would be facilitated by discovering the philosopher’s stone and being able to transmute lead into gold. However, in the twentieth century, an entirely different interpretation of alchemy gained ascendance due, in large part, to the writings of the Swiss psychotherapist Carl Gustav Jung. Jung interpreted alchemy as a symbolic process that aimed at individuation, the psychological assimilation of opposites whilst retaining their separateness, leading to the psychological (or even spiritual) transformation of the alchemist. The use of symbols and materials in the alchemical process function as archetypes of mythological images that reside within an individual’s unconscious, triggering an internal transformation as they pursue the Work. This likening of alchemy to the esoteric and spiritual traditions of East Asia (such as yoga and meditation) as well as its own Western roots in Hermeticism places it clearly within a framework for reflection, revelation, transfiguration and enlightenment.

In January 2012 a team from Proboscis (Stefan Kueppers and Giles Lane) was invited to collaborate in a critical and creative dialogue with scientists (David Walker and Steffen Reymann) from Philips Research Laboratory in Cambridge as part of Anglia Ruskin University’s Visualise public art programme (commissioned by Andy Robinson of Futurecity with Dipak Mistry of Arts & Business Cambridge). Our collaboration was one of several initiated between artists and industry in Cambridge that were aimed at helping to communicate the benefits that could come from such partnerships. Philips proposed that the theme for our joint dialogue would focus on personal health monitoring. Specifically our colleagues at Philips were interested in exploring new ways to engage nominally healthy people in monitoring their own health and lifestyle as a preventative measure, rather than waiting for a medical condition to arise and then find themselves having to adopt biosensor monitoring as part of a recuperative regime. The aim would be to think of emerging biosensor systems as part of a continual, holistic process of healthy living and wellbeing, rather than just as technological aids for post hoc medical intervention. The problem was that the statistics concerning the use of commercial biosensor products and related smartphone apps demonstrated that the vast majority of users tended to abandon the devices and ignore the data visualisations within weeks of first using them, undermining any potential beneficial impact they could have.

Over the next six months through a series of intense monthly meetings, rapid conceptual development and iterative prototyping we developed an experimental response to the problem. Our project, Lifestreams, proposed a novel way of thinking about the nature of biosensor data and its relationship to how we live our lives. We sought to move beyond the simple graphs and number counting that pervades so much of the ‘quantified self’ meme towards the poetic and numinous; to capture something of the epic in everyday life. Our aim was to transform our relationships to digital data from the ephemeral of screens and interfaces into something that encompassed the tactile and material producing a more subconsciously emotive and emotional experience – an artefact or Lifecharm.

Having developed the basic concept we grappled with the form that such an artefact should take asking ourselves, “What physical form could be mathematically driven by data to create dynamic and interesting shapes that could also communicate some sense of the whole person?”. The answer was to reflect on and revisit nature for archetypal forms and generative principles. In listing the attributes that an artefact generated from information would likely have, we found ourselves describing the growth patterns and expressiveness of shells. The patterns in their growth are determined by the health of the creature (such as a mollusc or snail) making them; what they consume, stress factors and the environmental conditions they exist within. Shells have a near universal fascination so the idea took hold of using contemporary technologies to artificially allow a human to ‘grow’ their own shells from data generated by monitoring their own health and lifestyle patterns.

This slideshow requires JavaScript.

The lifecharms were created by capturing a range of personal biosensor data types (heart rate, body temperature, blood pressure, step count, sleep pattern, exposure to air pollution) and applying the data to a workflow using algorithms to extend the principles of the helico-spiral with time-based rules. These allow us to ‘grow’ the shell in the Groimp 3D modelling environment producing the initial 3D model surface which we then post-processed using Meshlab software for export as a stereolithographic file. The file can then be sent to a 3D printer to generate the physical artefact in a variety of different materials such as plastic, metals, glass, resin and ceramic. What makes the lifecharms unique is that they are not just parametric or formulaic transmogrifications of the raw data but generative because time as a key element informs the variations in the growth grammar that evolves the shells. Each of the biosensors’ time-series data drives one of the parameters governing the shell’s growth form. The data points are iterated through time intervals and become parameters altering the shell’s growth rules as more data is fed into the model. This gives each shell a non-deterministic morphology somewhat akin to the way a shell would be grown by a living creature.

Our own research into and experiences of using more common screen-based interfaces for visualising biosensor data had left us feeling that they were somehow inadequate. Their frankly mechanistic approach to relaying the data back to the user seemed to lack the kind of poetry that would allow someone to weave the process into the daily narrative that people construct about themselves. Unlike data visualisations the lifecharms are generated through a process of non-deterministic spatial data transformation. It does not confine them to such an instrumental purpose as merely relaying the original data back to us as information in a simplified and easy to comprehend manner. Instead, they are embodiments of the data, transformed from the abstract and ephemeral into the concrete and present. They establish the potential for uncommon insights to be perceived into the health conditions and lifestyle patterns in which the data was collected. Such insights are prompted by tactile and intuitive reflection.

Over the past decade Proboscis has been exploring tactile interfaces and tangible souvenirs as a key part of our research into the way people create and share knowledge, stories and experiences – what we call public authoring. An element of the handmade often features in the outputs we design, but here the imprint of the person about whom the data being shared is directly embodied in the object itself. A Lifecharm shell synthesises the intrinsic qualities of the data within its morphology; visualisations, on the other hand, make extrinsic interpretations of such data. It is, at one and the same time, both an informational object – representing a state gleaned from sensor data – and also a philosophical thing triggering intuitive reflection. It unites different traditions of investigation and meaning making: the scientific and the mythic, or magical, both being and becoming. However, a lifecharm is neither an icon nor iconic, nor yet an implement or tool – it embodies a state without representing it banally. What it exemplifies is not knowledge in the form of a ‘transactable’ commodity or product but a path to knowing that arises from an ongoing process of continuous interaction with and intervention within everyday habits, in this case practiced daily through touch.

“Magic in its earliest form is often referred to as “the art”. I believe this is completely literal. I believe that magic is art and that art, whether it be writing, music, sculpture, or any other form is literally magic. Art is, like magic, the science of manipulating symbols, words, or images, to achieve changes in consciousness.”
Alan Moore

The Lifecharms are not rational, functional objects, they are magical, irrational, indeed talismanic things by which, through tactile familiarity, we may come into knowledge or understanding by way of revelation. Like poetry, which is much more than the sum of words and their arrangement on a page, they are more than the sum of the data that drives their growth parameters.

Carrying a lifecharm and touching it everyday, both consciously and even as a displacement activity, causes you to develop a relationship with it over time. You become familiar with its materiality – the feel of the shape in your hand; the weight of the material it is made of, the textures of its surface. None of these reveal the patterns in the data that generated it directly, however this is precisely the point at which the lifecharm begins to operate in a mythic or magical capacity – as a performance of patterns of being and of behaviour embodied and reified into a talisman. Its magical power could be defined as the potential for revelation that it holds for you to come into an uncommon insight by handling it over time. In this way you might come to perceive new possibilities for change and adaptation in your own patterns and behaviours – triggering your own process of subjective transformation. The lifecharm is thus not just a thing of being but a thing of becoming. Their role in the personal narratives we construct around our daily lives is revealed as much through our continued interaction with them as by their thingness.

Like poetry, the lifecharms are also diachronic – meaning that we can experience and relate to them across time, whilst the meaning or data they embody is fixed in time (i.e. the shape of the shell or the words of the poem do not change). Dynamic data visualisations may often be synchronous – i.e. driven by live or recent data streams – but the way we experience and relate to them is likely to be mediated (through devices such as smartphones, tablets or computers) and determined by our behaviours and patterns of using those devices they are mediated through. This makes the lifecharms intrinsically different to screen-based visualisations of data. The information that we may glean from them is less to do with an instrumental replay in visual form and much more to do with how we begin to learn about the patterns they embody through a growing tactile familiarity with their physical form. This difference becomes an opportunity to augment our means of understanding the phenomena recorded in the biosensor data – an opportunity to explore meaning making through a relationship to complexity and intersubjectivity.

About six months after our initial three generations of shells were created and 3D fabbed I came into my own uncommon insight – that the shells were in fact, tactile poems. This happened partly as a result of my stay in Reite village in Papua New Guinea with anthropologist Professor James Leach (University of Western Australia/CNRS) during November 2012 and our conversations since, as well as those I have had about my experiences there with poet Hazem Tagiuri (a Proboscis associate). The villagers of Reite lead a traditional ‘kastom’ lifestyle in the jungle with a fairly minimal exposure to a ‘modern’ existence predicated on patterns of consumption and mediated sociality. (Although the modern world of industrially produced goods and telecommunications is slowly but surely encroaching and making an impact on their lives and culture). Reite people were traditionally non-literate and remain highly skilled makers, carving and weaving many of the things they use. Touch is a powerful sense through which they acquire information about their world, as indeed it could also be said to be with highly skilled artisans and craftspeople of our own society. However, the incredible sense of presentness in everyday Reite life and the intensity with which they conduct continuous social relations is vastly unlike our Western culture of discontinuous being, mediated as it is through patterns of dislocation, telecommunication and distraction. I felt that their physical knowledge of materials connects at a deeper level and is more attuned to detail and granularity than ours. Looking at our own society and culture, such physical, traditional knowledge has been debased as a lower form of skill and social standing – for instance in the negative way manual labour is contrasted with intellectual work, or how craft is ‘lesser’ than Art – for centuries.

Since returning from PNG my conversations with James have often focused on this intensity and presentness – a kind of radical continuity with being that life in the village feels like. This intensity has also been the subject of my many attempts to describe what life in the village feels like to others. An enduring memory I have, and which I described to Hazem, was watching a man ‘conjure’ fire from cold sticks in a firepit without using any form of tinder, or ember or fire-lighting materials. What seemed like magic or an illusion was an everyday demonstration of the uncanny power and knowledge this man possessed. He knew just how to feel for residual warmth within the sticks and arrange them in just the right way that would amplify the heat enough to stimulate combustion, a skill and power I have neither witnessed nor even previously heard of. The poem Hazem subsequently wrote helped me to connect the lifecharm’s talismanic nature to poetry. It helped kindle the spark of revelation that, like the way we come to know a thing through poetry, so the kind of knowing that resides within our hands and sense of touch is not just symbolic knowledge, but actual; that we may truly come to know something through touch alone. And that, like in poetry, the precise, elusive moment in which we come into the knowledge that the lifecharm offers us remains on the edge of conscious thought; a sensation we intuitively call revelation. Perhaps such a thing might also be described as the Work of digital alchemy.

Giles Lane
Loch Ard, Scotland August 2013

This essay was first published in Tasting Notes, a book accompanying the exhibition, This New Nostalgia, curated and published by InspireConspireRetire, September 2013.

Lifecharms at London Design Festival

September 10, 2013 by · 13 Comments 

Header Image with info

A selection of Lifecharms made for our Lifestreams project with Philips Research will be exhibited in a group show, This New Nostalgia, as part of this year’s London Design Festival at the Liberty of Norton Folgate in Bishopsgate, 14th-22nd September. The show is curated by InspireConspireRetire exploring,

“how we transform the physical object world and how this world in-turn, transforms us… The Lifestreams project by Proboscis forms a key feature of this exhibition, opening conversations about the role of the maker in developing objects that embody emotion and hold meaning without a superimposition through forces of branding and advertising. [T]his project engages the design community in questioning our role as makers of meaning and significance whilst keeping up with technologies and harnessing their powers for transformations extremely personal, weaving themselves into the narratives of everyday life.”

Lifestreams : Tactile Poetry

March 21, 2013 by · 14 Comments 

shell-1

Since early December last year I’ve been carrying around one of the Lifecharm shells with me every day. It was generated from personal biosensor data gleaned not just from myself but from two other studio members last summer when we were capturing a range of experimental data sets to generate prototypes with. Using the data, Stefan generated this particular lifecharm as part of our third iteration of prototypes in late July. This shell was one of several that we later chose to have 3D printed in different materials at Shapeways – this one in sterling silver, the others in glass, ceramic, resin and steel.

I have been carrying it around to see how I feel about it, what it means to me and how I weave it into my everyday life. Our original concept for the lifecharms was that they might trigger an entirely novel way of developing meaningful relationships to the kinds of personal health data gathered by sensors (such as Fitbit, Fuelband etc) that people are now adopting as part of the ‘quantified self’ meme. Our colleagues at Philips Research, David & Steffen, told us that the statistics of use of these kinds of sensors by healthy people tended towards abandonment after just a few months as interest and engagement fades. Their interest was in exploring motivations that might make self-monitoring of wellbeing and healthy lifestyle a thing someone would choose to do before they discovered a health issue that required monitoring.

Our approach to this was to think about the way such sensor data is relayed back to users – most commonly in the form of screen-based visualisations. We wondered if perhaps these simply aren’t arresting enough to weave themselves into the narratives of everyday life that people construct for themselves. I’ve long been interested in touch as a form of knowing and sharing, and Proboscis have been exploring physical outputs from digital experiences for many years (such as tangible souvenirs) so we started out by thinking about how we might embody the data in a physical form that could be carried around and used like a charm or talisman. Stefan has written previously about our research methods and the journey that led us to devise the lifecharm and its inspiration from nature. His Lifestreams film also explains the various technical processes we adopted and adapted to create the results.

diagram-v4

What’s so special about these ‘data objects’?
Unlike data visualisations the lifecharms are generated through a process of data transformation that does not confine them to an instrumental purpose such as relaying the original data back to us as information in a simplified and easy to comprehend manner. Instead, they are embodiments of the data, transformed from the abstract and ephemeral into the concrete and present. They establish the potential for uncommon insights to be perceived into the conditions from which the data was collected (i.e. someone’s health and lifestyle patterns), prompted through a process of tactile and intuitive reflection.

A Lifecharm shell synthesises the intrinsic qualities of the data within its morphology (visualisations, on the other hand, make extrinsic interpretations of such data). It is, at one and the same time, both an informational object – representing a state gleaned from sensor data – and also a philosophical thing triggering intuitive reflection. It unites different traditions of investigation and meaning making: the scientific and the mythic, or magical, both ‘being’ and ‘becoming’. However, a lifecharm is neither an ‘icon’ (nor iconic) nor an ‘implement’ (tool) – it embodies a state without representing it banally. What it exemplifies is not knowledge in the form of a ‘transactable’ commodity or product but a path to knowing that arises from an ongoing process of continuous interaction with and intervention within everyday habits, in this case practiced daily through touch.

shell-3shell-2

Tactile Poetry?
The Lifecharms are not rational, functional objects, they are magical, irrational, indeed talismanic things by which, through tactile familiarity we may come into knowledge or understanding by way of revelation. Like poetry, which is much more than the sum of words and their arrangement on a page, they are more than the sum of the data that drives their growth parameters.

Carrying a lifecharm and touching it everyday, both consciously and even as a displacement activity, causes you to develop a relationship with it over time. You become familiar with its materiality – the feel of the shape in your hand; the weight of the material it is made of, the textures of its surface. None of these reveal the patterns in the data that generated it directly, however this is precisely the point at which the lifecharm begins to operate in a mythic or magical capacity – as a performance of patterns of being and behaviour embodied and reified into a talisman. Its ‘magical power’ could be defined as the potential for revelation that it holds for you to come into an uncommon insight by handling it over time. In this way you might come to perceive new possibilities for change and adaptation in your own patterns and behaviours – triggering your own process of subjective transformation. The lifecharm is thus not just a thing of being but an thing of becoming.

Like poetry, the lifecharms are also diachronic – we can experience and relate to them across time, whilst the meaning or data they embody is fixed in time (i.e. the shape of the shell or the words of the poem do not change). Dynamic data visualisations may often be synchronous – i.e. driven by live or recent data streams – but the way we experience and relate to them is more likely to be mediated (through devices such as smartphones, tablets or computers) and determined by our behaviours and patterns of using the devices they are mediated through. This makes the lifecharms intrinsically different to screen-based visualisations of data. The information that we may glean from them is less to do with an instrumental replay in visual form, and much more to do with how we begin to learn about the patterns they embody through a growing familiarity with their physical form. This difference becomes an opportunity to augment our means of understanding the phenomena recorded in the bio sensor data – an opportunity to explore meaning making through a relationship to complexity and intersubjectivity.

I came to my own uncommon insight – that the shells were in fact, tactile poems – partly as a result of my stay in Reite village in Papua New Guinea and the conversations I have had since with anthropologist James Leach, and also with poet Hazem Tagiuri. The villagers of Reite lead a traditional ‘kastom’ lifestyle in the jungle with a fairly minimal exposure to a ‘modern’ existence predicated on patterns of consumption and mediated sociality. (Although the modern world of industrially produced goods and telecommunications is slowly but surely encroaching and making an impact on their lives and culture). They were traditionally a non-literate people and remain highly skilled makers, carving and weaving many of the things they use. Touch is a powerful sense through which they acquire information, as it could be said to be with highly skilled artisans and craftspeople of our own society. But coupled with the incredible sense of presentness in everyday Reite life and the intensity with which they conduct social relations that is so unlike our own society of discontinuous being, I felt that their physical knowledge of materials connects at a deeper level and is more attuned to detail and granularity; whereas in our own western culture it has been debased as a lower form of skill and social standing – such as the negative way manual labour is contrasted with intellectual labour, or how craft is ‘lesser’ than art.

Since returning from PNG my conversations with James have often turned on this intensity and presentness – the form of radical continuity with being that life in the village feels like. I have, in turn, attempted to convey my experiences to friends, to describe how utterly different I felt whilst in the village. During the course of one conversation with Hazem I described watching a man ‘conjure’ fire from cold sticks in a firepit without using any form of tinder, ember or fire-lighting materials. What seemed like magic was a demonstration of the uncanny power and knowledge this man had in knowing how to feel for residual warmth within the sticks, and arrange them in just the right way that would amplify the heat enough to stimulate combustion. A skill and power I have not witnessed nor even heard of before. Hazem wrote a poem about my description of this act which he sent me as I was grappling with writing about the lifecharms and what they are. His poem helped me to connect the lifecharm’s talismanic nature to poetry. It helped kindle the spark of revelation that, like the way we come to know a thing through poetry, so the kind of knowing that resides within our hands and sense of touch is not just symbolic knowledge, but practical; that we may truly come to know something through touch alone. And that, like in poetry, the precise, elusive moment in which we come into the knowledge that the lifecharm offers us remains on the edge of conscious thought; a sensation we intuitively call revelation.

Invoking Fire by Hazem Tagiuri

We talk of his time in the jungle.
He describes one marvel in particular:
how a fire was conjured from cold sticks,
as if heat swelled in their fingertips.

No tinder, hot coals; embers a day dead.
“It’s not that it seems like magic, it simply is.
Their magic. These are not illusions.”
No sleight of hand. Smoke, but no mirrors.

What we mimic through tools,
these men of power can summon,
with quiet majesty. No incantations;
they save their breath for the flames.

Lifestreams film

March 7, 2013 by · Leave a Comment 

A new film to explain some of the technical aspects to our Lifestreams project and how we created the Lifecharm shells.

Lifestreams from Proboscis on Vimeo.

New Lifecharm Shells

December 12, 2012 by · 2 Comments 

Our colleague at Philips R&D, David Walker, was kind enough to have some more shells 3D printed in metal for a small experiment we’re planning to run in the new year. Here are some photos he’s taken of them.