fromCONCENTRATE

research blog of artist John O'Shea

Simple Twisting Interface

As outlined in previous posts I have developed a Mk 1 hardware element of a ’simple twisting interface’ based on the intuitive and inventive action familiar to anyone who has ever experienced, what is technically known as,  a cassette tape fuck-up.

I presented a working prototype for my internal assessment at Culture Lab on the 9th of December 2009, where I used the device in conjunction with an arduino board which was relaying the analog information to MAXmsp in order to trigger and control sample audio files.

Thoughts on interface:

Aspects of the Mk 1 hardware are not ideal.  The prototype device is not using a truly ‘continuous’ potentiometer (if such a thing were to exist) – it is using a standard potentiometer which has been butchered and hacked to go all of the way round. The problem is that this leaves a gap in the turn (the resistive element inside is ‘c’ shaped rather than a continuous ‘o’) and as a result of trying to work with this, the principles of code for the current Max patch are heavily compromised.

The demo MAX patch is very buggy and only worked intermittently during the presentation – it is clear that it needs much more rigorous development.

  • For a Mk 2 it would be highly desirable to find a better solution than the modified potentiometer for sending ‘full twist’ analogue data to arduino.
  • A new MAX patch could then be developed which uses ‘clean’ change in acceleration data rather than periodically polling for difference in values  (which is the clumbsy way the demo ‘worked’)

Thoughts on concept:

During the presentation I was asked ‘why exactly THIS twist?’ and ‘why THIS outcome?’

The action of twisting a pen or pencil in the reel of a cassette tape is something that the majority of the adult population will at some time have done – regardless of technological confidence.  The ‘twisting action’ is the result of some kind of inate human inventiveness which arises in an attempt to fix the tape.

I had begun working with this simple twist because the action is very satisfying, and I wanted to see what kinds of things could be done with the resulting data output that might have some kind of ‘intuitive’ relevance to the cultural associations of the object and so, conceptually speaking ‘feedback’ or echo…

This approach relates to aspects of our recent theoretical study where we considered J. J. Gibson’s ‘Theory of Affordances’ (1977. pp 67-82) in the context of designing for interaction.  Early in the article Gibson, talking about the origin of his theory quotes from ‘Principles of Gestalt Psychology’ (1935, Koffka.)

Each thing says what it is…

…the handle “wants to be grasped” and things “tell us what to do with them

Later though, in a footnote, Gibson warns about making naive assumptions about the simple consequences of our interaction:

THINGS THAT LOOK LIKE WHAT THEY ARE

If the affordances of a thing are perceived correctly, we say that it looks like what it is.  But we must, of course, learn to see what things really are – for example, that the innocent-looking leaf is really a nettle or that the helpful-sounding politician is really a demagogue.  And this can be very difficult.

Strategy:

It is very interesting to work simply from this one ‘action’ and to try and see how much ‘resolution’ there is within it.  In order to make a successful Mk 2 ’simple twisting interface’ I will take the following steps:

  1. use bourns continuous potentiometer to make MAX patch work ‘properly’ for demonstration.  This potentiometer allows 10 full turns (based on an internal spiral) so this will allow full development of the patch – key is that I understand how to calibrate MAX and control samples using the device.
  2. Make MAX patch work with Rotary Encoder (Encoder to Arduino – how? then Arduino to MAX – filter prior to debugged patch?)
  3. Make processing piece using rotary encoder - Arduino to Processing-
  4. Do something interesting!

Finally

What might be  interesting outcomes if this were to be a kind of instrument for triggering music tracks, for instance, rather than a mere demonstration of principle? (and art object?)

It might be interesting if:

  • initial turning ie. too slow, too fast, speeding up corresponded to audible experience (akin to ’scrubbing’ the playhead)
  • turning at a consistent speed for a set period (eg. 5 seconds) allowed the track to take over and play itself
  • twisting fast toggled thru available tracks (in this way, more than one track could be played at a time and tracks could be cued using the scrubbing action.)

Actual and Virtual: Boundaries #2 – Physicality and Imagination

Legal boundaries are often determined in respect of private ownership of land and property and are typically ascribed by the simultaneous use of physical boundaries – walls, fences, gates etc.

What happens if the physical boundary is removed or disappears or deteriorates?

The answer it would seem, is that the legal boundary, lacking its physical scaffold, is prone to demise, and the previously ‘private’ property risks falling into public domain. A simple strategy for combating this undesired collapse of law is to give notification of the established legal boundary whilst also making a symbolic gesture towards the previous physical boundary through the use of small markers.

In this way spaces can give the visible and physical impression of being ‘public’ whilst, at the same time, remaining psychologically, legally, economically and physically ‘private’.

The simple brass studs in the video above allude to the outline of a previous structure which, whilst no longer present, is still able to retain territorial supremacy by invoking law – in this case The Highways ACT 1959.

Regarding the Highways Act 1959 – the Office of Public Sector Information has no record of such an act in their 1959 archive. Further investigation reveals that the act was superseded and repealed with the introduction of the Highways Act 1980.

The situation above presents us with an imaginary building and a sign pointing to a vanished law.

Actual and Virtual: Boundaries #1 – Global Scale

In November 2009, television news reports from the day of the fall of the Berlin Wall returned to our screens, 20 years on, like retinal after images. The Berlin Wall had not been a mere boundary marker but a globally visible, physical, manifestation of a global scale political impasse. The transgression and fall of the wall are now seen as emblematic of the groundswell political changes sweeping Eastern Bloc countries at that time.

In advance of our trip to Berlin for Transmediale, I want to consider some contemporary boundaries and how they manifest.

What (if anything) might contemporary boundaries be symbolic manifestations of?

A couple of months ago I saved a link to a ‘Virtual Berlin Wall’ project but now that I return to the link it directs me to the ‘Google’ web search home page – this anomaly takes this blog post off at a tangent…

Virtual Berlin wall launched to commemorate walls http://tinyurl.com/ydl2oqp 3:47 AM Nov 9th from web

There are three possible reasons for this unexpected outcome:

1. – it is simply a dead link and ‘Google’ is the ‘in browser’ default
2. – this is a smartass conceptual art joke
3. – the ‘error’ is some kind of freudigital slip

I choose to believe all three of the above reasons to be correct.

Google is a kind of global digital interfacing membrane, which applies top secret filtration algorithms in order to control, administer and record the exchange of information on the internet.

Today’s withdrawal of Google from the Chinese ‘market’ on grounds of ongoing state censorship is seen by political commentators as a gesture towards a western democratic moral and political highground.

Despite Google’s seeming omnipotence, the vast majority of internet users seem to perceive Google, less as an oppressive ‘wall’ rather, as a benevolent ‘gateway’. For many, Google is a symbol of free, easy access to information and, as such, Google is more analogous in popular consciousness to the Brandenburg Gate than the Berlin Wall.

Brandenburg Gate image used under licence from Wikimedia Commons.

Links:

Google and China: a cynical ploy or a principled stand?Charlie Beckett, Director POLIS

Google and China: What’s the real story, and where does it go from here? – Mac Slocum. O’Reilly Radar

Making – Strategy

Prototype intuitive interface / proof of concept / instrument – successful?

Plan

Original drawing identified basic principle:

  1. Twist pencil in tape reel
  2. This action twists potentiometer
  3. potentiometer relays DATA
  4. Arduino board receives ANALOG data in 0 –> 5V
  5. Arduino script translates ANALOG voltage to DIGITAL serial data
  6. Serial data transfered via USB lead into MAXmsp patch
  7. MAXmsp patch interprets data allowing user to triggers samples

proto - type

Although I considered different configurations (eg. geering) the simplest approach for this test was to directly engage the modified ‘continuous’ potentiometer with the pen lid through the cassette reel.

potentiometer to tape

AND this just felt really ‘RIGHT’!

When building the MAX patch I attempted to identify 3 ‘triggers’ that I wanted to isolate from the user input data:

  • twisting
  • not twisting
  • twisting fast

ConditionalI basically attempted to identify these 3 triggers using the METRO object to periodically (every 1 sec and every 200 milliseconds) read data coming into MAXmsp and then, using conditional statements eg. pictured, compare the previous two values to identify the rate of change.

I am aware that this is in no way the most sophisticated way of using MAX to interpret this rate-of-change / acceleration data but, this was the fastest way for me to prototype this and get a result with my fledgling knowledge of MAX.

Working on this piece has totally re-affirmed this statement:

simpler interface = more complex interaction

It is fascinating how much data is contained within such a simple single twisting action and there are really huge ramifications for my future ‘user interface’ work if I can develop my skills at using code and software to interpret and translate this data.

Download my ‘Echoes’ MAX patch here.

- PLEASE COMMENT! -

Analog to Digital

Cheap potentiometer only does part of a turn – need ‘continuous’ turn to realise piece.
Went shopping for continuous potentiometer – consumer approach – but was informed that such components don’t tend to be stocked – insufficient demand.

Assumption – scarcity means that ‘continuous potentiometer’ requires ’special’ technical facility.

Jamie – probably just something in there stopping it going all the way round…

take apart

Take apart – discovery – OBVIOUS! – ‘afraid to look under the hood’

Now – Arduino needs to communicate with MAX over SERIAL port – Short answer – NOT WORKING!

OSC_Dirty_Hack

Joey provides workaround in shape ov OpenFrameworks application (have the feeling I’ll be using O.F. a lot more…)

Turning & Sound

During our DOING session 001 we did an initial experiment inputting analogue data into MAX using Arduino + Potentiometer.

Question – why? what is the relationship between ‘turning’ and ’sound’? What is interesting about this?

Sound and Turning

  • potentiometers (pots) used on mixing desks

where else? – reels, wheels, disks (cassette –> music, cars –> noise

MixingDeskpotentiometer

This hand gesture is familiar, a kind of latent physical memory.

  • ad-hoc (twist ov the thumb, pen/pencil)
  • improvised, inventive, intuitive
  • twisting hand gesture directly linked to malfunction of cassette tape
  • not CONTRIVED PHYSICALITY

Tools for Artists

…absence of a higher level interfacing tool creates a barrier to participation… (previous post)

Corkscrew_web

The basic corkscrew twists into a cork and (with a bit of umph!) the cork is pulled out of the bottle, releasing wine.  The Wing Corkscrew (above) does exactly the same thing, but assisted by two levers either side, (mechanical advantage) our cork is removed with a little less umph!

Does my glass of wine taste different – better or worse – as a result of the bottle being opened with mechanical assistance?

Tools:

  • Humans are animals that use tools.
  • Tools extend capability.
  • Extension is technology is (digital) media. McLuhan.

Interfaces:

  • Between-ness.
  • Physical Interface / Software Interface / Human Computer Interface
  • HANDS-ON?

Instruments:

  • Precision
  • Potentially CREATIVE tools…
  • Arduino (electronics, code, physics, physicality)
  • MAXmsp (graphical, GUI, programming)
  • OpenFrameworks (C++, more lower level code)

BUT, let’s remain focused on the wine (and how to get at it) not the corkscrew, crowbar, cannon or wateva…

Incidental Archive

32 Archive

During 2002/03 I collected magnetic tape from streets and trees – eventually amassing an archive 50+ individual pieces.  I began painstakingly re-assembling these – putting the old magnetic tape into new cassettes.  These were never shown / performed or shared since I could not think of a satisfactory way to play these again….

cassette #5

Simply putting the tapes into a tape player risks potential damage.

and yet…

A digital ‘press-button’ archive is boring and unsuitable – and the sanitisied digital files seperation the end user from the original concept and labour involved in re-assembling tapes.

At the time I had the feeling that what was needed was:

  • New ‘device’ – instrument – TANGIBILITY
  • sound has been detached – needs hands-on care to make audible again
  • facility for random access – database? – mixin and new interpretation ov these samples…

Evidences of Law

Series of photographs and videos made whilst walking between Newcastle train station and Culture Lab to document every occasion where I saw ‘evidence’ of ‘law’ (prep for our Theoretical Foundations ‘Media Theory’ seminar.)

At an extremely simplistic level, I wanted to formally begin explicitly investigating ‘law’ as a ‘medium’ within my Digital Media studies at Culture Lab.

Used my laptop to play back the images and videos in sequence as a slideshow presentation.  A kind of monotonous (and humourous) rhythm was established – pressing the spacebar and instinctively speaking words and phrases to accompany the photos – kind of spontaneous performance.

Uploaded the photos as an .MOV  file to YouTube and then added a ’subtitle track’ to reproduce/share the experience of the presentation.

Subtitling – Why would I do this?

Demonstrate a NEW, ABSOLUTE INTRINSIC reading of the signage and architecture of the city?  No.

But, street signage (for example) demonstrates very well, one of many levels of conceptual ‘encoding’ and ‘decoding’ taking place in people’s heads, unconsciously, all of the time.  And if we are in any doubt regarding how signage should be interpreted, we have a text – The Highway Code – to ensure that signage is interpreted (decoded) with consistency.  Interpretation is as important as the embedded message itself.

(Below – amusing comedy sketch on subtext…)

A fascinating aspect of Youtube (and the web2.0 phenomena as a whole) is the commenting function, which allows a kind of subjective subtitling to develop – people are enabled to share own perspective – interpretation democratised?

Subtext – add your thoughts to video

The subtitles in evidences_of_law.mov are a kind of subjective ‘sub-text‘ which, inevitably, intrudes and influences – imposing a kind of narrative on the viewer’s ‘reading’ of the images.

Whilst looking for a suitable YouTube subtitling tool I stumbled across Overstream – an application which is designed specifically so that individuals can impose their own reading over an online video.  Now, not only can we have foreign language subtitles (making a film accessible to broader audiences) and directors commentaries (sharing insight into a creative process) but also subjective commentaries and alternative readings – all within ‘mainstream media.’

I was emboldened to attempt to develop my own subtitle file following a presentation given by Pete Hindle at the Datarama event in October.  You can read all about that here.

Adding subtitles was a surprisingly technical affair – I found out that it is possible to embed a subtitle or caption track into a YouTube video by making an *.srt file.  This is basically a piece of code which is read in three components:

(1) number in the sequence
(2) timecode in/out
(3) text to be displayed

SRT FILE

The file can be downloaded here:evidence_trial5.srt

Typing this ‘code’ by hand (even with copy and paste) was 

laborious
, tedious and 
frustrating
.  It took forever.  If I did something wrong then the *srt. file wouldn’t load to YouTube.  And if I needed to add something in then the number of all the subsequent entries had to be changed.  It was painful going back and forth lining up the times with the appropriate frames.

Through this exercise it is much clearer to me why we might use tools (software, interfaces…) to automate this kind of laborious coding task.  I would have given up if I had not been really determined to share the file.

Only a minority of individuals with a certain level of technical knowledge would put this amount of effort into subtitling a YouTube video so, the absence of a higher level interfacing tool (subtitling software) creates a barrier to participation.

Below: notes from Jamie Allen Media Theory session (4-11-2009) on MRes. research WIKI.

http://www.fromconcentrate.net/WIKI/doku.php?id=04-11-2009

(Has everyone seen John Carpenter’s ‘They Live’ (1988)?…)

Transmediale 2010 #1

diagram_web

Last week Ewelina sent an open invitation to our Digital Media mailing list:

Hey ***
I was wondering if any of you would like to go to Transmediale Festival(?)

Lot’s of people expressed an interest, so we held a meeting after class on the Wednesday and about 20 people came.  All of the people wanted to go to Transmediale 2010 and liked the idea of working together.  At the same time, a nagging question remained:

Q.  How do we co-ordinate loads of positive energy, valuable ideas and different approaches without wasting loads of valuable time and energy in the process?

Rather than begin planning for some kind of ’school-trip’ we set about establishing some guiding principles:

What do we agree on? AND What are the barriers?

We identified the following:
DATES: some people will want to flexible so, good idea to suggest dates and let people book
TRAVEL: best if people book flights, accom individually
ACCOMODATION: desirable to stay together – group hostel, student halls, apartments etc.
PARTICIPATION: Identify two-day activity period during Transmediale that CultureLabbers can plan the rest of their trip around.
MONEY: This was really the only barrier for people attending.

We’re now trying to co-ordinate our efforts through the Digital Media course wiki: http://dm.ncl.ac.uk/wiki/index.php/Transmediale_Festival_2010

del.icio.us