Noise 2014 & Robot Talk

Few updates over the past couple of weeks: Firstly the robot is set for a string of UK exhibitions I will not release information on this until I have proper confirmation from the institutions. Secondly the installation received an outstanding award from the Noise 2014 festival curators. (1.1)

1.1

Finally I had a really great time taking the installation to show the Bridlington Beavers, Cubs and Scouts. They engaged really well with the project and asked some interesting questions. (2.2)

2.2

D&AD Awards Show (London)

Photo Credit: Kevin Joseph @ Response London

Photo Credit: Kevin Joseph @ Response London

 Photo Credit: Kevin Joseph @ Response London

Photo Credit: Kevin Joseph @ Response London

I really enjoyed been at the opening night of the D&AD awards and It was very humbling to have my work picked for the front cover of the D&AD awards show website. 

The robot functioned amazing well throughout the whole day, running for around a period of approx 10 hours (4 of them totally unmanned) without any issues at all. This is the longest time I have allowed the robot to be active for. I really enjoyed seeing how people interacted with the project again after a week or so off from exhibiting it. In addition to this I also received the Huddersfield university: Chancellors award for outstanding performance (Professor Sir Patrick Stewart), which I am honoured to have been chosen for.  'insert girly scream' : massive fan of Star Trek and X-men..well all of Patrick Stewarts films. 

http://www-old.hud.ac.uk/news/2014/july/chancellorsprizeforoutstandingachievement.php

My final major degree project: Actuality and Artificiality. from carl on Vimeo.

Final Degree Show

Final Degree Show 2014: 13.06.14

I am very pleased to say that the installation functioned very well throughout the final show, running for a period of around 4 hours without any issues at all. It was a great experience seeing people interact with the project: One of the main factors that stood out, was peoples reaction to first seeing the project. It was great to see people approach the installation put there face close up to the robot for a better look but reel in shock and surprise when the robot reacted to this situation. Another interesting phenomena was peoples inability to think of what to say to the robot to start the conversation, I found this really interesting and will continue to explore this area.

I am massively happy with how people got involved with the installation, being my first time ever doing an event like this was rather nerve racking, but most people seemed to want to interact with the project which made the situation a little easier for me and I really enjoyed taking part in it.
I am also very pleased to say that I was awarded the Professor Paul Wells award for outstanding achievement in the field of animation theory, which was really one of the highlights of my University experience so far.

Photo by: Rachel J Milner

Photo by: Rachel J Milner

Name: Carl Strathearn

(First Class BA-Hons) Multimedia Design

Title: Actuality and Artificiality

www.Strathearnmultimedia.co.uk

This is my personal blog describing the processes used for my final year Multimedia Design Project. I have kept a weekly log 'sessions' along with videos and pictures of the build including an in-depth analysis of each stage of the project. In order to achieve a comprehensive log I implemented Gibbs (1988) model of reflective practise, to help improve and maintain a high standard of work via critically analysing and evaluating each session.

The title of my final year Multimedia Design project (Actuality and Artificiality) is an adaptation of the postmodernist philosopher Jean Baudrillard’s ideology, Simulacra and Simulation: Simulacra as object and Simulation as process. The objective of the project was to combine the disciplines of: Processing ‘Kinect’, Arduino, Applescript and Physical Robotics to create a machine that could simulate intelligence, respond to its environment, interact with people and effectively express human characteristics and emotions.

The model for this character is based on Marvin from the television series - The Hitchhikers Guide to the Galaxy: who was programed with a ‘genuine people personality’ - emulating human emotions. The concept that a machine could operate outside the parameters of its programed symbolic order (Apparently random recurrent behaviour in a simple deterministic system) and evolve into a new entity, is one that has always fascinated me. I wanted to explore this ideology further and create an interactive installation based on this idea. The project utilises Weizenbaum’s (1966), ‘Eliza’ or chat-bot framework (Keyboard Interaction), which I adapted to create the personality of the robot, this script is then outputted to Applescripts voice function and the robots integrated speaker system enabling it to talk. The robot can track movement using an Xbox Kinect module and is controlled autonomously through its programming framework.  

I spent the first two years at University researching and developing my skills in the fields of: programming, animation and philosophy, so in my final year I wanted to combine all of these elements to create something that was innovative, progressive and different to what these processes are typically used for. At college I studied Psychology, Sociology and Social Welfare so the progression to Multimedia was not a straight forward one. However, I feel that I was able to adapt the methodical approaches I learnt at college into my current work. I am always interested in developing my skills further and getting involved in different projects, as a mature student I take my work seriously and always aim to achieve the highest possible standard of outcome. 

Facebook: https://www.facebook.com/CarlStrathearnMultimediaDesign

Philosophy: Actuality and Artificiality // Basis of my Special Study

SINCE THE FIRST HUMANOID ROBOT GRACED THE SILVER SCREEN IN METROPOLIS (1927). THE MECHANOID AS A PSYCHOTIC, MALFUNCTIONING ICON WAS BORN. THE IDEOLOGY THAT A MECHANICAL CONSTRUCT MAY FUNCTION OUTSIDE OF ITS SYMBOLIC ORDER & EVOLVE INTO A NEW ENTITY IS ONE THAT HAS BEEN REPLICATED IN FILM & LITERATURE EVER SINCE. BUT IS THIS PHENOMENA PLAUSIBLE OR MERELY CONFINED TO THE REALMS OF SCIENCE FICTION?

The branch of A.I philosophy that deals with the creation of an artificial consciousness is called ‘Cognitive Science’. It endeavours to create a synthetic brain, which is capable of individual thought and process; the predominant model of this construct is the human mind. However, we are very far away from achieving this goal, the most technologically advanced computers and systems are equivalent in intelligence to insects. Searle (1971) in his experiment ‘The Chinese room’ demonstrates that seemingly complex symbolic strings can be mimicked without understanding the meaning of the symbol. (An example of this may be a Chimpanzee that has been taught sign language, even though the Chimp and replicate certain symbols and even form sentences / strings: The Chimp has no knowledge of the meaning of those individual symbols). Knowing the limits of today’s technology means we have to conceptualise that in the future these hurdles may be jumped and true A.I created. So.. how could a program or machine operate outside of its symbolic order, one possible answer may lie in the study of chaos theory.

Chaos theory is becoming more applied in the field of science as our understanding of its core concepts progress: for example a system based on chaos theory is used to measure turbulence on aeroplanes and defining previously un-definable objects in fractal geometry. Chaos theory dictates the possibility of, apparently random recurrent behaviour within a simple deterministic system. However, this is a massive stretch of the imagination and although not entirely impossible very, very improbable. This opens up another door of intrigue, why do we accept the concept of the malfunctioning robot as a new entity so easily.

In Stephen Spielberg’s 2001 adaption of Kubricks 1970 script ‘Artificial Intelligence’ the lead character, a robot named David is brought into existence to replace a husband and wife’s unwell son ‘Martin’ who is in a coma. David is programed to express emotion and make attachments with humans. However, when Martin the son comes out of his coma and returns to the family things quickly escalate. In a scene set at the dinner table Martin is eating his food and David is sat mimicking eating from an empty plate, Martin then provokes David by eating with his mouth open and taunting him. In response David picks up some food from Martins plate and starts eating, they both keep eating and taunting each other despite direct orders from the mother and farther, this results in David braking down. It is possible to hypothesise that the reason for David braking protocol and eating human food that could potentially destroy him was purely driven by desire in the form of the unrestricted, underdeveloped super ego, underlying the symbolic order wanting to be human, equally loved and accepted by the family. 

However, I suggest that the robot as a psychotic malfunctioning mechanical symbol is not the most terrifying phenomena. It is the fact that the machine as an object has become more 'human' than a mere mechanical construct. To quickly conclude, the possibility of a robot operating outside of its symbolic order is not entirely impossible but highly unlikely. Half a century of research into ‘A.I’ has not lived up to initial expectations; this is due to modern A.I been founded on a classical symbolic system that is fundamentally flawed.

   

Stage (20) Week Commencing (19/05/14)
Week 32

Final Reflection (Sessions Ends 23.05.14)


:This is going to be my last entry concerning the reflective aspect of the blog, however I will continue to post any further developments up to the final degree show. 

To start this session I would like to reflect on the project as a whole, analyzing key elements and factors that cropped up both during the developmental and production stages of the build.

Application

One of the major concepts of this project concerns is it's future application outside of the gallery or exhibition space. I believe that the build would be suitably placed inside a museum setting, the Eliza script could be adapted to emulate the personality of any person in history and the data base could hold unique and in-depth information regarding that individual. This concept would add an extra dimension to museum displays: by having life like animatronic elements that can not only interact with people but respond to unique questions and track and follow peoples movement may bring museam displays to life. The current framework could also be improved via implementing voice recognition technology instead of a keyboard interface, this may add further realism to museum displays, but further research into this proposition is required.


Time

Time has always been an important factor during this project, with family and work obligations my natural studying or building regime is between 8 – 1 o’clock at night. This of course was an element of the time scaling that was out of my hands and is something that had to be worked into and around the project. As the final hand-in for the project was Thurs 22nd of May, I asked myself the question what else could I have achieved in this time-frame, what did I set out to achieve that i didn't and what could I have done differently.

What else could I have achieved in the time frame ?

With the time-frame for the project having to be put on hold for 8 weeks during my dissertation module coupled with student finance issues and personal obligations. I feel that it was hard to get back on track and keep with the original time scale, so the project did suffer. However, alot was achieved within this time frame, the results of which met the standards and primary objectives I set at the start of the project.

What did I not achieve that I would of liked to ?

One of the key aspects that I really would have liked to of expanded on was the use a of global referencing/tracking system. The idea was to create a tracking system that could identify people at a distance and track their moment, then when they moved closer to the project the robot would enter a new mode that would be more engaging and would say hello or ask a question, then on final approach would go into its normal functioning. This was not achieved because of time issues concerning learning how to implement a complex tracking system into the project. The technical ability required to create such a system in the short time frame is out of my current range of abilities and even though I did research and find some useful blogs and videos I just did not have the time to sit down and learn the processes thoroughly enough to use them effectively.

What could I have done Differently / Additionally ?

If I had the option of starting the project over again, I would have certainly spent more time on the aesthetical side of the project. One of the main issues I had with the build is that some parts of it look rough e.g the milliput and mechano elements. I feel that if I had of taken a different approach and tested different materials such as themoplast instead of milliput and hand made aluminum brackets instead of using steel mechano sections that a higher standard of finish may have been achieved.

A further idea concerned creating a torso with working arms and claws, at the start of the project I purchased a robotic arm kit that came with aluminum servo brackets and a claw. I believe these would have been perfectly suited for creating the mid to upper torso for the robot. However this idea was not pursued due to issues with time and further costings.

Ongoing Issues

An on-going Issue with the project concerns maintaining the robot, I found out that if left to stand for more than a few days without careful maintenance the different mechanisms can stick or cease up. This is still an issues and is a process that has to be continued until the problem is resolved.

A further key issue concerns using cheap servos that I had shipped in from china, these are extremely temperamental and easily burnt out or stick during operation. The reason for buying cheap servos was on-going financial issues with student finance, I feel that this was unavoidable and I did everything I could at the time to resolve these issues. However the servos still remain part of the robot and are still burning out and sticking. Daily testing and maintenance appears to be the only way of ensuring these motors run efficiently.

Philosophy  

Although I spent alot of time researching the philosophy of 'A.I' from Descartes to Chomsky, I feel that I did not demonstrate these ideologies enough through-out the project. Writing a 2,500 word research study is not the same as been able to creatively express such views to a wide audience. However, I hope when it comes to the final show I will be able to strengthen some of those aspects by engaging people face to face and openly discussing these ideologies.


..............................................................................................................................................................
Final Weeks Session

Description

This weeks session is focused on the final phase of the project before hand-in. The session started via filming the robot in action, I set up in the dining room and just tried to get the robot to run a few simple phases like following objects and speaking a few phrases (1.1). This worked really well and in review I decided to leave the footage raw and unedited, I choose the tune Nannou by Aphex Twin for the video because it has been one of the pieces of music I have played the most thought the project. (1.2). However, I am still having power issues when it comes to running all the servos off the one Arduino board so things like the lip servos did not have enough energy to run at the same time as the rest of the servos. I have resolved this issue via getting a higher amplitude power supply at a customized 6v 4A unit but I am having to wait for that to be shipped from overseas, hopefully these elements will be all working together by the time of the final show.

I then tried to get some quicker more snappier shots of the project by filming outside. However, there was issues with the footage`;it was a busy day and I was getting alot of audio interference from people walking and talking along the headland, high winds, seagulls and general car noises (1.3 - Unedited). I also tried to film against the white wall of the cottage but i was having issues with the focus on the camera and I am not sure if it was due to light reflecting off the surface of the wall. These edits where never made into a video because of issues with ever depleting time scehdule before hand-in, however I will include them in this blog for the sake of referencing that i did experiment using multiple approaches during the final filming stages. (1.4) (1.5)

Feelings

I am very happy to have handed all of my work in, I feel this weeks session although it was rushed went well. I do not quite know how to feel about the final show at the moment, in terms of how the project will sit within the exhibition and what people will think about it. But I believe the robot is running and performing at that best it ever had done.

Evaluation

This session was an interesting experience, I had the pressure of trying to finish this project off and also the other modules and only having a day and night to film and edit a short video of the robot working. I only had a couple of hours sleep per night as I was trying to make sure everything was ok with what I was handing in, but then when you are tiered out you make silly mistakes so it would not surprise me if I get pulled up on a few errors here and there. I do not feel like the final rush of work was anything to do with poor planning, I believe its a normal part of the finishing stages of any large project 'final push'.

Analysis

The current stage of the build id say personally is at about 99% complete, all the elements now work and the new power adapter meaning the servos operate simultaneously. I only say 99% complete because I am still coming up with ideas and resisting the urge to tinker around with stuff.

Conclusion

In conclusion I am happy that I managed to hand in all the work I needed to hand in. I feel that alot of hard work has gone into this project and I would like to thank my family for giving me the time to get on with the project when I needed to especially in the building stages of the project that were normally quite messy and took over a lot of space. I also have my tutor to thank, without his help and time and demonstrating how different scripts could be implemented in the project I would not have been able to of achieved such a high standard of control over the robot.


Action Plan

The action plan is to have a break from work for a few days and spend it on the beach with my family and relaxing, I have my viva on the 30th so I need to plan the script for that using the research study. Then I will start thinking about how the installation will sit at the final degree show, and possibly further exhibitions.

Schematics 

(1.1)

(1.2)

(1.3)

 (1.4)

(1.5)

Stage (19) Week Commencing (12/05/14)

Week 31

Description

This session was an interesting one, firstly: I did not spend anytime out of Uni on the project this week as I have been so busy trying to get the special study module and the rest of my unifished modules sorted for thursdays hand-in.

On Monday I sent in my posters for the final show to be evaluated and I got advised on which was the most appropriate one. I also got an email from my lecturer saying that the problems with the tracking may be due to using the kinect skeleton library - we found in testing that sometimes the skeleton did not fully map onto a person if their legs where behind a desk or their arms in a funny position. So he sent me a code that basically gives you a set of values for the nearest pixel to the kinect sensor. This would mean that, it would be irrelevant if the kinect could not see certain body parts as it would just give a set of values for the nearest pixel to the sensor (which would be anyone standing closest to it) .

I also purchased a kinect stand but it was not up to scratch so I had to make my own using the bits that where worth having. I took the connectors off the top of the stand and used milliput to mould into the shape of a universal mounting plate. One it had dried I took my camera stand and mounted the kinect unit to the top of it so now I have a portable kinect unit that i can change the hight and position of easily which will hopefully come in handy when trying to get the best positional angle at the final degree show. 1.2

On Friday I got to spend some time with my tutor trying to iron out the tracking issues, and we got it nailed down to a tee !! then the laptop crashed and we lost all the code we had been working on and it was horrendous..not only did we lose the code we had been working on for 2 hours, but also blew up the neck servo for the y axis and when i got around to replacing and testing it out today I also discovered the right lip servo had also blown up at some point in the past week because it was working fine during the lip mechanism testing. However by working quickly we managed to get the x axis and mouth working together without any issues. We could not test the Y axis (neck u/d motor) because it had blown up. I have spent today getting things back on track I have the robot working on it's Y axis again and I pretty much have it all working spot on again. (1.1)

Feelings

This week has been a total rollercoaster !! it was so gutting to have had everything working so perfectly and the loose it all in a blink of an eye was very frustrating. On top of that I left trying to solve the same issues over again: loosing two servos and having to replace them.. (one was milliputted into the side of the top jaw servo so that had to be cut out with wire cutters and replaced) Was very frustrating.  This was down to maintenance issues, milliputting and permanently fixing servos means they cannot be tested effectively using a servo tester, it also makes cleaning the servos impossible) . However.. Considering all of these issue I have seen how well the project works as a complete set up, which was a great feeling.

Evaluation

This session was both soul destroying and successful... this is such a strange time and position to be in at the moment. The project is due in on Thursday and It's pretty much down to how much time I can get on the project and if I can see my lecturer one last time to iron out some of the script issues I've bee having. This is officially make or break time and I don't want to fail.. I want to get this project finished and working like it should. Careful maintenance is becoming such an important part of this project, I have been cleaning the base mechanism with a cue tip to keep all the dirt and oil build up that keeps accumulating and slowing down the movement and speed of the servo and oiling the eye and jaw mechanisms to keep the pressure off the servos.

Analysis

The current state of the project is not far off been fully finished, all this time and effort is about to have to stand on show and work repeatedly and efficiently for long periods of time. I cannot put into words how I feel sat at my laptop at this moment in time...

Conclusion

In conclusion the next few days are going to be spent doing work and trying to nail this thing down. I am exhausted and my brain feels like a sponge, in my head i have all three projects whizzing around and my mind keeps flicking on and off like static radio.. but I am so close to getting this project completed and working like I imagined it at very start of the year, so I'm going to give it my all. However, I am aware of all the problems iv'e had with this project and I'm worried that something may happen during the final show, the worst case scenario would be a servo blowing that wasn't easy to change out or friction on the eye mechanism causing the ball and socket joints pop out of their fittings potentially ruining the mechanism. So after hand-in week I will be testing every part of the robot for weaknesses and also running the systems for a couple of hours at a time to see how it works over long periods of time.

Action Plan

Work day and night, play inspirational music, drink coffee and red bull. ..

1.1

1.2