For my computational media final project I wanted to make a game about Cambridge Analytica and about the current cultural moment in data science and AI. I have seen the rise of the imperative to make one’s identity known and intelligible for collection online by various state and corporate actors as a sinister reach to further institutional control over the everyday, but I also think that the practice of psychographics is a silly pseudoscience. I’ve also recently been interested in games that have an anti-interface with the simplest possible values (especially cookie clicker games but also internet quizzes and ClickHole ClickVentures) so I wanted to limit the interface to just the fewest possible elements.
You can play the game here.
And see the code here. It is run via express server serving a p5 sketch. All the interactive elements are dom buttons that “switch on or off” different arrays of text written to a p5 canvas. Note some buttons are confusingly labeled.
The song is Mirandolina by Burnier e Cartier (1974).
One of my favorite word games to play is to try to suss out the grey areas of meaning with seemingly well established words (e.g. what foot angle and distance of leaving the floor differentiates a ‘tap’ from a ‘step’, in what ways are the aesthetic associations of a crypt different from those of a mausoleum). Kind of a useless semiotics examing the edge case value of a word (how much mist on a misty morning differentiates a bog from a swamp).
Recently I’ve also had psychographics, Cambridge Analytica, and the ways in which social media and internet usage data are being used to group, differentiate, and make the global human population intelligible to various governmental and corporate actors.
Combining these ideas I’d like to make a game focalized through the perspective of a machine learning algorithm tasked with assigning personality and demographic profiles to users based on those users’ associated word choices (i.e. a user decides that a bog has 85% more mist than a swamp on a cold bracing morning in the early spring -> that user is open to trying new things and likely lives in a large cosmopolitan city within the Eurozone).
The game interface would be half personality quiz and half Clickhole-style-choose-your-own-adventure. The aesthetic I’m looking to create calls on clickclickclick.click and Human Resource Machine much more so than AI fearventures like I Have No Mouth But I Must Scream. My end goal, other than to create an amusing and engaging experience, is to make intelligible the ways in which machine learning is deployed to group and assign identities and to hint at methods of real world digital subversion.
Inspired by the near extinct website guestbook and completely extinct methods of phone phreaking, I wanted to make something that felt as unfinished and wide open with potential as the “old” web of 1992 – 2001.
Please participate: https://tinyurl.com/y7tvrusf
Communication between users in this space is possible but only through “hacks” of the intended use. There is no security and everything can be seen.
At this point I have gotten the basic Google home API working on my raspberry pi and have started manipulating the methods of interaction (changing the trigger word, changing the voices) and have started to work on building a specific Google home Action. Still to do is build the haunted dollhouse enclosure. Since the basic first interaction I want users to have with the haunted doll is to knock on the dollhouse door, I wanted to first set up a basic knock and open circuit.
The piezo would be connected to the inside of the door and the motor underneath or above the door, rotating an axle that controls the door hinges. I am not sure if a servo is best for this or if there is a better motor for this application. The piezo would detect the knock (any kind of knock should do) and trigger the motor to open the door.
Beyond this very basic interaction I have a few different ideas. The aesthetics and interaction in my mind are beginning to push into Zoltar territory, so I was thinking of adding a thermal printer printout of whatever fortune or advice the doll is giving. Additionally I would like to replace the trigger word with the knock, i.e. to connect the arduino to the pi and trigger the pi to start listening for a question once a user has knocked on the door. Additionally I would like to incorporate some movement in the doll, that was the biggest feedback that I received at user testing. I think an easy start would be to put two LEDs in the eyes so that the eyes light up. From there, with time and resources I could add additional movements, such as a head or arm movement.
I really wanted to work with the twitter API and to show data in real time. I started working with the word cheese just to test it out and I ended up sticking with it throughout the process.
You can observer cheeses here.
And see code here.
Recently I’ve been thinking mostly – but somewhat disjointedly – about haunted dolls as relational to AI and various societal-level fears. The doll as feminine artifact rendered creepy by autonomous movement and malicious intent is drawing parallels for me to visions of consumer-level AI – which frequently is embodied feminized labor – disrupting human civilization, both on the level of job displacement and as genocidal overlords. Many questions arise. At what depth of the uncanny valley does misogyny lie? On what level are we as a society afraid that factory workers and truck drivers are being emasculated by machines and at what level are we genuinely concerned about joblessness and the negative externalities of creative destruction? How much are baseless fears of AI – akin to fear of paranormal and unknown – tangled in with worthwhile critiques and concerns, and how should AI policy and practice be formulated taking this intermingling into consideration?
This is a puzzle that I want to play with so I’ve been wanting to make some kind of “haunted doll” and to put inside it a camera with face tracking and servos that allow for head movement to do the kind of “Scooby Doo” project but then also put in a microphone and speaker connected to a Raspberry Pi running the Amazon Alexa API. Voila, a creepy Amazon Echo.
I’m in the middle of changing hosts for my blog so I will keep this entry short. I made a game involving clicking DOM buttons… a lot.
You can see the code for the game here.
And you can play the game here.
For our midterm Ridwan and I thought it would be really funny to make a machine that claims to give a high five but actually fakes you out every time.
Aesthetically it reminds me a bit of the toilet hand from Zelda.
Inside it has an arduino, two metal gear servos on a pan/tilt bracket meant for camera tracking controlling the hand, an HC- SR04 distance sensor, and an LCD screen. Ridwan found a box template for a laser cutter and we laser cut the enclosure out of cardboard, making the necessary modifications for our sensor, hand, and screen.
We had quite a bit of trouble with powering servos and actually destroyed two servos by putting too high a voltage across them.
I overhauled some of the code from my project last week so that events would only happen once so that the player would not experience an event more than once. I’d like to implement some further tracking so that the narrative would change depending on what the user had done previously but I didn’t finish that in a playable way.
You can see the improved code here.
I put a playable version of it here.
We’d like to thank Jason, Rick, and most importantly of all, Archibald! Thanks to bensound.com for the use of his music.