This week’s blog post is brought to you by Food House and GameCity.
I’ve just returned from the wonderful GameCity festival in Nottingham. Part of my contribution to the festival was this short talk on hacking perception, hypnosis, and illusions. If you’ve been following SoundSelf for a while, we go into some detail in what makes the experience get under your skin. For those of you who haven’t been following SoundSelf, this video is a lovely and brief introduction to the project.
(25 minutes, plus conversation at end)
PART 1 – HISTORY
PART 2 – ILLUSIONS
PART 3 – THE PERCEPTION OF SELF
PART 4 – HOW WE HACK IT
Since Burning Man this year, most of my SoundSelf time has been spent showing SoundSelf, describing SoundSelf, and developing new ideas. We’ve been preparing our Kickstarter rewards, showing the game at Indiecade, and in the coming two weeks we’ll be at GameCity (Nottingham),Gamercamp (Toronto) and MineCon (Orlando).
But while software development has slowed down, research has not. Here are a few of things that have excited and inspired me in the last few weeks:
I discovered this album through a Radiolab short devoted to it. I absolutely recommend checking it out.
Trance states are accessed through repetition. This is why many meditation techniques include a mantra, it’s why trance music (and music by definition) is based on repetition repetition, it’s why SoundSelf uses chanting (repeated voice) as it’s controller, and it’s why you see delusional people repeating the same words again and again.
Dawn of Midi’s album is as much a tribute to repetition as Ravel’s Bolero. But that repetitive structure is reduced to an elemental focus – the beat.
As a student of trance, of particular interest to me is the way the different beats work together. In stark contrast with shamanic drumming, there’s no global tempo in Dysnomia. Often three or four percussive patterns will be in play at the same time, each instrument following its own distinct beat. I found my mind shifting between the different instruments: as I rested my mind on a new rhythm, a formerly dominant rhythm would phase in and out of synchronization and syncopation.
Listening to this album has given me a new frame of reference for thinking about rhythm (and repetition at all, for that matter) as a tool for trance induction in SoundSelf.
The LACMA has a retrospective right now for light artist James Turrell. If you’re in LA… DO NOT MISS IT!
Most of Turrell’s pieces occupy an entire room, as they are designed to envelop participants in unique and sometimes illusory experiences of light.
The pieces are difficult to describe because they are not symbolic in nature. They are unique experiences of light and perception, as indescribably experiential as floating in a sense deprivation chamber is.
Turrell’s current project is (and has been for the past twenty-something years) converting a volcanic crater into a sort of modern-day Stone Henge: temples paying tribute to the sun, the sky, and human perception at dance with the cosmos.
The Singularity Project is artist David Tamargo’s entry in the Indiecade / Oculus VR Jam. It takes abstract fine art and explodes it into kinetic 3D. If you’re into SoundSelf, you’ll be into this.
I really love it when art makes me feel small and puts my life into geological scale. This is a to-scale puppet of a prehistoric ichthyosaur that once lived in the now dried lake bed that plays host to the Burning Man festival. And it’s pregnant.
Daniel Kahneman puts his long career of brain research into this deep but accessible model that describes the brain as simultaneously working in two radically different ways: fast and slow. It’s a wonderful read for anybody interested in biases and learning.
A short book with a deep and narrow focus: Trance. How it happens, the flavors it comes in, how to control it, and how it is often used irresponsibly.
Evan Balster here. I’m SoundSelf’s back-end engineer and co-designer. Helping Robin to understand new mathematical concepts that play into the design and development of the program is a big part of my job, and today I’ll be doing some of that explanation for you. Consider this the first installment of…
What you see below is the beginning of a new visual generative system for SoundSelf. Click it to visit our interactive ShaderToy page.
This is the default formulation of the shader, which can be manipulated with the mouse.
It’s loosely based on a concept called Cymatics, and computed as a sum of sines much like our existing harmonograph system. Instead of geometry, however, the sum computes an intensity value per pixel which is represented as color.
Move the ring of control nodes near the center for more regular, intense shapes.
The sine waves being summed in this demonstration are functions of distance from a point. Like ripples in a pond, they spread out and weaken. As more are added in regular or irregular arrangements we can get complex shapes as seen above. The default arrangement is a ring of control points arranged using the golden ratio.
We’re also experimenting with other wave functions which may offer more possibilities, as seen here:
This uses a combination of three circular ripples, a horizontal “bar” ripple and a vertical “bar” ripple. Symmetric patterns can often resemble faces.
The shader above was produced in a short time yesterday after a long discussion about what emergent system of visuals we should explore after the harmonograph. Emergence is a concept that is fundamental to the creation of SoundSelf; it is the phenomenon of complex behaviors or manifestations arising from simple rules that interact. The simpler the rules, and the more complex the manifestations, the deeper the emergence runs.
Because the harmonograph is deeply emergent, we very frequently see things in SoundSelf that we’ve never seen before. Interesting, sometimes beautiful forms that were not intentfully designed into the system are a common occurrence. Every oscillation has the power to transform the entire harmonograph, and with many tens of these at play the range of possibilities is immense.
Cymatics is one of the systems we discussed. In essence, if sand or dust is placed on a plate and that plate is subjected to harmonic vibrations, the plate will form standing waves as a function of the vibration and ts overlapping reflections. The sand will pile into intriguing patterns of points and lines which represent areas of stability, which differ based on the plate’s shape and size and the vibration’s source and frequency.
For a very simple home demonstration, fill a wine glass with water, near to the brim, dip your finger in the water and slide it across the lip to make the glass “sing”. A nearly full glass produces a deep sound and standing waves can be seen in the water, rotating in time with the vibration source (your finger).
This model, unlike the others, simulates the reflection patterns seen in square-plate cymatics. However, it’s expensive.
My initial evaluation of this system was discouraging — the actual forces and behaviors at work are prohibitively complex. However, the underlying concepts of waves and reflections, cancellation and stability are somewhat simpler. Distilling this process to a more representational method without concern for physical realism gives rise to a number of possibilities for simple, emergent systems. It would be accurate to say these are “inspired by cymatics” more than anything.
The experiments above are just scratching the surface of what can be done here. We’ll see what else we can find in this peculiar world of ripples. And of course, we’ll make sure there’s far, far more to be found in SoundSelf through the power of emergence.
Last month we brought a unique installation version of SoundSelf to [url=burningman.org]Burning Man[/url]. Making this unusual architectural iteration of our video game took a lot of work, a lot of sacrifice, and was only possible because our generous Kickstarter backers pushed us $7,000 past our goal.
Check out the rest of the loving messages visitors left in our Guest Book on our Facebook Page!
Photos by Dimitri Kouri and Michael Nusbaum.
For the first time since our Kickstarter, you can now pre-order or buy alpha access to SoundSelf!
Gone is the Windows-only prototype of yore! We’ve still got a long way to go, but this is the beginning of something special that’s already exceeding my expectations. Here’s what’s new from the KickStarter prototype:
- COMPLETELY overhauled music, COMPLETELY overhauled imagery.
- Much more intimate reaction to your voice. It feels more alive now than it ever has before!
- Oculus Rift support!
- More lightweight – won’t necessarily melt your machine – not literally anyway!
- Mac and Linux support!
We’re also migrating our forums to Steam! So come say hi on our Greenlight community page.