The “Clavilux 2000” is an interactive instrument for generative music visualization.

The setting of this installation consists of three parts: A digital piano with 88 keys and midi output, a computer running a vvvv patch and a vertical projection above the keyboard.

The visual concept of Clavilux 2000 is quite simple. For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and colour the way the particular key was stroke: The length and vertical position show the velocity, the stripe’s width reflects the length of each note.
By mapping the color wheel on the circle of fifths, the colours finally give the viewer and listener an impression of the harmonic relations. Notes belonging to one specific tonality always get colors from one specific area of the color wheel. Therefore each key gets it’s own color scheme and “wrong” notes stand out in contrasting colors. The more different tonalities a piece has, the more colorful the visualization will be.

Unlike most other visualized music, the visualization of Clavilux 2000 does not disappear when the music fades away. All stripes stay and overlap each other in an additive way, so at the end a kind of pattern remains – a summary of the music – which will be always unique. Since not only the notes played but also the interpretation of the piano player are influencing the outcome, visualizations for one single piece of music will vary, too. Therefore the stripes allow one to say something about the composition aswell as the specific performance: Which notes were played the most? Which were the loudest notes? Which range of the keys was played mostly? How harmonically constant was the music?

Furthermore the system allows the piano player to switch between the standart 2d view and an additional 3d view of the visualization while playing. Also the visibility of a background grid, as well as the „deepness“ of the 3d view can be adjusted with sliders on the piano.
The technical part was done with the visual programming language vvvv. The MIDI signals sent by the piano to the computer get processed in real time and directly transfered into the visualization of the Clavilux.

The Clavilux 2000 project was part of my 3rd semester at the Hochschule für Gestaltung Schwäbisch Gmünd and was supervised by Prof. Michael Götte and Veldana Sehic.

Clavilux
Clavilux
Clavilux
Clavilux
Clavilux

Clavilux
Claude Debussy’s Childrens Corner - Dr Gradus ad Parnassum (rendering)

Clavilux
Claude Debussy’s Childrens Corner - Dr Gradus ad Parnassum (3d view rendering)

Clavilux
Rimski-Korsakow’s Hummelflug (3d view rendering)

Project – Clavilux 2000


Year – 2009
Tags – HfG Schwäbisch Gmünd, interactive, Jonas's favourite, music, piano, vvvv
Comments & trackbacks
Philipp – July 1 12, 11:02 pm

Hey! Ne echt schöne Arbeit. Sehr ästhetisch.
Vor allem gefällt mir euer Ansatz, dass man die Spielweise von jedem Musiker sehen kann…

Congrats!

Philipp

Jawnypants – May 1 12, 8:59 pm

It looks very good and I am only wondering if it exists as an application that artists, composers and musicians could try out. I’m working with microtonal music and I would be interested to see how it is interpreted. I actually tried building such a thing in Max/MSP but it was too much processor drain…

Bola Sociology Design » Archives » Design+Tecnologia: Clavilux 2000 – March 15 10, 9:06 pm

[...] Clavilux 2000 é um piano digital que quando tocado, simultaneamente projeta uma composição visual colorida. Para cada nota, um novo elemento aparece na forma de uma linha, cuja dimensão, localização e cor correspondem a tecla e a maneira que ela foi tocada, criando uma espécie de processo sinestésico artificial. [...]

Bokmerka 9/52 | Oda Hveem – March 13 10, 11:53 pm

[...] interaktivt musikkvisualiseringsprosjekt gjort av Jonas Heuer i tredje semester på “Hochschule für Gestaltung Schwäbisch Gmünd”. Når ein trykker [...]

Interaktive Visualisierung von Musik – Das Philoblog – March 13 10, 8:50 am

[...] Instrument zur Visualisierung von Musik – am Klavier gespielt – entwickelt. Es heißt Clavilux2000 und wurde mit vvvv programmiert. Jede gespielte Note entspricht einem Streifen in der [...]

visual_audio | ryanmdschmidt – March 11 10, 12:24 am

[...] Interactive instrument for generative music visualization from Jonas Heuer. [...]

Burrull.com » Arxiu del Bloc » Clavilux 2000 – March 10 10, 12:34 am

[...] Clavilux 2000 [jonasheuer.de] is a subtle music visualization installation that represents the playing of sounds by way of a simultaneous animation that can be interpreted. [...]

Clavilux 2000 – An interactive instrument for generative music visualization by Jonas Heuer. | WeHeartData.org – March 9 10, 6:34 pm

[...] Learn more about this fantastic tool here Jonas Friedemann Heuer – portfolio – Clavilux 2000. [...]

Visualisation of music (installation) « Jayen’s bloggy woggie! – March 8 10, 10:12 pm

[...] Jonas Friedemann Heuer the creator of  the installation below has developed a contraption with visualization music from an electronic keyboard: [...]

Pablo Gonzalez Fernandez – March 8 10, 3:15 am

[...] CLAXILUX: UN TECLADO DE TODA LA VIDA PERO CON… ¡LUX! [...]

The Clavlilux 2000 « MICHAEL MCWATTERS – March 7 10, 6:58 pm

[...] The Clavilux 2000 is an interactive instrument for generative music visualization, which is able to generate a live visualization of any music played on a digital piano. [...]

Clavilux 2000 laat je zien wat je speelt | Freshgadgets.nl – March 7 10, 1:18 pm

[...] oosterbuur Jonas Friedeman Heuer komt met een bijzonder aardig project, Clavilux 2000 genaamd. Het betreft een digitaal keyboard dat [...]

Clavilux 2000 « Information Design at Penn – March 7 10, 2:22 am

[...] 2010 March 6 by Alyssa Clavilux 2000 is a subtle music visualization installation that represents the playing of sounds by way of a [...]

Clavilux 2000 – Generative Music Visualization Instrument | jmar – February 25 10, 4:27 am

[...] I really like these sound/music visualizations, anything that can unify the senses through visualization seems like a good idea to me. [...]

Visual notes for nerds | The smell of music – February 20 10, 10:49 pm

[...] Clavilux 2000 is an interactive instrument for generative music visualization  of any music played on a digital [...]

Fubiz.net – Clavilux 2000 Visualization – February 19 10, 2:56 pm

[...] Après la table musicale Noteput, voici Clavilux 2000 un instrument interactif intégrant une visualisation de la musique. Le tout est généré par le langage de programmation vvvv et l’objet se compose d’un piano de 88 touches et d’une projection verticale au-dessus du clavier. [...]

Weekly round-up: Old media memes, new media TV audiences, race + tech, and awesome uses of twitter | canarytrap.net – February 19 10, 9:20 am

[...] on the less political, more wonderful side of technological innovation, a simply gorgeous sound visualization project from Jonas Friedemann [...]

Clavilux 2000 | Interactive Music Visualization | A Design Mafia – February 18 10, 4:08 pm

[...] Source [...]

ELEBLOG - Clavilux 2000 – February 17 10, 7:50 pm

[...] 彼のWEBサイトにはたくさんの演奏後の写真やvvvvのパッチ(角度悪くてよくわからんのだけど)も載っていて面白い http://www.jonasheuer.de/index.php/clavilux-2000/ [...]

Claxilux by Jonus Heuer. via CreativeApplications — Some Random Dude – February 15 10, 10:34 pm

[...] Clavilux by Jonus Heuer. via CreativeApplications [...]

Planner Reads » Blog Archive » Clavilux 2000 [vvvv] – February 15 10, 7:30 pm

[...] For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and colour the way the particular key was stroke: The length and vertical position show the velocity, the stripe’s width reflects the length of each note. Furthermore the system allows the piano player to switch between the standart 2d view and an additional 3d view of the visualization while playing. Read more.. [...]

Furkan Tunalı v4 beta // Clavilux 2000 [vvvv] / – February 15 10, 4:19 pm

[...] For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and colour the way the particular key was stroke: The length and vertical position show the velocity, the stripe’s width reflects the length of each note. Furthermore the system allows the piano player to switch between the standart 2d view and an additional 3d view of the visualization while playing. Read more.. [...]

Planner Reads » Blog Archive » Clavilux 2000 – Interactive music visualization – February 14 10, 5:23 pm

[...] For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and speed the way the particular key was stroke. Colours give the viewer and listener an impression of the harmonic relations: Each key has it’s own color scheme and “wrong” notes stand out in contrasting colors. All stripes stay and overlap each other in an additive way, so at the end a kind of pattern remains – a summary of the music – which will be always unique since the notes of the composition aswell as the interpretation of the piano player are influencing the outcome. Furthermore the piano player can switch between the standart 2d view and an additional 3d view of the visualization while playing. Source [...]

Clavilux 2000 [vvvv] by @uleria | CreativeApplications.Net – February 13 10, 2:07 am

[...] For every note played on the keyboard a new visual element appears in form of a stripe, which follows in its dimensions, position and colour the way the particular key was stroke: The length and vertical position show the velocity, the stripe’s width reflects the length of each note. Furthermore the system allows the piano player to switch between the standart 2d view and an additional 3d view of the visualization while playing. Read more.. [...]

uberVU - social comments – February 5 10, 2:24 pm

This post was mentioned on Twitter by EpicallyHarshed: Music Visualization - so dope: http://www.jonasheuer.de/index.php/clavilux-2000/...

Dasignblog » Blog Archiv » Musik visualisieren – Die Arbeiten von Jonas Friedemann Heuer – January 22 10, 2:17 pm

[...] Ein weiteres interaktives Projekt ist der Clavilux 2000. Ein Keyboard mit dem man live grafische Visualisierung von Musik generieren kann, indem man jegliches Lied auf dem Instrument spielt. Für jede einzelne Note wird ein neues visuelles Element in Form eines Rechtecks generiert, dass in seiner Größe, Position und Geschwindigkeit abhängig davon ist, wie man die Taste spielt. Farben geben einen Eindruck der harmonischen Beziehungen, falsch gespielte Noten stechen farblich heraus. Am Ende eines Liedes sieht man eine Visualisierung, die das Lied grafisch wiedergibt, denn alle Elemente bleiben stehen und überlappen sich. Diese Visualisierung ist jedes mal einmalig, da sie abhängt von der Art und Weise wie ein Lied gespielt wird. Es gibt einen 2D und einen 3D Modus der Visualisierung. Mehr Infos dazu gibt es ebenfalls auf der Seite von Jonas. [...]

Tweets die Clavilux 2000 erwähnt -- Topsy.com – January 7 10, 12:13 am

[...] Dieser Eintrag wurde auf Twitter von David Snyder, ZachariahJamesParks erwähnt. ZachariahJamesParks sagte: RT @EpicallyHarshed: Music Visualization - so dope: http://www.jonasheuer.de/index.php/clavilux-2000/ [...]

creative coding » Midi Visualisaton – December 8 09, 9:29 am

[...] Link Permalink|Comments RSS Feed - Post a comment|Trackback URL. [...]

Benny Reimold – December 3 09, 1:14 pm

Hi Jonas,
bin letztens schonmal über dein Twitteraccount (über den von David) bei dir hier gelandet und dachte, ich hinterlasse mal einen Kommentar.
Das Clavilux-Teil ist extrem cool =)

Grüße aus Sifi
Benny
PS: ich werd das Video bei Gelegenheit mal im Blog verlinken ^^ (falls das nicht okay ist, einfach Bescheid geben)

hagit shimoni – November 13 09, 10:59 am

Hi johne, its Hagit. I dont know if u remember but I studied in Hfg last year as student exchange from Israel(Mario friend:).
anyway i saw your project and i loved it! Good luck!

Asaad – August 23 09, 4:17 pm

Das Projekt ist sowas von geil! Also echt richtig gut! Begeistert mich selbst ein Semester später.

Günther Johne – July 5 09, 11:32 pm

Falls du dich doch mal erbarmst zu antworten, ich habs nicht ausm Kopf bekommen:
Wie kannst du aus einzelnen Noten die Tonart bestimmen? Ich mein wenn du ein “C” spielst, kannst du das im Quintenzirkel doch dem C-Dur genauso zuordnen wie dem G-Dur oder nem As-Dur.
Kommt da ja jeweils vor.

Grüße =)

Günther Johne – July 2 09, 11:21 am

Mich zerfetzts, das ist total Strhansi. Wo hängt denn der Beamer, so seitlich?

Grüße

Andreas Fürst – June 8 09, 7:42 pm

Gabi hat gerade deine Visualisierten Töne entdeckt. War schön anzuhörschauen. Genial generativ!
Hoffe Deine Arbeit und Musik machen weiterhin Spaß.
Beste Grüße auch an Joana und hoffentlich bis bald (findet da nicht in Kürze ein Kongreß für visualisierte Musik in Leipzig statt)
Dein Andreas und Gabi

Please, leave a comment.