I have not read GEB but I thought his second book, I am a Strange Loop, did a pretty good job of connecting the idea of self referential loops (like in godels proof) to consciousness and art and such.
Thanks for the suggestions. Just checked out some of Le Ton Beau de Marot, will most likely read the rest.
Actually, I was recently wondering whether poems can be interpreted as "efficient" computer programs. Words in a sentence/essay just connect different objects in space and time (syntactically and semantically) to form some concept, kind of like a program. A poem just uses higher order abstractions (imagery) to express the same concepts in fewer words.