Sonifying UDK Skeletal Mesh Components with UDKOSC and Supercollider


We’ve touched on many many fairly complicated aspects of UDK, UDKOSC, Open Sound Control and SuperCollider usage here and left many many unanswered questions. And that’s ok. Stringing together systems like this can seem overwhelming at first but in the end, each individual process really isn’t that complicated on its own.

Musically, ECHO::Canyon is still evolving and drastic changes are afoot even as we speak… err… type. Check out a full demo fly-through of our current (as of 9/2013) working environment below. And for more information about the piece, UDKOSC or our ongoing research into Music in Virtual Worlds, check out these project links, or feel free to post any questions below.

Full ECHO::Canyon demo fly-through

Here’s a fun (but long) demonstration fly-through video of an early version of our ECHO::Canyon performance environment. The posing state and manual wing articulations are used in a few places, as well as musical sonification of many other in-game parameters.



UDKOSC Development Wiki:
UDKOSC github repository:

Rob Hamilton – Center for Computer Research in Music and Acoustics:

mvw blog:

Related Research:

Hamilton, R., “Musical Sonification of Avatar Physiologies, Virtual Flight and Gesture” In Proceedings of the 10th International Symposium on Computer Music Multidisciplinary Research (CMMR), Marseille, France, 2013.

Hamilton, R., Sonifying Game-Space Choreographies with UDKOSC, In Proceedings of the New Interfaces for Musical Expression Conference, Daejeon, Korea, 2013.

Hamilton, R., UDKOSC: An Immersive Musical Environment, In Proceedings of the International Computer Music Association Conference, Huddersfield, UK, 2011.

Hamilton, R., Caceres, J, Nanou, C., Platz. C, Multi-modal musical environments for mixed-reality performance, Journal for Multimodal User Interfaces (JMUI), Vol. 4, pp. 147-156, Springer-Verlang, 2011.

Hamilton, R., q3osc: or How I Learned to Stop Worrying and Love the Game, In Proceedings of the International Computer Music Association Conference, Belfast, Ireland, 2008.

Hamilton, R., Maps and Legends: Designing FPS-based Interfaces for Multi-User Composition, Improvisation and Interactive Performance, Lecture Notes in Computer Science: Computer Music Modeling and Retrieval 2007 Journal, Springer-Verlang, 2008.

Tagged with: ,
Posted in UDKOSC

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: