July 19, 2010
10048 Gestural Music Sequencer [Processing, Sound]
For those that may not know I had a pleasure of being invited to speak at the Flashbelt conference that has just ended. Over the next few weeks I will be writing about the great people I got to meet there and one of those is John Keston, a founder of AudioCookbook.org. The site is a non-profit resource for music and sound enthusiasts made possible by contributions from Unearthed Music.
One of the AC-org projects is the GMS, a Gestural Music Sequencer developed in Processing by John Keston. The application is essentially a performance tool that converts video input into musical phrases. It samples video and displays it either normally or inverted so it looks as though you’re looking into a mirror. Each frame is analyzed for brightness, then the X and Y data of the brightest pixel is converted into a MIDI note. The X axis is used to select a pitch, while the Y axis determines the dynamics. As users move, dance, gesture, or draw in front of the capture device, notes are generated based on a predetermined scale. Currently the available scales are pentatonic minor, whole tone, major, minor, and chromatic, all of which can be dynamically selected during a performance.
Other dynamic controls include MIDI out channel, BPM, low and high octave, transposition, sustain, duration selection (manual or randomized with probability distributions), BPM adjustment, and note randomization. A “free” mode allows the durations to be manipulated by the mean brightness of the video input. Finally, four, simple video filter presets were recently added that can be applied by pressing shift + [1-4]. The application works especially well in dark lighting while using a light source to control the sequencer. More information on the controls and features can be found in the readme.txt file distributed with the download.
You can read more and download the beta version of the application by visiting audiocookbook.org/gms/
Credits:
John Keston – Development
Grant Muller for work on improving the RWMidi library for Processing.
Ali Momeni inspiring John to develop the software as a potential tool for Minneapolis Art on Wheels.
- Author: Filip
Architect, Lecturer, New Media Technologist. Based in London and Berlin. MacBook Pro 15″ + iPhone.
URL: http://www.fvda.co.uk
View all entries by Filip
You might also like:
RGB MusicLab [Mac, Windows]
CAN at Flashbelt 2010 + Contest [Events]
TypeStar [Processing, Sound]
blog comments powered by Disqus
The audio for the lava lamp is created by analyzing the level of brightness for each frame in realtime!
Leave a Comment » | 
video | 
Permalink
Posted by fastore
July 15, 2010
Great example of compositing and effects
Leave a Comment » | video | Permalink
Posted by fastore
June 25, 2010
Wonderful performance piece using a mixture of live and pre-recorded video.
Leave a Comment » | video | Permalink
Posted by fastore
April 30, 2010
Here are some handy links to get you started with Apple’s motion graphics package Motion;
Leave a Comment » | mdcm3002, newsouthblogs, video | Permalink
Posted by fastore
April 27, 2010
This sounds worthwhile getting along to;
Friday on My Mind at AFTRS this week ‘Storyboarding Universe’ – David Russell is one of Hollywood’s top conceptual illustrators who cut his teeth on Star Wars: Return of the Jedi. Since then, he has created key sequences for over 100 productions including Who Framed Roger Rabbit, Batman, Terminator 2, The Thin Red Line, Moulin Rouge, Wolverine, Sanctum and The Chronicles of Narnia. He shares with us the secrets of capturing cinematic style and action at the crucial planning stage.
This Friday 5pm AFTRS Sydney – all welcome!
www.aftrs.edu.au
Australia
Leave a Comment » | mdcm3002, newsouthblogs, Uncategorized, video | Permalink
Posted by fastore
March 21, 2010
A list compiled in the SMH. I think the list could have been endless!
Leave a Comment » | afterEffects, mdcm3002, newsouthblogs, video | Permalink
Posted by fastore
March 7, 2010
Welcome to MDCM3002 Video Production!
This is where we’ll be posting course notes, links, discussions, works-in-progress, final videos and all kinds of other stuff that will help you in your learning experience.
The course outline is available here
Leave a Comment » | FinalCut Studio, mdcm3002, newsouthblogs, video | Tagged: editing, finalcut, mdcm3002, video | Permalink
Posted by fastore
March 7, 2010
There are countless resources on the web to help learn all aspects of digital video production. This is a list of sites I have found most useful;
- Creative Cow Forums is a great resource for just about all the major digital video and animation/motion graphics packages out there. Includes online forums and loads of tutorial material as well. This should be your first port of call. http://forums.creativecow.net/
- Squidoo is a graphics design oriented learning resource.
- Motionographer has an up to date list of the current hot production houses and individuals working in motion graphics
- Digitalzoo is a good collection of general resource. links
This list will gradually be added to.
Leave a Comment » | afterEffects, mdcm3002, newsouthblogs, video | Tagged: afterEffects, compositing, editing, finalcut, graphics, mdcm3002, motion, sfx, video | Permalink
Posted by fastore
March 6, 2010
Mat is posting some great stuff as usual over at the mdcm2002 blog and he’s remimnded me of Ken Stone’s great finalCut site and especially this useful article on the language of film by Michael Wohl.
Leave a Comment » | afterEffects, FinalCut Studio, mdcm3002, newsouthblogs, video | Tagged: chroma key, faqs, finalcut, finalcut editing, mdcm3002, tutorials, video | Permalink
Posted by fastore
