Not just another Theremin or KAOSS-style control. Now you're playing with cubes. Image courtesy the developer.

Not just another Theremin or KAOSS-style control. Now you’re playing with cubes. Image courtesy the developer.

Cue the Tetris theme, and start playing music by navigating a field of cubes.

So, you’ve seen X/Y touchpads before, many times, in hardware like the KAOSS Pad (or Lemur, or your computer trackpad). But AeroMIDI 3D does something rather different: instead of just a single X/Y area, you get an array of programmable 3D cubes floating in space, all triggered with waves of your fingers using the forthcoming Leap Motion connect. Use one finger, multiple fingers, different parameters, whatever you like, and notes and control messages are sent via MIDI to your favorite software.

You get three dimensions of control for each finger, if you like, and the developer promises low-latency gesture recognition. The software is available for Mac and Windows.

With Leap Motion apparently on track for a release next month, you could have your fingers on this very soon. And this is the second dedicated music app we’ve seen in development for the Leap, even before it has been released. (Leap Motion recently did a round-up of music apps; more are on the way.) Previously:
From Gestures to MIDI: Geco Promises Music Applications for Leap Motion

Video:

And more details from the developer:

AeroMIDI uses the Leap Motion controller to track your fingers in 3-dimensional space, allowing you to trigger notes and MIDI continuous controller messages. Works with any MIDI software or hardware! Control synthesizers, lighting rigs, DAWs, effects, virtual instruments, and any other MIDI-capable hardware or software with AeroMIDI!

AeroMIDI is the virtual 3D glue between your synths and your fingers. Prepare to create music in a whole new way.

Welcome to AeroMIDI – New Dimensions in MIDI Control!

**AeroMIDI and the Leap Motion are expected to be released in late July 2013.**

To learn more, go to:
http://aeromidi.net

24 responses to “Control Music with Cubes Using Your Fingers: AeroMIDI 3D for Leap Motion”

  1. foljs says:

    Am I missing something?

    At no point in the video it uses a 3rd dimension.

    In all instances, it only uses the front face of some cube, as a X/Y input.

    • davydka says:

      The video isn’t a very good demo, but I think that as you touch the cubes, it tracks how how deep you press into it. In the screenshot above, the two green cubes have different sized touch points drawn on them.

    • Acoustica says:

      Foljs, it uses the 3rd dimension in more than one way. You can place cubes in Z (front to back) as well as control CC parameters in the Z dimension. This video shows this better: http://www.youtube.com/watch?v=bQ-XZFnYfao Also, just search youtube for ‘aeromidi’ or sign up to our FB page to get more videos. Thanks!

  2. foljs says:

    Am I missing something?

    At no point in the video it uses a 3rd dimension.

    In all instances, it only uses the front face of some cube, as a X/Y input.

    • davydka says:

      The video isn’t a very good demo, but I think that as you touch the cubes, it tracks how how deep you press into it. In the screenshot above, the two green cubes have different sized touch points drawn on them.

    • Acoustica says:

      Foljs, it uses the 3rd dimension in more than one way. You can place cubes in Z (front to back) as well as control CC parameters in the Z dimension. This video shows this better: http://www.youtube.com/watch?v=bQ-XZFnYfao Also, just search youtube for ‘aeromidi’ or sign up to our FB page to get more videos. Thanks!

  3. foljs says:

    Am I missing something?

    At no point in the video it uses a 3rd dimension.

    In all instances, it only uses the front face of some cube, as a X/Y input.

    • davydka says:

      The video isn’t a very good demo, but I think that as you touch the cubes, it tracks how how deep you press into it. In the screenshot above, the two green cubes have different sized touch points drawn on them.

    • Acoustica says:

      Foljs, it uses the 3rd dimension in more than one way. You can place cubes in Z (front to back) as well as control CC parameters in the Z dimension. This video shows this better: http://www.youtube.com/watch?v=bQ-XZFnYfao Also, just search youtube for ‘aeromidi’ or sign up to our FB page to get more videos. Thanks!

  4. Chad Clark says:

    This is the kind of thing that does not interest me.

  5. Chad Clark says:

    This is the kind of thing that does not interest me.

  6. Chad Clark says:

    This is the kind of thing that does not interest me.

  7. Lee Chaos says:

    This is awesomely exciting. I do a lot of work with people with special educational needs, and the price-points and flexibility of this pairing make this an affordable development for people who find conventional instruments challenging.

    Plus I’ll be waggling my arms about onstage to control my own stuff, obviously….

  8. Lee Chaos says:

    This is awesomely exciting. I do a lot of work with people with special educational needs, and the price-points and flexibility of this pairing make this an affordable development for people who find conventional instruments challenging.

    Plus I’ll be waggling my arms about onstage to control my own stuff, obviously….

  9. Lee Chaos says:

    This is awesomely exciting. I do a lot of work with people with special educational needs, and the price-points and flexibility of this pairing make this an affordable development for people who find conventional instruments challenging.

    Plus I’ll be waggling my arms about onstage to control my own stuff, obviously….

  10. PetitZozo says:

    First picture looks a bit like Dataspace from tsugi https://www.youtube.com/watch?v=ctaE8Vfc7Bs another Leap motion app that lets you browse your sound / music collection in 3D, with sounds having similar perceptual features being close to each other.

    • santosh varma says:

      hi PetitZozo,

      could you help me how to move a cube using leap motion.and is it possible to develop in java?

      Thanks in advance

  11. PetitZozo says:

    First picture looks a bit like Dataspace from tsugi https://www.youtube.com/watch?v=ctaE8Vfc7Bs another Leap motion app that lets you browse your sound / music collection in 3D, with sounds having similar perceptual features being close to each other.

    • santosh varma says:

      hi PetitZozo,

      could you help me how to move a cube using leap motion.and is it possible to develop in java?

      Thanks in advance

  12. PetitZozo says:

    First picture looks a bit like Dataspace from tsugi https://www.youtube.com/watch?v=ctaE8Vfc7Bs another Leap motion app that lets you browse your sound / music collection in 3D, with sounds having similar perceptual features being close to each other.

    • santosh varma says:

      hi PetitZozo,

      could you help me how to move a cube using leap motion.and is it possible to develop in java?

      Thanks in advance

  13. junai says:

    If I may, I think the low-key aspects of Leap Motion usage–the ability to trigger shortcuts and actions without looking at something, just by waving your hand in the air–may be more important than the flashier aspects. I wrote up a few thoughts on starting to use Leap Motion with Reason here: http://junai.tumblr.com/post/56331714424/using-the-leap-motion-and-bettertouchtool-with-reason

  14. junai says:

    If I may, I think the low-key aspects of Leap Motion usage–the ability to trigger shortcuts and actions without looking at something, just by waving your hand in the air–may be more important than the flashier aspects. I wrote up a few thoughts on starting to use Leap Motion with Reason here: http://junai.tumblr.com/post/56331714424/using-the-leap-motion-and-bettertouchtool-with-reason

  15. junai says:

    If I may, I think the low-key aspects of Leap Motion usage–the ability to trigger shortcuts and actions without looking at something, just by waving your hand in the air–may be more important than the flashier aspects. I wrote up a few thoughts on starting to use Leap Motion with Reason here: http://junai.tumblr.com/post/56331714424/using-the-leap-motion-and-bettertouchtool-with-reason

Leave a Reply to PetitZozo Cancel reply

Your email address will not be published. Required fields are marked *