I like the premise, and its ALMOST there, imho, but some of the timing, clipping is a bit off, there is some skipping/tripping and there are artifacts all over your samples.. clean this up, get rid of the distraction of unpolished elements, and its an interesting toy..
RE: Game play
I think a Simon-says/copycat.. or guitar hero, sort of game paradigm could work with this.