Tricky
Wow. You had me after the "press the color of the herring" part. I reacted too soon at the color change and pressed the wrong button! Argh!
This was a good mind game though. If you plan to make a sequel, try making the buttons move around, add more colors, and/or try making new kinds of puzzles with them.