Well, this ... really isn't what brawler games are like. It feels more like a weak strategy game than a fight. If you hit something, it should react to the hit, fly backwards a bit, become stunned, that kind of thing. When you hit the attack button, the attack should resolve automatically. You can do this by adding a few extra variables.
The graphics are nice, and you are on the right track with some features. Try studying more classic brawlers like Golden Axe or River City Ransom and keep making more. I love brawler games and I have made a few, so PM me if you have a question about making them.