I'm more inclined towards glitchy, experimental stuff like this, but this could use some things for it to sound great. For one, the sounds used and the glitches are quite dry. The break could be cleaned up more, you could also play around with chopping the sample and doing all sorts of arrangements with it to make it more exciting. You could pan the vocals, delay them, destroy them too. The glitchy noises can really shine when they're put under the right processing, some modulated filters and something to smooth them out more.
I don't mean to be harsh, but it sounds like an experimentation session you put drums and some vocals over. This is a subjective thing, but it doesn't feel like the instruments are interacting between each other much, which would otherwise make the track more cohesive and grounded. Repeating phrases here and there, instruments going out as others come in, a consistent groove to legitimize the noise in between, I know this is a work in progress but just details like that are what I feel make a great glitchy track.
I think I heard some other sounds in there? Like a bass at 0:06 and some kind of white noise at 0:05? The glitchiness together with the break make it a bit hard to discern those extra sounds, you could mix them so they can leave a bit of space for the accompaniments. Just the glitchiness and the breaks alone take up a lot of presence, so you'd need to EQ them well so they don't overshadow the other elements.
For what you have right now, I'm intrigued to hear what the full track will sound like.