Beat can get clumsy
I kind of see what you're trying to do with all this sampling and putting drums over stuff, and yeah it's a noble pursuit I guess, if done right, but I don't like how this was done, honestly. For starters, it sounds too bare. Sure, you've got the sample in there, but don't rely too much on the sample. This needs a bass, and other melodies to go with it. I'm sure you know how to do that, but you're just experimenting/comfortable with using samples to make songs. So maybe next time, write your own melodies to go with the sample of your choosing?
Another thing that bugged me about this is how it kind of went nowhere. Like the beat clumsily went along with the sample for the majority of the song, and nothing really happened. So probably next time organize your song like with verses and choruses, with verses representing the quiet more melodic parts and choruses representing the parts everything explodes. I don't know.
Anyway yeah, you could use some work making this kind of music. Or perhaps a rapper. Maybe next time collaborate with a rapper, it'd sound much much better. Even Nujabes got people to rap over his beats, even if they were like classical pieces in terms of complexity and stuff. Yeah.