If you want a dedicated player but don't want to leave the phone ecosystem, why not a pair of headphones that has an integrated player?
If you're gonna be weird, don't be just a little weird, go all out.
On the cheap and terrible end, Antetek has a pair of Bluetooth headphones that have an integrated MP3 player, and an FM radio!
On the high end, the Sony NW-WS413's are just a standalone pair of headphones that play MP3's (but are waterproof).
Headphones are like dicks for your ears, so I wouldn't make any recommendation, but I'm sure capitalism can provide something that works for you.