Some bands that are small make their own vinyl. A Scottish band released a LP last year, 400 copies, all made out of chocolate.
The LP has the most possibilities for dicking about with it - bands such as NON who have done records of nothing but locked grooves, the infinite finish that locked grooves are usually used for, the twin tracks random playing trick. SO MUCH FUN!!!
Many items are still only available on vinyl or, if we really want to get ancient, bakelite.
Space is an issue, however, and always store your vinyl upright and in a vinyl storage case - OR - on a shelf, just as long as there is no direct sunlight, dampness, etc.
My other problem with vinyl is that, I need to have all of my music on me all of the time, on shuffle. I need to get a vinyl to MP3 deck. But I will probably get a tape to MP3 first, as I am going to hunt down the Spanish Edition of Kraftwerk's Computer World.
As I collect 80's, I will need these things, so much stuff has never been reissued!