Okay, here's some sleepless musings on the idea of zero voting.
The thing about the portals here on newgrounds, both flash and audio, is that the signal to noise ratio is... less than good. The flash portal shows this quite a bit better than the audio portal (as evinced by the blam system), but I would bet if I looked at the latest 50 audio submissions I would find a large number of them to fall into the 'noise' side of that ratio. Whether they're silly/spammy 'voice acting' submissions, another generic dance/electro track that uses the same presets everyone bitches about, linkin park's latest single, a midi-ripped mario theme or god knows what else, they're not really up to the snuff of some of the really great artists. (Don't get me wrong, a few of my submissions fall into the 'noise' category, without any shadow of a doubt.)
What does this have to do with zero voting? It's hard to say, but I think we can agree that it doesn't create an idea environment for a voting system that's truly representative of the quality of work. Add to that anonymity and the ability to vote every day, and you create an environment where a determined individual can take it upon himself to reduce a chosen artist's work to being buried in the rankings. The motivations aren't always clear, maybe it's jealousy (this might be the most often touted reason), maybe it's boredom or maybe it's just general malice. Certainly some of the low scores are intended to make way for the voter's own work.
However, every 'solution' i've seen proposed is unworkable for one reason or another. 'Make the votes public!' is a common cry. What does this really accomplish? New accounts are free, and people may well be able to bypass the limitations placed on the voting system. (This is up for debate, but it wouldn't surprise me).
"make the scores based purely on reviews!" has some merit. It (hypothetically) limits each user to a single vote, and requires at least some amount of input and effort. This is probably the best of the ideas that i've heard, however then we're left policing hundreds and thousands of spammy reviews, and new accounts are still free.
These are the two big ones that come to mind (i haven't slept tonight, so I may be forgetting some), and I've definitely heard them both a lot.
Regarding the commonly accepted wisdom that 'scores don't matter', and the sentiment that the voting system is the crux of the entire portal, that the rankings depend on it and so forth, that is true. However, you have to ask yourself if the rankings REALLY matter. Why do you want to be in the top 30? So you can get a hundred 10 reviews that say 'great job' ?
I don't know. These are just some of my thoughts on the subject.