If you're getting a guitar, I would HIGHLY recommend the Epiphone Les Paul Special II. It's not even that it's a good starter guitar, but it's incredibly low priced for its quality, and you can make it sound like pretty much anything you like.
As for an amp, I would get the Fender Frontman 212 DSP. It's loaded with built-in effects (No screwing around with pedals for half an hour trying to get everything adjusted and hooked up right, woohoo), like Flange, Reverb, Chorus, and a couple other ones. t has presets to emulate other Fender amps, as well. It's light enough to use a practice amp, but beefy enough to bring gigging.
It's the amp that I'm currently running, and it has a surprisingly loud sound, but if you're going into the hardcore customization area, I would suggest getting a Reaper 12", if you can find one. I've never actually used one, but I hear they're amazing.
For cables, I would recommend Monster Cable, they're almost transparent, and let the sound of pretty much any guitar ring through perfectly, and they're rather inexpensive as well.
Musician's Friend FTW.