If you've never been...
...to Last Vestige records on Quail Street in Albany, you should really go there. I hadn't been in a while, and when i stopped in recently, i was reminded how great it is, and how great used record shops are in general. They have a good selection of CD's and a nice amount of old records. You can also do some great dollar record shopping in the bargain bins.