Jonathan Richman - Not So Much To Be Loved as to Love

Kirsty MacColl - Galore

Sebadoh - III

Howard Devoto - Jerky Versions of the Dream

Material Issue - The Best of

To answer your question, that band that did the song "Valerie Loves Me." The Onion A.V. Club had an article about how cool one of their albums was. Here it is: http://www.avclub.com/content/node/70012 The album itself I couldn't find, in fact, I couldn't find any proper album by them so instead here's a greatest hits, we're not posuer though because we were forced by necessity.

Sebadoh - The Freed Man

The Replacements - Nothing for All

The second disc from the two disc set "All for Nothing/Nothing for All." The first was a collection of singles from the Sire years, you should listen to those as part of their albums as the artists intended! These here are rarities. All Shook Down sounds exactly the same except no John Cale viola, a recorder instead. Recorders sound sad as hell, I can't tell if I feel that way because they actually are or because of the bird funeral on that episode of The Office. Anyway, download this.