There’s a tonne of pre-Isn’t Anything stuff but it’s almost a different band.
Really early stuff was sub-Cramps/Birthday Party type goth stuff (with a different singer), then they went all jangle pop in the mid 80s, that stuff is pretty decent.
I’m not sure there are any “proper” albums though, just lots of 12”s and 7”s and sub-30 minute releases and compilations.