The final Crowded House album (Together Alone) and his first solo album (Try Whistling This) are my personal favourites. Slightly more experimental on the songwriting front and the production moves away from the 80s-ish whistles and boings into something a bit more tasteful. 
And if you enjoy those two, head for I’ll Be Lightning by his son next.